2020-11-20T11:40:08.798 INFO:root:teuthology version: 1.0.0-357fd4a 2020-11-20T11:40:08.800 DEBUG:teuthology.run:Teuthology command: teuthology --block --description fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/kernel_untar_build} --archive /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640305 --owner scheduled_pdonnell@teuthology --verbose --lock --name pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi -- /tmp/teuthology-worker.wym0qfig.tmp 2020-11-20T11:40:08.845 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:40:08.936 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640305 branch: wip-pdonnell-testing-20201120.053228 description: fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/kernel_untar_build} email: pdonnell@redhat.com first_in_suite: false job_id: '5640305' kernel: client: sha1: distro kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.3' overrides: admin_socket: branch: wip-pdonnell-testing-20201120.053228 ceph: cephfs: session_timeout: 300 cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 15m rados osd op timeout: 15m global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 15m rados osd op timeout: 15m mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 20 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20201120.053228 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb owner: scheduled_pdonnell@teuthology priority: 95 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - osd.2 - osd.5 - osd.8 - osd.11 sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb sleep_before_teardown: 0 suite: fs suite_branch: wip-pdonnell-testing-20201120.053228 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - kclient: null - check-counter: counters: mds: - mds.dir_split - workunit: clients: all: - kernel_untar_build.sh teuthology_branch: master timestamp: 2020-11-20_08:39:42 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.21151 2020-11-20T11:40:08.936 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa; will attempt to use it 2020-11-20T11:40:08.937 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa/tasks 2020-11-20T11:40:08.937 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-11-20T11:40:08.939 INFO:teuthology.task.internal:Checking packages... 2020-11-20T11:40:08.961 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'basic' and ceph hash 'b86e691bf191566922a8f08e2a5abf64fde8cfcb' 2020-11-20T11:40:08.961 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-11-20T11:40:08.962 INFO:teuthology.packaging:ref: None 2020-11-20T11:40:08.962 INFO:teuthology.packaging:tag: None 2020-11-20T11:40:08.962 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20201120.053228 2020-11-20T11:40:08.963 INFO:teuthology.packaging:sha1: b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T11:40:08.963 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20201120.053228 2020-11-20T11:40:09.117 INFO:teuthology.task.internal:Found packages for ceph version 16.0.0-7397.gb86e691b 2020-11-20T11:40:09.117 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-11-20T11:40:09.140 INFO:teuthology.task.internal:no buildpackages task found 2020-11-20T11:40:09.140 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-11-20T11:40:09.157 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-11-20T11:40:09.158 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T11:40:09.217 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:40:19.233 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:40:29.248 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:40:39.263 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:40:49.279 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:40:59.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:41:09.304 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:19.321 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:29.336 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:39.352 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:49.370 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:41:59.398 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:09.431 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:19.446 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:29.472 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:39.490 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:49.507 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:42:59.522 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:09.536 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:19.554 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:29.576 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:43:39.598 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:43:49.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:43:59.631 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:09.650 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:19.675 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:29.694 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:39.717 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:49.734 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:44:59.751 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:45:09.799 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:19.818 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:29.831 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:39.847 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:49.866 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:45:59.883 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:09.901 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:19.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:29.938 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:46:39.956 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:46:49.982 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:47:00.007 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:47:10.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:47:20.041 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:47:30.057 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:47:40.076 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:47:50.097 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:00.113 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:10.129 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:20.151 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:30.171 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:40.192 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:48:50.210 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:00.228 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:10.246 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:20.268 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:30.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:40.301 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:49:50.320 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:00.358 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:10.375 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:20.391 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:30.413 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:40.447 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:50:50.466 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:51:00.478 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:10.507 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:20.533 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:30.551 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:40.592 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:51:50.628 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:52:00.652 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:10.673 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:20.692 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:30.729 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:52:40.747 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:52:50.766 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:00.786 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:10.808 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:20.826 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:30.845 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:40.862 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:53:50.879 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:00.897 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:54:10.914 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:20.927 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:30.944 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:54:40.968 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:54:50.982 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:55:01.001 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:11.022 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:21.062 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:31.087 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:55:41.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:55:51.123 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:56:01.147 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:56:11.173 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:56:21.192 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:56:31.212 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:56:41.229 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:56:51.246 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:01.282 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:11.302 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:21.332 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:31.354 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:41.373 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:57:51.395 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:01.434 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:11.450 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:21.467 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T11:58:31.480 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 2)... 2020-11-20T11:58:41.508 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:58:51.526 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:59:01.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:59:11.560 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:59:21.582 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:59:31.599 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:59:41.613 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T11:59:51.630 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:00:01.676 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:00:11.701 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:00:21.724 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:00:31.768 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:00:41.785 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:00:51.804 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:01:01.822 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:01:11.858 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:01:21.882 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:01:31.898 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T12:01:41.922 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T12:01:51.944 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T12:02:01.959 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 1)... 2020-11-20T12:02:11.971 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:02:21.987 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:02:32.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:02:42.026 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:02:52.049 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 0 + 3, have 0)... 2020-11-20T12:03:02.068 DEBUG:teuthology.lock.ops:lock_many request: {'locked_by': 'scheduled_pdonnell@teuthology', 'count': 3, 'machine_type': 'smithi', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640305'} 2020-11-20T12:03:02.098 DEBUG:teuthology.lock.ops:locked ubuntu@smithi093.front.sepia.ceph.com, ubuntu@smithi066.front.sepia.ceph.com, ubuntu@smithi132.front.sepia.ceph.com 2020-11-20T12:03:02.176 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f568f407b70>, signals=[15]) 2020-11-20T12:03:02.388 INFO:teuthology.provision.fog.smithi066:Scheduling deploy of rhel 8.3 2020-11-20T12:03:02.393 INFO:teuthology.provision.fog.smithi132:Scheduling deploy of rhel 8.3 2020-11-20T12:03:02.395 INFO:teuthology.provision.fog.smithi093:Scheduling deploy of rhel 8.3 2020-11-20T12:03:02.738 INFO:teuthology.orchestra.console:Power off smithi132 2020-11-20T12:03:02.739 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T12:03:02.753 INFO:teuthology.orchestra.console:Power off smithi093 2020-11-20T12:03:02.754 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T12:03:02.766 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:02.775 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:02.788 INFO:teuthology.orchestra.console:Power off smithi066 2020-11-20T12:03:02.788 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-11-20T12:03:02.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:06.800 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:06.808 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:06.830 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:10.913 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:10.921 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:10.941 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:11.130 INFO:teuthology.orchestra.console:Power off for smithi093 completed 2020-11-20T12:03:11.149 INFO:teuthology.orchestra.console:Power off for smithi066 completed 2020-11-20T12:03:11.232 INFO:teuthology.orchestra.console:Power on smithi093 2020-11-20T12:03:11.233 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T12:03:11.250 INFO:teuthology.orchestra.console:Power on smithi066 2020-11-20T12:03:11.251 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T12:03:11.259 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:11.272 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:15.024 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:15.234 INFO:teuthology.orchestra.console:Power off for smithi132 completed 2020-11-20T12:03:15.280 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:15.292 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:15.336 INFO:teuthology.orchestra.console:Power on smithi132 2020-11-20T12:03:15.337 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-11-20T12:03:15.361 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:19.392 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi093.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:19.402 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:19.411 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi066.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:19.603 INFO:teuthology.orchestra.console:Power on for smithi093 completed 2020-11-20T12:03:19.621 INFO:teuthology.orchestra.console:Power on for smithi066 completed 2020-11-20T12:03:19.704 INFO:teuthology.provision.fog.smithi093:Waiting for deploy to finish 2020-11-20T12:03:19.723 INFO:teuthology.provision.fog.smithi066:Waiting for deploy to finish 2020-11-20T12:03:23.515 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-11-20T12:03:23.725 INFO:teuthology.orchestra.console:Power on for smithi132 completed 2020-11-20T12:03:23.826 INFO:teuthology.provision.fog.smithi132:Waiting for deploy to finish 2020-11-20T12:05:50.830 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:05:50.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:05:54.846 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:05:59.943 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:05:59.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:03.911 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:08.999 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:09.005 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:12.966 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:18.090 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:18.092 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:22.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:27.146 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:27.174 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:31.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:36.198 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:36.236 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:40.134 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:45.254 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:45.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:49.190 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:54.313 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:06:54.374 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:07:55.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:07:55.580 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T12:07:55.582 INFO:teuthology.orchestra.run.smithi132:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T12:07:55.887 INFO:teuthology.provision.fog.smithi132:Node is ready 2020-11-20T12:07:55.890 INFO:teuthology.orchestra.run.smithi132:> hostname 2020-11-20T12:07:55.913 INFO:teuthology.orchestra.run.smithi132.stdout:smithi132.front.sepia.ceph.com 2020-11-20T12:07:55.914 INFO:teuthology.orchestra.run.smithi132:> grep smithi132.front.sepia.ceph.com /etc/hosts 2020-11-20T12:07:55.974 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.15.132 smithi132.front.sepia.ceph.com smithi132 2020-11-20T12:07:55.975 INFO:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2020-11-20T12:07:56.096 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hosts 2020-11-20T12:07:56.125 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/172.21.15.132/172.21.15.132/g' /etc/hosts 2020-11-20T12:07:56.192 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i -e 's/smithi132.front.sepia.ceph.com/smithi132/g' /etc/hostname 2020-11-20T12:07:56.258 INFO:teuthology.orchestra.run.smithi132:> sudo hostname smithi132 2020-11-20T12:07:56.326 INFO:teuthology.provision.fog.smithi132:Deploy complete! 2020-11-20T12:07:56.327 DEBUG:teuthology.parallel:result is None 2020-11-20T12:08:00.318 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:00.378 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:00.565 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T12:08:00.566 INFO:teuthology.orchestra.run.smithi093:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T12:08:00.821 INFO:teuthology.orchestra.run:Running command with timeout 600 2020-11-20T12:08:00.822 INFO:teuthology.orchestra.run.smithi066:> while [ ! -e '/.cephlab_net_configured' ]; do sleep 5; done 2020-11-20T12:08:00.872 INFO:teuthology.provision.fog.smithi093:Node is ready 2020-11-20T12:08:00.872 INFO:teuthology.orchestra.run.smithi093:> hostname 2020-11-20T12:08:00.886 INFO:teuthology.orchestra.run.smithi093.stdout:smithi093.front.sepia.ceph.com 2020-11-20T12:08:00.886 INFO:teuthology.orchestra.run.smithi093:> grep smithi093.front.sepia.ceph.com /etc/hosts 2020-11-20T12:08:00.940 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.15.93 smithi093.front.sepia.ceph.com smithi093 2020-11-20T12:08:00.940 INFO:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2020-11-20T12:08:01.039 INFO:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hosts 2020-11-20T12:08:01.063 INFO:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/172.21.15.93/172.21.15.93/g' /etc/hosts 2020-11-20T12:08:01.113 INFO:teuthology.provision.fog.smithi066:Node is ready 2020-11-20T12:08:01.113 INFO:teuthology.orchestra.run.smithi066:> hostname 2020-11-20T12:08:01.126 INFO:teuthology.orchestra.run.smithi093:> sudo sed -i -e 's/smithi093.front.sepia.ceph.com/smithi093/g' /etc/hostname 2020-11-20T12:08:01.128 INFO:teuthology.orchestra.run.smithi066.stdout:smithi066.front.sepia.ceph.com 2020-11-20T12:08:01.128 INFO:teuthology.orchestra.run.smithi066:> grep smithi066.front.sepia.ceph.com /etc/hosts 2020-11-20T12:08:01.182 INFO:teuthology.orchestra.run.smithi066.stdout:172.21.15.66 smithi066.front.sepia.ceph.com smithi066 2020-11-20T12:08:01.183 INFO:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2020-11-20T12:08:01.190 INFO:teuthology.orchestra.run.smithi093:> sudo hostname smithi093 2020-11-20T12:08:01.253 INFO:teuthology.provision.fog.smithi093:Deploy complete! 2020-11-20T12:08:01.253 DEBUG:teuthology.parallel:result is None 2020-11-20T12:08:01.298 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hosts 2020-11-20T12:08:01.323 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/172.21.15.66/172.21.15.66/g' /etc/hosts 2020-11-20T12:08:01.389 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i -e 's/smithi066.front.sepia.ceph.com/smithi066/g' /etc/hostname 2020-11-20T12:08:01.453 INFO:teuthology.orchestra.run.smithi066:> sudo hostname smithi066 2020-11-20T12:08:01.517 INFO:teuthology.provision.fog.smithi066:Deploy complete! 2020-11-20T12:08:01.518 DEBUG:teuthology.parallel:result is None 2020-11-20T12:08:01.889 INFO:teuthology.lock.ops:Checking smithi093.front.sepia.ceph.com 2020-11-20T12:08:01.890 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T12:08:01.916 INFO:teuthology.lock.ops:Checking smithi066.front.sepia.ceph.com 2020-11-20T12:08:01.917 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T12:08:01.935 INFO:teuthology.lock.ops:Checking smithi132.front.sepia.ceph.com 2020-11-20T12:08:01.935 INFO:teuthology.lock.ops:New key found. Updating... 2020-11-20T12:08:01.958 INFO:teuthology.lock.ops:Updating [smithi093.front.sepia.ceph.com]: set os type and version on server 2020-11-20T12:08:01.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:08:01.959 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:02.037 INFO:teuthology.orchestra.run.smithi093:> true 2020-11-20T12:08:02.130 INFO:teuthology.orchestra.run.smithi093:> uname -m 2020-11-20T12:08:02.187 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2020-11-20T12:08:02.189 INFO:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2020-11-20T12:08:02.247 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T12:08:02.247 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T12:08:02.248 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2020-11-20T12:08:02.248 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2020-11-20T12:08:02.248 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.3" 2020-11-20T12:08:02.248 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:08:02.248 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T12:08:02.249 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2020-11-20T12:08:02.249 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T12:08:02.249 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T12:08:02.249 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T12:08:02.249 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:02.250 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T12:08:02.250 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T12:08:02.250 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T12:08:02.250 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T12:08:02.251 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2020-11-20T12:08:02.271 INFO:teuthology.lock.ops:Updating [smithi066.front.sepia.ceph.com]: set os type and version on server 2020-11-20T12:08:02.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:08:02.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:02.412 INFO:teuthology.orchestra.run.smithi066:> true 2020-11-20T12:08:02.586 INFO:teuthology.orchestra.run.smithi066:> uname -m 2020-11-20T12:08:02.652 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2020-11-20T12:08:02.653 INFO:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2020-11-20T12:08:02.712 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T12:08:02.713 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T12:08:02.713 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel" 2020-11-20T12:08:02.713 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora" 2020-11-20T12:08:02.713 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.3" 2020-11-20T12:08:02.714 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:08:02.714 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T12:08:02.714 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2020-11-20T12:08:02.714 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T12:08:02.714 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T12:08:02.715 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T12:08:02.715 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:08:02.715 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T12:08:02.715 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T12:08:02.715 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T12:08:02.716 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T12:08:02.716 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2020-11-20T12:08:02.736 INFO:teuthology.lock.ops:Updating [smithi132.front.sepia.ceph.com]: set os type and version on server 2020-11-20T12:08:02.736 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:08:02.737 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:02.859 INFO:teuthology.orchestra.run.smithi132:> true 2020-11-20T12:08:03.033 INFO:teuthology.orchestra.run.smithi132:> uname -m 2020-11-20T12:08:03.096 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2020-11-20T12:08:03.097 INFO:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2020-11-20T12:08:03.161 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T12:08:03.161 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T12:08:03.161 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2020-11-20T12:08:03.162 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2020-11-20T12:08:03.162 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.3" 2020-11-20T12:08:03.162 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:08:03.162 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T12:08:03.163 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2020-11-20T12:08:03.163 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T12:08:03.163 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T12:08:03.163 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T12:08:03.163 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:08:03.164 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T12:08:03.164 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T12:08:03.164 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T12:08:03.164 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T12:08:03.165 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2020-11-20T12:08:03.189 INFO:teuthology.task.internal.lock_machines:3 smithi machines locked this try, 3/3 locked so far 2020-11-20T12:08:03.258 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi066.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDETzklulgZf9iOkqm6Cph+dC9vlmFslG8Uc2Oiu3lnnH3GsMPIqvSZ4DRUi8gd5io4g8y6W4O1GrtnInoYZ1seH6nm4CjRBhmTfnInQDw3ohGYdj+u0bbZcl4eqW/wdX2NjYr61WgjP6WHw0ZAQAjzqbVMQOm6MbvHTBYhtpFmLbsdqVIDFezhQNtit+BiMh2wWRnHOrRMGI8qIbxEF5DTUqKt1F2B/hhyVMfoeW29Ab2X5MU4Unl8kiB41wizcGRkDDZ8cmgzCJpbfH4IqwrFQYVJaBJkRhGxo3s4KpYZeMyqxNl8F1xW7VOeKsQIfDL5YZwRtwgwvQEk7DPEl6pK0qJp8ZbYcx8wjGQJMG0F0wFGsLGHijc+vyuoOZzhONjJBmZplRepBI5vpdS/Ur3VQLAmnqeN2gkSS4IGaMjo/zZ2JOLcHjJGqTBY4vVkYYsqCDOEpdAywHQm051dy7JYXXq4N13C2N3jF20axusArrgH4W+LolvwpGjuAD5IN6M= smithi093.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwemX6/TcjI085GGC4d1QmTSRpFcOkMKlFq03Cy1FeXmM869WwdFFeUpai/BGY3zOnczsR/NUCDSN5DUQyV9ZEMiFllrK/LnEm4Vxh/o1X17OWi+0bFDuOY6XtOWmiC7y/MFxHtoS+3Th7onq+XK37L65zlOA9QQM9xr26+Mk5EeAZ9Eyofw6uVQB1ZbsYgT3ykWtXnjTiQEh6hLwI7ockOvGSuwOVN0uVze778LUi3jkfl+JEuUfLeGUTludcxX0cHtP13/KwAnS9CziRF0EoFYQdU6M8LKIMtrET2ruIDPpwJyUxYxgZUzDKpBTfPJf2OlUXrETGnUpzacAa/xPkgg9AOSfjs9OgAeJZLsynHmXVEb3LaWkiDhX8Ou/CS9Q4jbY5PS5MqSMOxJsGAHIekmQBURZUYz4DBgjzryKQoSx43wKwLSSU9ia56KAaGidkqaDkOYpiYRPLTS9hhB+8/9WZmiESXL88Bz+BChp3wWaa8O+tSIssE80qTdTk4JM= smithi132.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl//kXSjtIaY94UKPY9NDOVuAv62Wnr4qs1PmsK6Ko0UY39HeFPLMhGh3tuRzPI8AFJb03YiUqMUdqfk9CmwjthjLTkqNv/I8t3DT+CzImQh917aclUW9dCDTsJsy7qBEPJnIqPBG/5HpKRUKsE0QIb8y/JaFd1v/223EYFKxmBQAfn9OUL/WdNDVBzBDYM4v6BWmvpORKyYF6sYQP949fxFwSpRZ8dqAaK1Qv7vmg6atkZDiSA91rbh1xYWPVObdNhqsDVTFlgfB6jB0NPbZisfTlqEx1tPaDUBb/pa74QDlTIO/OkNZM3jm0YCDnZxPQ0pirBz5F1rCqRH7BIGIIky3i79YpDe7mkSTI2SnG/243XcLVkHh9XMrGkNdZlTtkSu6rsu/v1S3hDPWclZHpWNOucu0Yxs94u677U2Iy6PKIfG6C+ih0WH1c8SODIDTE2D2nY/FBQtIbiVDlEL9jsr5AOC3QQGgvZqWdTeaVgXvO9M4jYs2qfr7UxYWU0U= 2020-11-20T12:08:03.258 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-11-20T12:08:03.323 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-11-20T12:08:03.332 INFO:teuthology.task.internal:Saving configuration 2020-11-20T12:08:03.352 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-11-20T12:08:03.360 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-11-20T12:08:03.381 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 12:03:02.080780', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640305', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCsUPShyGrQ36i8z77CBClpKcuhycWm5OldTAlWEsrXh4/X4or9wl2CMPJSfsB5jkQg6NuICltinu9dJnxMrv4k=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi093.front.sepia.ceph.com'} 2020-11-20T12:08:03.404 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 12:03:02.080801', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640305', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDq9ObDHnYsuq3XUc+4WcuwiqpsGhDZw105alRw9OHB7f0uHtKz1IltuF4MXueqFXZ9LCw5OROjwK4nPdE7jFBc=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi066.front.sepia.ceph.com'} 2020-11-20T12:08:03.422 DEBUG:teuthology.task.internal.check_lock:machine status is {'is_vm': False, 'locked': True, 'locked_since': '2020-11-20 12:03:02.080817', 'description': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640305', 'locked_by': 'scheduled_pdonnell@teuthology', 'up': True, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKyzOl4Vm5NhlLLUgONhijS082bLYwqzAlfSNpKpBrpqwnpMrLAzmCQLugi/aIFR8j1jwpl1NQhtHbNbqO4Wn50=', 'os_version': '8.3', 'machine_type': 'smithi', 'vm_host': None, 'os_type': 'rhel', 'arch': 'x86_64', 'mac_address': None, 'name': 'smithi132.front.sepia.ceph.com'} 2020-11-20T12:08:03.423 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-11-20T12:08:03.431 INFO:teuthology.task.internal:roles: ubuntu@smithi093.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2020-11-20T12:08:03.431 INFO:teuthology.task.internal:roles: ubuntu@smithi066.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2020-11-20T12:08:03.431 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2020-11-20T12:08:03.432 INFO:teuthology.run_tasks:Running task console_log... 2020-11-20T12:08:03.538 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f568f407d90>, signals=[15]) 2020-11-20T12:08:03.539 INFO:teuthology.run_tasks:Running task internal.connect... 2020-11-20T12:08:03.549 INFO:teuthology.task.internal:Opening connections... 2020-11-20T12:08:03.550 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi093.front.sepia.ceph.com 2020-11-20T12:08:03.552 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:03.623 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi066.front.sepia.ceph.com 2020-11-20T12:08:03.626 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:03.701 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2020-11-20T12:08:03.703 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:08:03.773 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-11-20T12:08:03.783 INFO:teuthology.orchestra.run.smithi093:> uname -m 2020-11-20T12:08:03.803 INFO:teuthology.orchestra.run.smithi093.stdout:x86_64 2020-11-20T12:08:03.804 INFO:teuthology.orchestra.run.smithi093:> cat /etc/os-release 2020-11-20T12:08:03.859 INFO:teuthology.orchestra.run.smithi093.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T12:08:03.859 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T12:08:03.860 INFO:teuthology.orchestra.run.smithi093.stdout:ID="rhel" 2020-11-20T12:08:03.860 INFO:teuthology.orchestra.run.smithi093.stdout:ID_LIKE="fedora" 2020-11-20T12:08:03.860 INFO:teuthology.orchestra.run.smithi093.stdout:VERSION_ID="8.3" 2020-11-20T12:08:03.860 INFO:teuthology.orchestra.run.smithi093.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:08:03.861 INFO:teuthology.orchestra.run.smithi093.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T12:08:03.861 INFO:teuthology.orchestra.run.smithi093.stdout:ANSI_COLOR="0;31" 2020-11-20T12:08:03.861 INFO:teuthology.orchestra.run.smithi093.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T12:08:03.861 INFO:teuthology.orchestra.run.smithi093.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T12:08:03.861 INFO:teuthology.orchestra.run.smithi093.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T12:08:03.862 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:03.862 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T12:08:03.862 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T12:08:03.862 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T12:08:03.862 INFO:teuthology.orchestra.run.smithi093.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T12:08:03.863 INFO:teuthology.lock.ops:Updating smithi093.front.sepia.ceph.com on lock server 2020-11-20T12:08:03.882 INFO:teuthology.orchestra.run.smithi066:> uname -m 2020-11-20T12:08:03.898 INFO:teuthology.orchestra.run.smithi066.stdout:x86_64 2020-11-20T12:08:03.899 INFO:teuthology.orchestra.run.smithi066:> cat /etc/os-release 2020-11-20T12:08:03.953 INFO:teuthology.orchestra.run.smithi066.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T12:08:03.953 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T12:08:03.953 INFO:teuthology.orchestra.run.smithi066.stdout:ID="rhel" 2020-11-20T12:08:03.954 INFO:teuthology.orchestra.run.smithi066.stdout:ID_LIKE="fedora" 2020-11-20T12:08:03.954 INFO:teuthology.orchestra.run.smithi066.stdout:VERSION_ID="8.3" 2020-11-20T12:08:03.954 INFO:teuthology.orchestra.run.smithi066.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:08:03.954 INFO:teuthology.orchestra.run.smithi066.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T12:08:03.954 INFO:teuthology.orchestra.run.smithi066.stdout:ANSI_COLOR="0;31" 2020-11-20T12:08:03.955 INFO:teuthology.orchestra.run.smithi066.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T12:08:03.955 INFO:teuthology.orchestra.run.smithi066.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T12:08:03.955 INFO:teuthology.orchestra.run.smithi066.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T12:08:03.955 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:08:03.955 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T12:08:03.956 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T12:08:03.956 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T12:08:03.956 INFO:teuthology.orchestra.run.smithi066.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T12:08:03.956 INFO:teuthology.lock.ops:Updating smithi066.front.sepia.ceph.com on lock server 2020-11-20T12:08:03.972 INFO:teuthology.orchestra.run.smithi132:> uname -m 2020-11-20T12:08:03.987 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2020-11-20T12:08:03.987 INFO:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2020-11-20T12:08:04.041 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="Red Hat Enterprise Linux" 2020-11-20T12:08:04.041 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="8.3 (Ootpa)" 2020-11-20T12:08:04.041 INFO:teuthology.orchestra.run.smithi132.stdout:ID="rhel" 2020-11-20T12:08:04.042 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="fedora" 2020-11-20T12:08:04.042 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="8.3" 2020-11-20T12:08:04.042 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el8" 2020-11-20T12:08:04.042 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.3 (Ootpa)" 2020-11-20T12:08:04.042 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2020-11-20T12:08:04.043 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.3:GA" 2020-11-20T12:08:04.043 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://www.redhat.com/" 2020-11-20T12:08:04.043 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2020-11-20T12:08:04.043 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:08:04.043 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2020-11-20T12:08:04.044 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.3 2020-11-20T12:08:04.044 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2020-11-20T12:08:04.044 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.3" 2020-11-20T12:08:04.044 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2020-11-20T12:08:04.061 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-11-20T12:08:04.129 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-11-20T12:08:04.137 INFO:teuthology.task.internal:Checking for old test directory... 2020-11-20T12:08:04.137 INFO:teuthology.orchestra.run.smithi066:> test '!' -e /home/ubuntu/cephtest 2020-11-20T12:08:04.140 INFO:teuthology.orchestra.run.smithi093:> test '!' -e /home/ubuntu/cephtest 2020-11-20T12:08:04.143 INFO:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2020-11-20T12:08:04.156 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-11-20T12:08:04.165 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-11-20T12:08:04.166 INFO:teuthology.orchestra.run.smithi066:> test -z $(ls -A /var/lib/ceph) 2020-11-20T12:08:04.195 INFO:teuthology.orchestra.run.smithi093:> test -z $(ls -A /var/lib/ceph) 2020-11-20T12:08:04.198 INFO:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2020-11-20T12:08:04.219 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-11-20T12:08:04.276 INFO:teuthology.run_tasks:Running task kernel... 2020-11-20T12:08:04.297 DEBUG:teuthology.task.kernel:normalized config {'client.0': {'sha1': 'distro'}} 2020-11-20T12:08:04.297 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2020-11-20T12:08:04.298 INFO:teuthology.orchestra.run.smithi093:> uname -r 2020-11-20T12:08:04.314 INFO:teuthology.orchestra.run.smithi093.stdout:4.18.0-240.1.1.el8_3.x86_64 2020-11-20T12:08:04.314 INFO:teuthology.task.kernel:Running kernel on smithi093: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T12:08:04.315 INFO:teuthology.orchestra.run.smithi093:> sudo yum install -y kernel 2020-11-20T12:08:05.832 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2020-11-20T12:08:05.832 INFO:teuthology.orchestra.run.smithi093.stdout:Unable to read consumer identity 2020-11-20T12:08:05.972 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:05.972 INFO:teuthology.orchestra.run.smithi093.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T12:08:05.973 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:07.765 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 23 MB/s | 8.3 MB 00:00 2020-11-20T12:08:09.463 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 4.9 MB/s | 23 kB 00:00 2020-11-20T12:08:09.958 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-4.18.0-240.1.1.el8_3.x86_64 is already installed. 2020-11-20T12:08:09.958 INFO:teuthology.orchestra.run.smithi093.stdout:Package kernel-4.18.0-240.el8.x86_64 is already installed. 2020-11-20T12:08:10.063 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2020-11-20T12:08:10.069 INFO:teuthology.orchestra.run.smithi093.stdout:Nothing to do. 2020-11-20T12:08:10.069 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2020-11-20T12:08:10.172 INFO:teuthology.orchestra.run.smithi093:> echo no | sudo yum reinstall kernel || true 2020-11-20T12:08:10.434 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2020-11-20T12:08:10.435 INFO:teuthology.orchestra.run.smithi093.stdout:Unable to read consumer identity 2020-11-20T12:08:10.522 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:10.522 INFO:teuthology.orchestra.run.smithi093.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T12:08:10.523 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:10.691 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:00:01 ago on Fri 20 Nov 2020 12:08:09 PM UTC. 2020-11-20T12:08:10.816 INFO:teuthology.orchestra.run.smithi093.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T12:08:10.816 INFO:teuthology.orchestra.run.smithi093.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T12:08:10.848 INFO:teuthology.orchestra.run.smithi093.stderr:Error: No packages marked for reinstall. 2020-11-20T12:08:10.884 INFO:teuthology.orchestra.run.smithi093:> sudo yum reinstall -y kernel || true 2020-11-20T12:08:11.162 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2020-11-20T12:08:11.162 INFO:teuthology.orchestra.run.smithi093.stdout:Unable to read consumer identity 2020-11-20T12:08:11.216 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:11.216 INFO:teuthology.orchestra.run.smithi093.stdout:This system is not registered to Red Hat Subscription Management. You can use subscription-manager to register. 2020-11-20T12:08:11.217 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:08:11.381 INFO:teuthology.orchestra.run.smithi093.stdout:Last metadata expiration check: 0:00:02 ago on Fri 20 Nov 2020 12:08:09 PM UTC. 2020-11-20T12:08:11.523 INFO:teuthology.orchestra.run.smithi093.stdout:Installed package kernel-4.18.0-240.1.1.el8_3.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2020-11-20T12:08:11.523 INFO:teuthology.orchestra.run.smithi093.stdout:Installed package kernel-4.18.0-240.el8.x86_64 (from anaconda) not available. 2020-11-20T12:08:11.548 INFO:teuthology.orchestra.run.smithi093.stderr:Error: No packages marked for reinstall. 2020-11-20T12:08:11.585 INFO:teuthology.orchestra.run.smithi093:> rpm -q kernel --last | head -n 1 2020-11-20T12:08:11.670 INFO:teuthology.orchestra.run.smithi093.stdout:kernel-4.18.0-240.1.1.el8_3.x86_64 Tue 10 Nov 2020 09:16:49 PM UTC 2020-11-20T12:08:11.672 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-240.1.1.el8_3.x86_64 2020-11-20T12:08:11.672 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2020-11-20T12:08:11.672 INFO:teuthology.run_tasks:Running task internal.base... 2020-11-20T12:08:11.679 INFO:teuthology.task.internal:Creating test directory... 2020-11-20T12:08:11.679 INFO:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T12:08:11.682 INFO:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T12:08:11.685 INFO:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-11-20T12:08:11.701 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-11-20T12:08:11.813 INFO:teuthology.run_tasks:Running task internal.archive... 2020-11-20T12:08:11.826 INFO:teuthology.task.internal:Creating archive directory... 2020-11-20T12:08:11.827 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T12:08:11.830 INFO:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T12:08:11.833 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-11-20T12:08:11.856 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-11-20T12:08:11.865 INFO:teuthology.task.internal:Enabling coredump saving... 2020-11-20T12:08:11.866 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T12:08:11.899 INFO:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T12:08:11.901 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-11-20T12:08:11.929 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:11.941 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:11.942 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:11.949 INFO:teuthology.orchestra.run.smithi093.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:11.962 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:11.964 INFO:teuthology.orchestra.run.smithi066.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-11-20T12:08:11.965 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-11-20T12:08:11.973 INFO:teuthology.task.internal:Configuring sudo... 2020-11-20T12:08:11.973 INFO:teuthology.orchestra.run.smithi066:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T12:08:11.977 INFO:teuthology.orchestra.run.smithi093:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T12:08:11.992 INFO:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-11-20T12:08:12.031 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-11-20T12:08:12.042 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-11-20T12:08:12.043 INFO:teuthology.orchestra.run.smithi066:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T12:08:12.046 INFO:teuthology.orchestra.run.smithi093:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T12:08:12.056 INFO:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-11-20T12:08:12.087 INFO:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:12.145 INFO:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:12.200 INFO:teuthology.orchestra.run.smithi093:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:12.273 INFO:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:12.319 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:08:12.320 INFO:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:12.372 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:12.381 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:08:12.382 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:08:12.382 INFO:teuthology.orchestra.run.smithi093.stderr:152 bytes copied, 2.9253e-05 s, 5.2 MB/s 2020-11-20T12:08:12.383 INFO:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:12.421 INFO:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:12.502 INFO:teuthology.orchestra.run.smithi066:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:12.557 INFO:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:12.611 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:08:12.612 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:12.675 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:12.687 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:08:12.687 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:08:12.687 INFO:teuthology.orchestra.run.smithi066.stderr:152 bytes copied, 3.5952e-05 s, 4.2 MB/s 2020-11-20T12:08:12.688 INFO:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:12.736 INFO:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-11-20T12:08:12.841 INFO:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:12.883 INFO:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-11-20T12:08:12.931 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:08:12.932 INFO:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:12.988 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2020-11-20T12:08:13.001 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:08:13.002 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:08:13.004 INFO:teuthology.orchestra.run.smithi132.stderr:152 bytes copied, 2.9387e-05 s, 5.2 MB/s 2020-11-20T12:08:13.006 INFO:teuthology.orchestra.run.smithi066:> sudo service rsyslog restart 2020-11-20T12:08:13.016 INFO:teuthology.orchestra.run.smithi093:> sudo service rsyslog restart 2020-11-20T12:08:13.023 INFO:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2020-11-20T12:08:13.077 INFO:teuthology.orchestra.run.smithi066.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T12:08:13.092 INFO:teuthology.orchestra.run.smithi093.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T12:08:13.111 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-11-20T12:08:13.528 INFO:teuthology.run_tasks:Running task internal.timer... 2020-11-20T12:08:13.542 INFO:teuthology.task.internal:Starting timer... 2020-11-20T12:08:13.543 INFO:teuthology.run_tasks:Running task pcp... 2020-11-20T12:08:13.577 INFO:teuthology.run_tasks:Running task selinux... 2020-11-20T12:08:13.631 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-11-20T12:08:13.632 INFO:teuthology.orchestra.run.smithi066:> sudo service auditd rotate 2020-11-20T12:08:13.733 INFO:teuthology.orchestra.run.smithi066.stdout:Rotating logs: [ OK ] 2020-11-20T12:08:13.735 INFO:teuthology.orchestra.run.smithi093:> sudo service auditd rotate 2020-11-20T12:08:13.818 INFO:teuthology.orchestra.run.smithi093.stdout:Rotating logs: [ OK ] 2020-11-20T12:08:13.820 INFO:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2020-11-20T12:08:13.925 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: [ OK ] 2020-11-20T12:08:13.927 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-11-20T12:08:13.927 INFO:teuthology.orchestra.run.smithi093:> /usr/sbin/getenforce 2020-11-20T12:08:13.956 INFO:teuthology.orchestra.run.smithi093.stdout:Permissive 2020-11-20T12:08:13.957 INFO:teuthology.orchestra.run.smithi066:> /usr/sbin/getenforce 2020-11-20T12:08:13.985 INFO:teuthology.orchestra.run.smithi066.stdout:Permissive 2020-11-20T12:08:13.986 INFO:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2020-11-20T12:08:14.013 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2020-11-20T12:08:14.014 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi093.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi066.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi132.front.sepia.ceph.com': 'permissive'} 2020-11-20T12:08:14.014 INFO:teuthology.orchestra.run.smithi093:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T12:08:14.045 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:08:14.046 INFO:teuthology.orchestra.run.smithi066:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T12:08:14.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:08:14.076 INFO:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|comm="ksmtuned"\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-11-20T12:08:14.102 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:08:14.102 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-11-20T12:08:14.103 INFO:teuthology.orchestra.run.smithi093:> sudo /usr/sbin/setenforce permissive 2020-11-20T12:08:14.130 INFO:teuthology.orchestra.run.smithi066:> sudo /usr/sbin/setenforce permissive 2020-11-20T12:08:14.157 INFO:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2020-11-20T12:08:14.182 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-11-20T12:08:14.192 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-11-20T12:08:14.193 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-11-20T12:08:14.206 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-11-20T12:08:14.209 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi093.front.sepia.ceph.com,smithi066.front.sepia.ceph.com,smithi132.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-11-20T12:08:14.544 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-11-20T12:08:15.467 INFO:teuthology.task.ansible.out:[WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-11-20T12:08:17.983 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-11-20T12:08:18.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:17 +0000 (0:00:00.070) 0:00:00.070 ******* 2020-11-20T12:08:18.016 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:18 +0000 (0:00:00.013) 0:00:00.083 ******* 2020-11-20T12:08:18.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:18 +0000 (0:00:00.014) 0:00:00.097 ******* 2020-11-20T12:08:19.570 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi132.front.sepia.ceph.com] 2020-11-20T12:08:19.612 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] 2020-11-20T12:08:19.620 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] 2020-11-20T12:08:19.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:19 +0000 (0:00:01.668) 0:00:01.765 ******* 2020-11-20T12:08:19.739 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:19 +0000 (0:00:00.040) 0:00:01.806 ******* 2020-11-20T12:08:19.769 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:19 +0000 (0:00:00.030) 0:00:01.836 ******* 2020-11-20T12:08:19.996 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-11-20T12:08:19.998 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:08:20.032 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.262) 0:00:02.099 ******* 2020-11-20T12:08:20.063 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.030) 0:00:02.130 ******* 2020-11-20T12:08:20.070 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:08:20.112 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.049) 0:00:02.179 ******* 2020-11-20T12:08:20.424 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** ok: [smithi132.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} ok: [smithi093.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T12:08:20.430 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-11-20T12:08:20.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.350) 0:00:02.529 ******* 2020-11-20T12:08:20.493 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.030) 0:00:02.560 ******* 2020-11-20T12:08:20.525 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.031) 0:00:02.592 ******* 2020-11-20T12:08:20.530 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-11-20T12:08:20.532 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:20.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.040) 0:00:02.633 ******* 2020-11-20T12:08:20.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.031) 0:00:02.664 ******* 2020-11-20T12:08:20.603 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:20.639 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.042) 0:00:02.706 ******* 2020-11-20T12:08:20.866 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-11-20T12:08:20.868 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} ok: [smithi093.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:20.868 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:08:20.901 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.262) 0:00:02.968 ******* 2020-11-20T12:08:20.932 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.030) 0:00:02.999 ******* 2020-11-20T12:08:20.966 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:20 +0000 (0:00:00.034) 0:00:03.033 ******* 2020-11-20T12:08:21.675 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-11-20T12:08:21.677 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874100.9815264-227823603078677/source", "state": "file", "uid": 0} 2020-11-20T12:08:21.708 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.741) 0:00:03.775 ******* 2020-11-20T12:08:21.715 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874100.9153905-171434281965610/source", "state": "file", "uid": 0} 2020-11-20T12:08:21.716 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874100.9443095-9327321481067/source", "state": "file", "uid": 0} 2020-11-20T12:08:21.750 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.042) 0:00:03.817 ******* 2020-11-20T12:08:21.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:21 +0000 (0:00:00.030) 0:00:03.847 ******* 2020-11-20T12:08:22.199 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-11-20T12:08:22.201 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T12:08:22.203 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T12:08:22.241 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-11-20T12:08:22.243 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail 2020-11-20T12:08:22.244 INFO:teuthology.task.ansible.out:.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@ 2020-11-20T12:08:22.246 INFO:teuthology.task.ansible.out:aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-11-20T12:08:22.396 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-11-20T12:08:22.405 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-11-20T12:08:22.550 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:22 +0000 (0:00:00.769) 0:00:04.617 ******* 2020-11-20T12:08:22.580 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:22 +0000 (0:00:00.030) 0:00:04.647 ******* 2020-11-20T12:08:22.612 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:22 +0000 (0:00:00.031) 0:00:04.679 ******* 2020-11-20T12:08:23.190 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-11-20T12:08:23.192 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] 2020-11-20T12:08:23.199 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] 2020-11-20T12:08:23.264 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] 2020-11-20T12:08:23.306 INFO:teuthology.task.ansible.out:[WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-11-20T12:08:23.308 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.694) 0:00:05.374 ******* 2020-11-20T12:08:23.345 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.035) 0:00:05.409 ******* 2020-11-20T12:08:23.412 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.069) 0:00:05.479 ******* 2020-11-20T12:08:23.890 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2020-11-20T12:08:23.892 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.198581", "end": "2020-11-20 12:08:23.865194", "rc": 0, "start": "2020-11-20 12:08:23.666613", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:23.926 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.513) 0:00:05.992 ******* 2020-11-20T12:08:23.932 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.199165", "end": "2020-11-20 12:08:23.879819", "rc": 0, "start": "2020-11-20 12:08:23.680654", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:23.936 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.238024", "end": "2020-11-20 12:08:23.880282", "rc": 0, "start": "2020-11-20 12:08:23.642258", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:23.967 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.041) 0:00:06.034 ******* 2020-11-20T12:08:23.998 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:23 +0000 (0:00:00.030) 0:00:06.065 ******* 2020-11-20T12:08:24.140 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-11-20T12:08:24.141 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.009122", "end": "2020-11-20 12:08:24.119007", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:24.109885", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:24.175 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.177) 0:00:06.242 ******* 2020-11-20T12:08:24.182 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008219", "end": "2020-11-20 12:08:24.149950", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:24.141731", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:24.217 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.041) 0:00:06.284 ******* 2020-11-20T12:08:24.223 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T12:08:24.225 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.025645", "end": "2020-11-20 12:08:24.187561", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:24.161916", "stderr": "", "stderr_lines": [], "stdout": "46fd2a03b54c2ce7520f33746fa0586027b558c3", "stdout_lines": ["46fd2a03b54c2ce7520f33746fa0586027b558c3"]} 2020-11-20T12:08:24.259 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.041) 0:00:06.326 ******* 2020-11-20T12:08:24.289 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.030) 0:00:06.356 ******* 2020-11-20T12:08:24.295 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T12:08:24.297 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.333 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.044) 0:00:06.401 ******* 2020-11-20T12:08:24.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.030) 0:00:06.431 ******* 2020-11-20T12:08:24.371 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-11-20T12:08:24.372 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.406 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.041) 0:00:06.473 ******* 2020-11-20T12:08:24.440 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.034) 0:00:06.507 ******* 2020-11-20T12:08:24.447 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-11-20T12:08:24.449 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.491 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.050) 0:00:06.558 ******* 2020-11-20T12:08:24.524 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.032) 0:00:06.591 ******* 2020-11-20T12:08:24.531 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.068) 0:00:06.659 ******* 2020-11-20T12:08:24.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.038) 0:00:06.698 ******* 2020-11-20T12:08:24.637 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T12:08:24.639 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.672 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.041) 0:00:06.739 ******* 2020-11-20T12:08:24.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.031) 0:00:06.771 ******* 2020-11-20T12:08:24.710 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-11-20T12:08:24.712 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.043) 0:00:06.814 ******* 2020-11-20T12:08:24.753 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:24.755 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.757 INFO:teuthology.task.ansible.out: skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.757 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.758 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:24.758 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "i 2020-11-20T12:08:24.760 INFO:teuthology.task.ansible.out:tem": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgallow 2020-11-20T12:08:24.761 INFO:teuthology.task.ansible.out:ay", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.047) 0:00:06.862 ******* 2020-11-20T12:08:24.804 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f30 2020-11-20T12:08:24.808 INFO:teuthology.task.ansible.out:09adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} TASK [users : Filter the managed_users list] *********************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW 2020-11-20T12:08:24.810 INFO:teuthology.task.ansible.out:2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis 2020-11-20T12:08:24.813 INFO:teuthology.task.ansible.out:", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.840 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.045) 0:00:06.907 ******* 2020-11-20T12:08:24.847 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.847 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.849 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.849 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.851 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.851 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96 2020-11-20T12:08:24.853 INFO:teuthology.task.ansible.out:a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f2 2020-11-20T12:08:24.854 INFO:teuthology.task.ansible.out:7af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.886 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.045) 0:00:06.953 ******* 2020-11-20T12:08:24.894 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.895 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-11-20T12:08:24.895 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ 2020-11-20T12:08:24.896 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.897 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.897 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result w 2020-11-20T12:08:24.899 INFO:teuthology.task.ansible.out:as False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.899 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha 2020-11-20T12:08:24.901 INFO:teuthology.task.ansible.out:HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.932 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.046) 0:00:06.999 ******* 2020-11-20T12:08:24.939 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.940 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2020-11-20T12:08:24.940 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.941 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.941 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.942 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.942 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional res 2020-11-20T12:08:24.944 INFO:teuthology.task.ansible.out:ult was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.978 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:24 +0000 (0:00:00.045) 0:00:07.045 ******* 2020-11-20T12:08:24.985 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.986 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.987 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.988 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.989 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:24.990 INFO:teuthology.task.ansible.out:skipping: [smithi066.f 2020-11-20T12:08:24.991 INFO:teuthology.task.ansible.out:ront.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.047) 0:00:07.093 ******* 2020-11-20T12:08:25.045 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.049 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.050 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.052 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'andrewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.056 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.056 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.057 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.057 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.058 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 2020-11-20T12:08:25.059 INFO:teuthology.task.ansible.out: 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, " 2020-11-20T12:08:25.061 INFO:teuthology.task.ansible.out:skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7 2020-11-20T12:08:25.062 INFO:teuthology.task.ansible.out:PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.071 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.073 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.073 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.085 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.087 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.097 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.099 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'and 2020-11-20T12:08:25.100 INFO:teuthology.task.ansible.out:rewschoen', 'ovpn': 'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.111 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'zack', 'ovpn': 'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.112 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.113 INFO:teuthology.task.ansible.out: skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.115 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kdreyer', 'ovpn': 'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.128 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dmick', 'ovpn': 'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\ndmick@hplaptop 49Wf5LFRBuobkfWp7OoAdQ 1401efaf459e0b7673f03b546eeff2c8144219c674eb3c94aa23e5af5ffc66b9\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.133 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.134 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.135 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.138 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.138 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.139 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.139 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ans 2020-11-20T12:08:25.141 INFO:teuthology.task.ansible.out:ible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.143 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sage', 'ovpn': 'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_v 2020-11-20T12:08:25.145 INFO:teuthology.task.ansible.out:ar": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.154 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.156 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dgalloway', 'ovpn': 'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.168 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.172 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'akraitma', 'ovpn': 'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcaratzas', 'ovpn': 'jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcaratzas", "ovpn": "jcaratza@fedora rT6gfdsBHVr0RvokJfO3mQ e634e7a31d873f310ff5326bacae6c19f95087f8215edda618f68dd2761257a9"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3 2020-11-20T12:08:25.174 INFO:teuthology.task.ansible.out:d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.183 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'trociny', 'ovpn': 'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.185 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.195 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.196 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.197 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.197 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'smithfarm', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf', 'ovpn': 'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.197 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriwein 2020-11-20T12:08:25.199 INFO:teuthology.task.ansible.out:stein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mbenjamin', 'ovpn': 'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n'}) => {"ansible_loop_var": "item", "changed": 2020-11-20T12:08:25.200 INFO:teuthology.task.ansible.out:false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.210 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.212 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'aemerson', 'ovpn': 'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01\naemerson@electric TjQxreDKF6bsIehyQnX4aQ a73b7d56b95ba3d4dda5ded995b9cb98eaaf5d2db7d148c340aa4f4c68cf26d7\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'amaredia', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour', 'ovpn': 'ali@f 2020-11-20T12:08:25.214 INFO:teuthology.task.ansible.out:reerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9 2020-11-20T12:08:25.216 INFO:teuthology.task.ansible.out:+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.235 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'tserlin', 'key': 'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet', 'ovpn': 'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.237 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxiche 2020-11-20T12:08:25.238 INFO:teuthology.task.ansible.out:n", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.249 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dis', 'ovpn': 'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.251 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gregf', 'ovpn': 'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'joshd', 'ovpn': 'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'davidz', 'ovpn': 'dzafman@ub 2020-11-20T12:08:25.253 INFO:teuthology.task.ansible.out:untu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'cmeno', 'ovpn': 'cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cmeno", "ovpn": "cmeno@boxtop KD0XJIGun8xcnNI83pqrsg 79079fe78e1cf401cccb14692c9d16f63e2010c57cfbf56c487387affca90aed"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ivancich', 'ovpn': 'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b 2020-11-20T12:08:25.254 INFO:teuthology.task.ansible.out:70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.264 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.266 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'wusui', 'ovpn': 'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f 2020-11-20T12:08:25.268 INFO:teuthology.task.ansible.out:7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'zyan', 'ovpn': 'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.270 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.270 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuriw', 'ovpn': 'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH2 WhMAZ+zZ/PPXOc+4HEDaZg 2d3e28b31edc3f2be43f6b73150dedc9c9df6e316d29afc1416d6b96a982e217\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.271 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.271 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ce 2020-11-20T12:08:25.273 INFO:teuthology.task.ansible.out:ph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.282 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'tamil', 'ovpn': 'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.284 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.285 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.285 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jowilkin', 'ovpn': 'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff9 2020-11-20T12:08:25.287 INFO:teuthology.task.ansible.out:0d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.297 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.299 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'bhubbard', 'ovpn': 'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yehudasa', 'ovpn': 'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.300 INFO:teuthology.task.ansible.out:skipp 2020-11-20T12:08:25.301 INFO:teuthology.task.ansible.out:ing: [smithi066.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.311 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dang', 'ovpn': 'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.313 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.313 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'branto', 'ovpn': 'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.314 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": " 2020-11-20T12:08:25.315 INFO:teuthology.task.ansible.out:shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiaoxichen', 'ovpn': 'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.330 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.332 INFO:teuthology.task.ansible.out: skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ffilz', 'ovpn': 'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.333 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.335 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'joao', 'ovpn': 'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.337 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'nhm', 'ovpn': 'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redha 2020-11-20T12:08:25.339 INFO:teuthology.task.ansible.out:t.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'nwatkins', 'ovpn': 'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.350 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkidd', 'ovpn': 'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.352 INFO:teuthology.task.ansible.out: skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.353 INFO:teuthology.task.ansible.out: skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.356 INFO:teuthology.task.ansible.out: skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlopez', 'ovpn': 'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.357 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'haomaiwang', 'ovpn': 'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.359 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.360 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jdillaman', 'ovpn': 'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.371 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.372 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kchai', 'ovpn': 'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.373 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdn 2020-11-20T12:08:25.374 INFO:teuthology.task.ansible.out:IGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.385 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.386 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dfuller', 'ovpn': 'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@ 2020-11-20T12:08:25.388 INFO:teuthology.task.ansible.out:t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'owasserm', 'ovpn': 'owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@orit-desktop zi8oe8INwK6IZrtUz6lg0w b5f4f96232a77a260f7a16244af873df2ff143c2bde0dbaabf02e9952b8f38ca\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vasu', 'ovpn': 'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39R 2020-11-20T12:08:25.390 INFO:teuthology.task.ansible.out:sFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.400 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.402 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'smohan', 'ovpn': 'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.413 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'abhi', 'ovpn': 'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.414 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.417 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.417 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:25.417 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.419 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'cbodley', 'ovpn': 'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.419 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mwatts', 'ovpn': 'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.421 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.432 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.434 INFO:teuthology.task.ansible.out: skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pdonnell', 'ovpn': 'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.435 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.435 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.435 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jlayton', 'ovpn': 'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayt 2020-11-20T12:08:25.437 INFO:teuthology.task.ansible.out:on@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rzarzynski', 'ovpn': 'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.438 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.438 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thin 2020-11-20T12:08:25.440 INFO:teuthology.task.ansible.out:kpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rdias', 'ovpn': 'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.450 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.453 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vshankar', 'ovpn': 'vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride eYOkK3Yj10T5PFLIUu5DKw f6d9d714fb6a97e51a4c8d2a4fb7ed0c0e87caedfd0fa813b209846abd9a8a20"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'akupczyk', 'ovpn': 'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupcz 2020-11-20T12:08:25.455 INFO:teuthology.task.ansible.out:yk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.466 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'nojha', 'ovpn': 'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e\nnojha@nojha-mac aucFu11aJL4iZg9ch76Lmg 6f14a860471fabc125d167c7af8d4729c26bc93bfab5e73d5457ebf54d32d526\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.468 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ifed01', 'ovpn': 'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.480 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'myoungwon', 'ovpn': 'myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@fg2server p5CiGtdZolEwS1dCiRJjkg cd2491f835be1474a7802db607cf9a31c59e1031001e1dfb8fe240616dda9a71"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.492 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gabrioux', 'ovpn': 'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.494 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'leseb', 'ovpn': 'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'hchen', 'ovpn': 'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.494 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4Fl 2020-11-20T12:08:25.496 INFO:teuthology.task.ansible.out:KQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.505 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.507 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jcollin', 'ovpn': 'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.507 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xxg', 'ovpn': 'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.508 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'pnawracay' 2020-11-20T12:08:25.509 INFO:teuthology.task.ansible.out:, 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pcuzner', 'ovpn': 'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.521 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.523 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mkogan', 'ovpn': 'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.523 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.524 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vumrao', 'ovpn': 'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.524 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, 2020-11-20T12:08:25.527 INFO:teuthology.task.ansible.out:"item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'henrix', 'ovpn': 'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, 2020-11-20T12:08:25.528 INFO:teuthology.task.ansible.out: "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pbs1108', 'ovpn': 'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.539 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.540 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.541 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'clacroix', 'ovpn': 'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.541 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.542 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'epuertat', 'ovpn': 'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006'}) => {"ansible_loop_var": 2020-11-20T12:08:25.544 INFO:teuthology.task.ansible.out: "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'tdehler', 'ovpn': 'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.554 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.556 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'laura', 'ovpn': 'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yaarit', 'ovpn': 'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.557 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.558 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.558 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rpavani1998', 'ovpn': 'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.560 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.570 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.572 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rishabh', 'ovpn': 'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.589 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'skrah', 'ovpn': 'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.590 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.590 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'smanjara', 'ovpn': 'smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora OfpUShUejOW2W/R4FlKQ7Q fab77ef619f730a5aaf255e4167aa7a35a7e5450d12820923d969036a6326b0f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.591 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'bengland', 'ovpn': 'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn 2020-11-20T12:08:25.593 INFO:teuthology.task.ansible.out:": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.608) 0:00:07.701 ******* 2020-11-20T12:08:25.641 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pnawracay', 'ovpn': 'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.642 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.644 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'alfonsomthd', 'ovpn': 'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.645 INFO:teuthology.task.ansible.out: skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'oliveiradan', 'ovpn': 'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.646 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.647 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'swagner', 'ovpn': 'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'yuvalif', 'ovpn': 'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e\nyuvalif@medea gy0T/Hj/6DnVSKyOKD0/ag 468fe695fad8610a8f2eba6d1015949e4e6dc3d62c50ecf03579928d45a8d2ae\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.648 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.648 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'scar 2020-11-20T12:08:25.650 INFO:teuthology.task.ansible.out:valhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kkeithle', 'ovpn': 'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'emmericp', 'ovpn': 'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.650 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.650 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mchangir', 'ovpn': 'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mc 2020-11-20T12:08:25.652 INFO:teuthology.task.ansible.out:hangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sidharthanup', 'ovpn': 'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.652 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'varsha', 'ovpn': 'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.653 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdove 2020-11-20T12:08:25.654 INFO:teuthology.task.ansible.out:r@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sjust', 'ovpn': 'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.655 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.667 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.668 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ideepika', 'ovpn': 'deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@x1carbon hyRj1/9UjWhVzhav5+LNKA e3f7d2882c2b1a410dbb5458c08f280814d652e34c87e96f8a2e8bef1928926f"}, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.669 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gsalomon', 'ovpn': 'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.670 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'soumyakoduri', 'ovpn': 'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.707 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.072) 0:00:07.774 ******* 2020-11-20T12:08:25.715 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kyr', 'ovpn': 'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.717 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sseshasa', 'ovpn': 'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rfriedma', 'ovpn': 'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.717 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.719 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'lmb', 'ovpn': 'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ksirivad', 'ovpn': 'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc\nksirivad@macbook 0ivvJOZVAywT15aJCDF2xw 0066940a99b2d37dcd856c8622f48e0d8cb59c092f8f96cc2352ec0bc979ce45\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.732 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ofriedma', 'ovpn': 'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'h4iresis', 'ovpn': 'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyrat 2020-11-20T12:08:25.734 INFO:teuthology.task.ansible.out:sas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'shyukri', 'ovpn': 'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'scarvalhojr', 'ovpn': 'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.735 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rakesh', 'ovpn': 'rakesh@fedora CXs 2020-11-20T12:08:25.736 INFO:teuthology.task.ansible.out:WP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'ryg-', 'ovpn': 'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.738 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prsrivas', 'ovpn': 'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'zdover', 'ovpn': 'zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@lenovot5301 88ArNhsAMXq/nkSC9tKDig 131b8214bbea52345220522f8dd13c768bc5c1e41e4d164e7138719cfc3295d3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.073) 0:00:07.847 ******* 2020-11-20T12:08:25.789 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.791 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'rraja', 'ovpn': 'rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@p50 4NMUghtas9gI46n7X0iJXA cc646e47c8b503eb38d30efa47e459076af52b4fc001c4959833f32ddc563a02"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'toabctl', 'ovpn': 'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.792 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mgfritch', 'ovpn': 'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 2020-11-20T12:08:25.794 INFO:teuthology.task.ansible.out: 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xiubli', 'ovpn': 'root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "root@lxbceph0 /BNUvfmLPqzfbIz/Jzlqkw 3e109dcb826d45a6ee7e8195fc025b257b3d369e135400bf0a4bf503d48503e3\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jafaj', 'ovpn': 'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.798 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@ 2020-11-20T12:08:25.800 INFO:teuthology.task.ansible.out:mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jschmid', 'ovpn': 'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kachau', 'ovpn': 'kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad dX7+Zp6Z+rMSZTbxL52c7g 59d0d7be858e4a3769eaca4563399989298004a271f60b08cc36bf4130e089fe"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c85 2020-11-20T12:08:25.801 INFO:teuthology.task.ansible.out:45202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.807 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'khiremat', 'ovpn': 'khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "khiremat", "ovpn": "khiremat@kotresh-T490s 7o9JjenDm1h34Zmd2SWO2g 791981cd84bd4c80bf3ff6076ebc64b3ebf8432903e36d1a49bbee27561f8315"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.808 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kapandya', 'ovpn': 'kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kapandya", "ovpn": "kapandya@thinkpad g4JoonWShBhyS6fEdaHh7A 2990a987bf7afee6e3c8b5236b3dac813a57dbdce47ec63965c40b1b7bdafd67"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prasad', 'ovpn': 'prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prasad", "ovpn": "prasad@macprasad tJYuW/3nDX8ikaLyJQdpAQ 1544f87809a170bb61069b588630467b05283a1347945b9545205b0a28110f89"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.809 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", 2020-11-20T12:08:25.810 INFO:teuthology.task.ansible.out:"changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vikhyat', 'ovpn': 'vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vikhyat", "ovpn": "vikhyat@redhat ae77Y7dK1BxLEfQvAOJo8A a62d65a2aa09a75dca299ce0424caf6bcbc52696b22aa1567432aac34d78f18f"}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.811 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'shraddhaag', 'ovpn': 'shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shraddhaag", "ovpn": "shraddhaag@asus w1lmx5nwk8QQ/4u3UfGsJQ 98c5840f994a5e35b234375b07b1782f9a92bdcd5cf73e5847027045ab88e6d2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.812 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'gkyratsas', 'ovpn': 'gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gkyratsas", "ovpn": "gkyratsas@suse.com PO5Ut+2Z4kCMjaumOyA+1A 70fafe30ccb801c8c0a059a7eb3a842a2d08015b828c63bc1a702caf056014c7"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.813 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.848 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.067) 0:00:07.915 ******* 2020-11-20T12:08:25.875 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'prateek', 'ovpn': 'prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prateek", "ovpn": "prateek@linux kj4pU4yLf+76XxY0mvoIwg c24292e824e3e43ebf7465f1079449ce80bf26311426ae3914cdf1fe8d591c67"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.877 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jelopez', 'ovpn': 'jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jelopez", "ovpn": "jelopez@imac XbzY2mjr57lSPExJp0ZBgA 4f5dfad692c25293cd58393bd8ddae91b4dc0b2561c860072e0665933531208e"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'dcain', 'ovpn': 'dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dcain", "ovpn": "dcain@fullsteam 7vptxC1ZWCXLUV3FJwWQAg 2d73728e16c5f724e5f28eb326c24b8e13e7b361bcbaf506809f539e80223389"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'sunny', 'ovpn': 'sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sunny", "ovpn": "sunny@devBox 81r/AKNOWhvaD0ESYy6tTg 58b86902f858bc3f1edb12cfc41ce10ed163985db2f7c253de08b7f1c310fe11"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'xuxuehan', 'ovpn': 'xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xuxuehan", "ovpn": "xuxuehan@xuxuehan-PC aJDFkJ1+XzbovMyvRiFCAQ 5a71908d9bc8372ce0fff3bdbce4ea0e27eb11af0ed30e573f93d7a0b4335279\nxuxuehan@xuxuehan-notebook LzP6obPSYuao0iCJLQ/92A 3af116b690da581c77912a0c5fe184c84ca78526f67331db15714bc4ffddbcdc\n"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.878 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (i 2020-11-20T12:08:25.879 INFO:teuthology.task.ansible.out:tem={'name': 'aclewett', 'ovpn': 'aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "aclewett", "ovpn": "aclewett@mac bP0KgOkhW1GxTiugD3jMQA 90009b65da8175e083ee0e79d4953268f44493b98c2b532854da8d9e1d14e798"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'cblum', 'ovpn': 'cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cblum", "ovpn": "cblum@ ad4mZ9Cg0u6H8AdARvQUZw 4e3cec570cbe42786e5190de4194c2937f1073aef62a25b61bd85e05ee23db56"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mlatimer', 'ovpn': 'mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mlatimer", "ovpn": "mlatimer@lx5510 3lc4nP664Dmg63yr8yKG7w 3778fb16fb62d1a7d61f41cf2c2e72fd9acaae2805de2dc34497ef41ee1ad64f"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'shyamsundarr', 'ovpn': 'shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyamsundarr", "ovpn": "shyamsundarr@bartimaeus HUEzMC00f5f/tdydddWGNw e9032244bda086ecca6abc4f525296f9a125e4bbdb768d8c76c6d53d02f475d5"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.880 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'shuzhenyi', 'ovpn': 'bigwhite@wrjj37deMacBook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shuzhenyi", "ovpn": "bigwhite@wrjj37deMacB 2020-11-20T12:08:25.882 INFO:teuthology.task.ansible.out:ook-Pro-2.local VoTYmzsOPazeWcH+DOHXKw d7502e96b37ebc2ee5e0c14c6026f10e2e72b49be70dd1c5c7e9751fafcd8501"}, "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'mdipalma', 'ovpn': 'mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mdipalma", "ovpn": "mdipalma@mdmac IVn9Oy/SxZEmDgSWSeo3jA ea4dc08cb39ba55ade357c4949bf3f7d4d0322171ff5b5dac3c06d47cdc38f14"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'kchang', 'ovpn': 'kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchang", "ovpn": "kchang@kiefer-uchi Vy8tg3hSizdX5fIAJFgG/A 912a49a77b5722fdf4b9e304ee329c7b808728d73bb1e1f70cf55bd1221a3da3"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.915 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.067) 0:00:07.982 ******* 2020-11-20T12:08:25.947 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:25 +0000 (0:00:00.032) 0:00:08.015 ******* 2020-11-20T12:08:25.954 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'vereddy', 'ovpn': 'vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vereddy", "ovpn": "vereddy@vereddy.remote.csb 8jHiMDBfgQxu/8+MTlPR1A 07898add1a48c50647de4a81ad23db0c8545202cb56d3172db9b22df32c6b4a2"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.955 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'benhanokh', 'ovpn': 'gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "benhanokh", "ovpn": "gbenhano@localhost.localdomain uMf63iCCcqDt1rUnOSujaw 8c554c50bf8e27d3373515168e59f4ed3e4c48bace5689838268569948545ed5"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jsalomon', 'ovpn': 'jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jsalomon", "ovpn": "jsalomon@Josh-laptop 9V9NVwrt57LxXiqRh5Q7PQ 4cf0b0dfa39cf1e72f51bbfed19b4d88bdb286d09e54a99eb35721e33b1ae7b0"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'jolmomar', 'ovpn': 'jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jolmomar", "ovpn": "jolmomar@thinkpad CnoIzb/786lZh1NINj0xAA e60eeb560654da4b84977a4f9dbccd599bf9460980985ee5726595eb4a46e640"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.956 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'hmunjulu', 'ovpn': 'hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hmunjulu", "ovpn": "hmunjulu@thinkpad +5kJJIhXveJw6Q8ytILUSA 546f32fb058ff40ef3113e6c258b0f1cba6611155ba0a40a55646946cdb53019"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.956 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'julpark', 'ovpn': 'julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8'}) => {"ansible_loop_var": "ite 2020-11-20T12:08:25.958 INFO:teuthology.task.ansible.out:m", "changed": false, "item": {"name": "julpark", "ovpn": "julpark@thinkpad svj+nOCQG95zuBUwdJoluQ 7252f05ef02b16fd74d931d6cf937304afbb098dbdbde13d377e884fe35e2fb8"}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'name': 'pdhange', 'ovpn': 'prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdhange", "ovpn": "prashant@cephdev JZCEN2T5TXiHnU5yLG4hBg 3f94ec1bd179dafd2d58335ac4bea35808d394d30fa9e174fe16d6b872450fe0"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:25.973 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T12:08:25.975 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all users without sudo access.] *************************** 2020-11-20T12:08:26.007 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.059) 0:00:08.074 ******* 2020-11-20T12:08:26.038 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.031) 0:00:08.105 ******* 2020-11-20T12:08:26.070 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.032) 0:00:08.137 ******* 2020-11-20T12:08:26.076 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T12:08:26.078 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.111 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.040) 0:00:08.178 ******* 2020-11-20T12:08:26.149 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.036) 0:00:08.214 ******* 2020-11-20T12:08:26.154 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-11-20T12:08:26.155 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.042) 0:00:08.257 ******* 2020-11-20T12:08:26.196 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.198 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.199 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.202 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.203 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.236 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.045) 0:00:08.303 ******* 2020-11-20T12:08:26.244 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.245 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.248 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.248 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.288 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.051) 0:00:08.355 ******* 2020-11-20T12:08:26.295 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.301 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.335 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.046) 0:00:08.402 ******* 2020-11-20T12:08:26.345 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} TASK [users : Clone the keys repo] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.347 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.347 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.385 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.049) 0:00:08.452 ******* 2020-11-20T12:08:26.391 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.394 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.394 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.432 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.047) 0:00:08.499 ******* 2020-11-20T12:08:26.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.031) 0:00:08.531 ******* 2020-11-20T12:08:26.470 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-11-20T12:08:26.471 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.045) 0:00:08.576 ******* 2020-11-20T12:08:26.516 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-11-20T12:08:26.516 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.040) 0:00:08.617 ******* 2020-11-20T12:08:26.557 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-11-20T12:08:26.558 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.594 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.043) 0:00:08.661 ******* 2020-11-20T12:08:26.610 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2020-11-20T12:08:26.612 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.622 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.624 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** skipping: [smithi093.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.657 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.063) 0:00:08.724 ******* 2020-11-20T12:08:26.663 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.664 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.664 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.665 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.665 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.666 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.666 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.667 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.667 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.679 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.681 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.692 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.703 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.704 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.714 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.716 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.726 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.727 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.727 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.727 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.728 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.740 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.751 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=gmeno) => {"ansible_loop_var": "item", "changed": false, "item": "gmeno", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.753 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.764 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=alfredodeza) => {"ansible_loop_var": "item", "changed": false, "item": "alfredodeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.766 INFO:teuthology.task.ansible.out: skipping: [smithi132.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.767 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.769 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.769 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.771 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.771 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.785 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.796 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.798 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.808 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.809 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.819 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.821 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.833 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.835 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.835 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.836 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.836 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.848 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.853 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.855 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.231) 0:00:08.955 ******* 2020-11-20T12:08:26.895 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.897 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.897 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.898 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.898 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.898 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.899 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.899 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=pranith) => {"ansible_loop_var": "item", "changed": false, "item": "pranith", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.910 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dorinda) => {"ansible_loop_var": "item", "changed": false, "item": "dorinda", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.912 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.922 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.934 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.935 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.946 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.948 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.957 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=jbainbri) => {"ansible_loop_var": "item", "changed": false, "item": "jbainbri", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:26.959 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=kdhananj) => {"ansible_loop_var": "item", "changed": false, "item": "kdhananj", "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.002 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:26 +0000 (0:00:00.111) 0:00:09.066 ******* 2020-11-20T12:08:27.154 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:27.156 INFO:teuthology.task.ansible.out:TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T12:08:27.192 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.193) 0:00:09.260 ******* 2020-11-20T12:08:27.220 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T12:08:27.221 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => { "msg": "Host smithi066.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T12:08:27.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.062) 0:00:09.322 ******* 2020-11-20T12:08:27.294 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T12:08:27.295 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T12:08:27.330 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.075) 0:00:09.397 ******* 2020-11-20T12:08:27.339 INFO:teuthology.task.ansible.out: 2020-11-20T12:08:27.341 INFO:teuthology.task.ansible.out:TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T12:08:27.374 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.043) 0:00:09.441 ******* 2020-11-20T12:08:27.382 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T12:08:27.383 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.417 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.043) 0:00:09.484 ******* 2020-11-20T12:08:27.423 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T12:08:27.426 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => { "msg": "Host smithi093.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T12:08:27.462 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.045) 0:00:09.529 ******* 2020-11-20T12:08:27.469 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-11-20T12:08:27.470 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "eefb312a9cf82af5b9a46fb88fa640babe5fe20f", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-11-20T12:08:27.505 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.042) 0:00:09.572 ******* 2020-11-20T12:08:27.511 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T12:08:27.513 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} 2020-11-20T12:08:27.547 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.041) 0:00:09.614 ******* 2020-11-20T12:08:27.553 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-11-20T12:08:27.555 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => { "msg": "Host smithi132.front.sepia.ceph.com is running RedHat 8.3 (Ootpa)" } 2020-11-20T12:08:27.616 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.063) 0:00:09.678 ******* 2020-11-20T12:08:27.620 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T12:08:27.622 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.658 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.047) 0:00:09.725 ******* 2020-11-20T12:08:27.665 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-11-20T12:08:27.727 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml) => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/{{ container_mirror }}", "nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"], "rhsm_repos": ["rhel-8-for-x86_64-baseos-rpms", "rhel-8-for-x86_64-appstream-rpms"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/redhat_8.yml"} Friday 20 November 2020 12:08:27 +0000 (0:00:00.042) 0:00:09.767 ******* 2020-11-20T12:08:27.738 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-11-20T12:08:27.740 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:27.772 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.071) 0:00:09.839 ******* 2020-11-20T12:08:27.955 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.344837", "end": "2020-11-20 12:08:27.927382", "rc": 0, "start": "2020-11-20 12:08:27.582545", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T12:08:27.993 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:27 +0000 (0:00:00.220) 0:00:10.060 ******* 2020-11-20T12:08:28.020 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T12:08:28.022 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.054 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.061) 0:00:10.121 ******* 2020-11-20T12:08:28.092 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T12:08:28.094 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.134 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.079) 0:00:10.201 ******* 2020-11-20T12:08:28.162 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.203 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.069) 0:00:10.271 ******* 2020-11-20T12:08:28.210 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-11-20T12:08:28.211 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.312709", "end": "2020-11-20 12:08:28.159742", "rc": 0, "start": "2020-11-20 12:08:27.847033", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T12:08:28.245 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:10.312 ******* 2020-11-20T12:08:28.252 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T12:08:28.253 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.286 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:10.354 ******* 2020-11-20T12:08:28.294 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.328 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:10.395 ******* 2020-11-20T12:08:28.334 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T12:08:28.335 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.040) 0:00:10.435 ******* 2020-11-20T12:08:28.375 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T12:08:28.377 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.378846", "end": "2020-11-20 12:08:28.331034", "rc": 0, "start": "2020-11-20 12:08:27.952188", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-11-20T12:08:28.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.042) 0:00:10.478 ******* 2020-11-20T12:08:28.443 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.031) 0:00:10.510 ******* 2020-11-20T12:08:28.448 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T12:08:28.450 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.485 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.042) 0:00:10.552 ******* 2020-11-20T12:08:28.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.031) 0:00:10.583 ******* 2020-11-20T12:08:28.523 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-11-20T12:08:28.525 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.558 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:10.625 ******* 2020-11-20T12:08:28.564 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T12:08:28.566 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.600 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:10.667 ******* 2020-11-20T12:08:28.631 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.031) 0:00:10.698 ******* 2020-11-20T12:08:28.637 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-11-20T12:08:28.639 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Set have_entitlements] ****************************************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T12:08:28.696 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.064) 0:00:10.763 ******* 2020-11-20T12:08:28.730 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.033) 0:00:10.797 ******* 2020-11-20T12:08:28.736 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T12:08:28.738 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.771 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.041) 0:00:10.839 ******* 2020-11-20T12:08:28.778 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-11-20T12:08:28.780 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.818 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.046) 0:00:10.885 ******* 2020-11-20T12:08:28.829 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T12:08:28.830 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-20T12:08:28.872 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.054) 0:00:10.939 ******* 2020-11-20T12:08:28.887 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-11-20T12:08:28.889 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:28.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.050) 0:00:10.990 ******* 2020-11-20T12:08:28.940 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T12:08:28.943 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi093.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:28.976 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:28 +0000 (0:00:00.053) 0:00:11.043 ******* 2020-11-20T12:08:28.982 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-11-20T12:08:28.984 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:29.024 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.042) 0:00:11.085 ******* 2020-11-20T12:08:29.025 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-11-20T12:08:29.027 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T12:08:29.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.050) 0:00:11.136 ******* 2020-11-20T12:08:29.077 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-11-20T12:08:29.079 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"entitlements_path": "/etc/ansible/secrets/entitlements.yml"}, "changed": false} 2020-11-20T12:08:29.120 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.050) 0:00:11.187 ******* 2020-11-20T12:08:29.168 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-11-20T12:08:29.170 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:29.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.089) 0:00:11.277 ******* 2020-11-20T12:08:29.249 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"have_entitlements": true}, "changed": false} 2020-11-20T12:08:29.286 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:29 +0000 (0:00:00.076) 0:00:11.353 ******* 2020-11-20T12:08:30.009 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T12:08:30.011 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605874109.882594-vdnoitcj/katello-ca-consumer-latest.noarch4v1ecgan.rpm"]} 2020-11-20T12:08:30.043 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.757) 0:00:12.111 ******* 2020-11-20T12:08:30.589 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** fatal: [smithi093.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:30.591 INFO:teuthology.task.ansible.out:...ignoring 2020-11-20T12:08:30.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.578) 0:00:12.689 ******* 2020-11-20T12:08:30.661 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T12:08:30.663 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T12:08:30.696 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:30 +0000 (0:00:00.073) 0:00:12.763 ******* 2020-11-20T12:08:34.329 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-11-20T12:08:34.331 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605874114.1396747-ccrzctca/katello-ca-consumer-latest.noarchpxueu3al.rpm"]} 2020-11-20T12:08:34.363 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:03.667) 0:00:16.431 ******* 2020-11-20T12:08:34.608 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed /root/.ansible/tmp/ansible-moduletmp-1605874114.4156651-63wwa2fh/katello-ca-consumer-latest.noarchr6cffgnk.rpm"]} 2020-11-20T12:08:34.644 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.280) 0:00:16.711 ******* 2020-11-20T12:08:34.901 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T12:08:34.902 INFO:teuthology.task.ansible.out:fatal: [smithi066.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T12:08:34.935 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:34 +0000 (0:00:00.290) 0:00:17.002 ******* 2020-11-20T12:08:34.973 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T12:08:35.006 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:35 +0000 (0:00:00.070) 0:00:17.073 ******* 2020-11-20T12:08:35.203 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-11-20T12:08:35.204 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ...ignoring 2020-11-20T12:08:35.238 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:35 +0000 (0:00:00.232) 0:00:17.306 ******* 2020-11-20T12:08:35.276 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-11-20T12:08:35.278 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": false}, "changed": false} 2020-11-20T12:08:35.311 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:35 +0000 (0:00:00.071) 0:00:17.377 ******* 2020-11-20T12:08:46.045 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi093.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:46.086 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:10.775) 0:00:28.153 ******* 2020-11-20T12:08:46.135 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T12:08:46.137 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T12:08:46.176 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:00.089) 0:00:28.243 ******* 2020-11-20T12:08:46.744 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T12:08:46.745 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.368385", "end": "2020-11-20 12:08:46.710685", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:46.342300", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T12:08:46.776 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:00.600) 0:00:28.844 ******* 2020-11-20T12:08:46.804 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:46.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:00.060) 0:00:28.904 ******* 2020-11-20T12:08:46.864 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:46.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:00.060) 0:00:28.965 ******* 2020-11-20T12:08:46.925 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T12:08:46.927 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:46.959 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:46 +0000 (0:00:00.060) 0:00:29.026 ******* 2020-11-20T12:08:46.996 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:08:47.000 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:47.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:47 +0000 (0:00:00.071) 0:00:29.097 ******* 2020-11-20T12:08:49.357 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-11-20T12:08:49.359 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:49.393 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:02.360) 0:00:31.458 ******* 2020-11-20T12:08:49.430 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-11-20T12:08:49.432 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} 2020-11-20T12:08:49.480 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.088) 0:00:31.546 ******* 2020-11-20T12:08:49.565 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.350775", "end": "2020-11-20 12:08:49.542135", "rc": 0, "start": "2020-11-20 12:08:47.191360", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T12:08:49.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.139) 0:00:31.686 ******* 2020-11-20T12:08:49.673 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T12:08:49.674 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T12:08:49.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.088) 0:00:31.775 ******* 2020-11-20T12:08:49.755 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T12:08:49.757 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:49.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.096) 0:00:31.871 ******* 2020-11-20T12:08:49.857 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T12:08:49.890 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.085) 0:00:31.957 ******* 2020-11-20T12:08:49.929 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-11-20T12:08:49.930 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T12:08:49.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:49 +0000 (0:00:00.073) 0:00:32.031 ******* 2020-11-20T12:08:50.066 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T12:08:50.068 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.374300", "end": "2020-11-20 12:08:50.033544", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:49.659244", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T12:08:50.101 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.136) 0:00:32.168 ******* 2020-11-20T12:08:50.139 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T12:08:50.140 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.175 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.072) 0:00:32.240 ******* 2020-11-20T12:08:50.200 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-11-20T12:08:50.202 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.250 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.076) 0:00:32.317 ******* 2020-11-20T12:08:50.277 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-11-20T12:08:50.279 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:50.314 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.064) 0:00:32.381 ******* 2020-11-20T12:08:50.342 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:08:50.344 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:50.375 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.061) 0:00:32.442 ******* 2020-11-20T12:08:50.661 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** changed: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:51.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:50 +0000 (0:00:00.332) 0:00:32.775 ******* TASK [common : Set rhsm_registered if we just registered] ********************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"rhsm_registered": true}, "changed": false} Friday 20 November 2020 12:08:50 +0000 (0:00:00.077) 0:00:32.852 ******* 2020-11-20T12:08:51.461 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-11-20T12:08:51.463 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager release --list | grep -E '[0-9]'", "delta": "0:00:00.438975", "end": "2020-11-20 12:08:51.418169", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:08:50.979194", "stderr": "", "stderr_lines": [], "stdout": "7.4\n7.5\n7.6\n7.7\n7.8\n7.9\n7Server\n8\n8.0\n8.1\n8.2\n8.3", "stdout_lines": ["7.4", "7.5", "7.6", "7.7", "7.8", "7.9", "7Server", "8", "8.0", "8.1", "8.2", "8.3"]} 2020-11-20T12:08:51.495 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.710) 0:00:33.562 ******* 2020-11-20T12:08:51.526 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-11-20T12:08:51.532 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:51.562 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.067) 0:00:33.629 ******* 2020-11-20T12:08:51.591 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:51.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.077) 0:00:33.707 ******* 2020-11-20T12:08:51.671 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:08:51.704 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.063) 0:00:33.771 ******* 2020-11-20T12:08:51.742 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:08:51.743 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:51.775 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:51 +0000 (0:00:00.071) 0:00:33.842 ******* 2020-11-20T12:08:52.436 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi093.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:52.470 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.695) 0:00:34.538 ******* 2020-11-20T12:08:52.939 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T12:08:52.941 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.347637", "end": "2020-11-20 12:08:52.909591", "rc": 0, "start": "2020-11-20 12:08:50.561954", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T12:08:52.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:52 +0000 (0:00:00.510) 0:00:35.048 ******* 2020-11-20T12:08:53.033 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T12:08:53.036 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T12:08:53.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.106) 0:00:35.154 ******* 2020-11-20T12:08:53.142 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:53.174 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.086) 0:00:35.241 ******* 2020-11-20T12:08:53.212 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T12:08:53.247 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.072) 0:00:35.313 ******* 2020-11-20T12:08:53.309 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T12:08:53.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:53 +0000 (0:00:00.106) 0:00:35.420 ******* 2020-11-20T12:08:54.424 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-11-20T12:08:54.426 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": "subscription-manager repos --list | grep -B4 'Enabled:.*1' | grep 'Repo ID:' | sed -e 's/Repo ID:\\s*\\(.*\\)/\\1/' | sort", "delta": "0:00:02.437174", "end": "2020-11-20 12:08:54.393799", "rc": 0, "start": "2020-11-20 12:08:51.956625", "stderr": "", "stderr_lines": [], "stdout": "rhel-8-for-x86_64-appstream-rpms\nrhel-8-for-x86_64-baseos-rpms", "stdout_lines": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]} 2020-11-20T12:08:54.470 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:01.117) 0:00:36.537 ******* 2020-11-20T12:08:54.523 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-11-20T12:08:54.525 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"repo_list": ["rhel-8-for-x86_64-appstream-rpms", "rhel-8-for-x86_64-baseos-rpms"]}, "changed": false} 2020-11-20T12:08:54.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.096) 0:00:36.634 ******* 2020-11-20T12:08:54.606 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-11-20T12:08:54.608 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:54.640 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.072) 0:00:36.707 ******* 2020-11-20T12:08:54.677 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-11-20T12:08:54.679 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": false}, "changed": false} 2020-11-20T12:08:54.712 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.072) 0:00:36.780 ******* 2020-11-20T12:08:54.751 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"replace_repos": true}, "changed": false} 2020-11-20T12:08:54.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:54 +0000 (0:00:00.072) 0:00:36.852 ******* 2020-11-20T12:08:55.853 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-11-20T12:08:55.855 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:55.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:55 +0000 (0:00:01.104) 0:00:37.957 ******* 2020-11-20T12:08:55.949 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.282037", "end": "2020-11-20 12:08:55.923365", "rc": 0, "start": "2020-11-20 12:08:52.641328", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T12:08:55.986 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:55 +0000 (0:00:00.096) 0:00:38.053 ******* 2020-11-20T12:08:56.175 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T12:08:56.177 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T12:08:56.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:56 +0000 (0:00:00.224) 0:00:38.278 ******* 2020-11-20T12:08:56.407 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T12:08:57.029 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Friday 20 November 2020 12:08:56 +0000 (0:00:00.230) 0:00:38.508 ******* 2020-11-20T12:08:57.044 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi093.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T12:08:57.351 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** changed: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:08:57.399 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:57 +0000 (0:00:00.957) 0:00:39.466 ******* 2020-11-20T12:08:57.487 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi093.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T12:08:57.537 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:57 +0000 (0:00:00.138) 0:00:39.604 ******* 2020-11-20T12:08:58.038 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi093.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T12:08:58.477 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T12:08:58.532 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.994) 0:00:40.599 ******* 2020-11-20T12:08:58.561 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:08:58.564 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.602 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.070) 0:00:40.669 ******* 2020-11-20T12:08:58.629 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:08:58.630 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.663 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.060) 0:00:40.730 ******* 2020-11-20T12:08:58.701 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.073) 0:00:40.804 ******* 2020-11-20T12:08:58.764 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-11-20T12:08:58.765 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.060) 0:00:40.865 ******* 2020-11-20T12:08:58.825 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:08:58.827 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.062) 0:00:40.927 ******* 2020-11-20T12:08:58.887 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T12:08:58.888 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:58.934 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.074) 0:00:41.001 ******* 2020-11-20T12:08:58.966 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:59.001 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:58 +0000 (0:00:00.066) 0:00:41.067 ******* 2020-11-20T12:08:59.029 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T12:08:59.031 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:59.066 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:59 +0000 (0:00:00.065) 0:00:41.133 ******* 2020-11-20T12:08:59.093 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T12:08:59.095 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:08:59.126 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:59 +0000 (0:00:00.060) 0:00:41.193 ******* 2020-11-20T12:08:59.523 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T12:08:59.524 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.220147", "end": "2020-11-20 12:08:59.500331", "rc": 0, "start": "2020-11-20 12:08:59.280184", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:08:59.565 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:08:59 +0000 (0:00:00.438) 0:00:41.632 ******* 2020-11-20T12:09:00.589 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T12:09:00.591 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:04.512881", "end": "2020-11-20 12:09:00.567437", "rc": 0, "start": "2020-11-20 12:08:56.054556", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T12:09:00.625 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:00 +0000 (0:00:01.059) 0:00:42.691 ******* 2020-11-20T12:09:00.812 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T12:09:00.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:00 +0000 (0:00:00.225) 0:00:42.917 ******* 2020-11-20T12:09:01.038 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:09:01.071 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:01 +0000 (0:00:00.221) 0:00:43.138 ******* 2020-11-20T12:09:01.452 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-11-20T12:09:01.454 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["subscription-manager", "repos", "--enable=rhel-8-for-x86_64-baseos-rpms", "--enable=rhel-8-for-x86_64-appstream-rpms"], "delta": "0:00:03.841559", "end": "2020-11-20 12:09:01.421917", "rc": 0, "start": "2020-11-20 12:08:57.580358", "stderr": "", "stderr_lines": [], "stdout": "Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.\nRepository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system.", "stdout_lines": ["Repository 'rhel-8-for-x86_64-baseos-rpms' is enabled for this system.", "Repository 'rhel-8-for-x86_64-appstream-rpms' is enabled for this system."]} 2020-11-20T12:09:01.509 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:01 +0000 (0:00:00.436) 0:00:43.575 ******* 2020-11-20T12:09:01.587 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:09:01.588 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T12:09:01.733 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-11-20T12:09:01.735 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "path": "/etc/yum.repos.d/cd.repo", "state": "absent"} 2020-11-20T12:09:01.767 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:01 +0000 (0:00:00.259) 0:00:43.835 ******* 2020-11-20T12:09:01.967 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-11-20T12:09:01.969 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:09:02.003 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:01 +0000 (0:00:00.235) 0:00:44.071 ******* 2020-11-20T12:09:02.020 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:09:02.022 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T12:09:02.060 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:02 +0000 (0:00:00.056) 0:00:44.127 ******* 2020-11-20T12:09:02.313 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T12:09:02.315 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T12:09:02.348 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:02 +0000 (0:00:00.287) 0:00:44.415 ******* 2020-11-20T12:09:02.376 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T12:09:02.377 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:02.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:02 +0000 (0:00:00.061) 0:00:44.476 ******* 2020-11-20T12:09:02.437 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T12:09:02.464 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:02.473 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:02 +0000 (0:00:00.064) 0:00:44.540 ******* 2020-11-20T12:09:02.505 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** ok: [smithi066.front.sepia.ceph.com] => (item={'key': 'epel', 'value': {'name': 'Extra Packages for Enterprise Linux', 'mirrorlist': 'file:///etc/yum.repos.d/epel-mirrorlist', 'failovermethod': 'priority', 'enabled': '1', 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "86c0d58bde7ad4cfaafe592d2fefd92c920c42ca", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 236, "state": "file", "uid": 0} 2020-11-20T12:09:02.516 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T12:09:02.518 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:02.552 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:02 +0000 (0:00:00.078) 0:00:44.619 ******* 2020-11-20T12:09:02.563 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi132.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T12:09:02.583 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T12:09:02.585 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:02.618 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:02 +0000 (0:00:00.066) 0:00:44.685 ******* 2020-11-20T12:09:03.030 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-11-20T12:09:03.032 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'key': 'epel-testing', 'value': {'name': 'Extra Packages for Enterprise Linux - Testing', 'mirrorlist': 'file:///etc/yum.repos.d/epel-testing-mirrorlist', 'failovermethod': 'priority', 'enabled': 0, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a1bad5509ed35b895c2061841236b1cfe10619ae", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 262, "state": "file", "uid": 0} 2020-11-20T12:09:03.082 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.463) 0:00:45.149 ******* 2020-11-20T12:09:03.090 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi132.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T12:09:03.130 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.048) 0:00:45.197 ******* 2020-11-20T12:09:03.151 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T12:09:03.153 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T12:09:03.186 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.055) 0:00:45.253 ******* 2020-11-20T12:09:03.194 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.228 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.042) 0:00:45.295 ******* 2020-11-20T12:09:03.265 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.297 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.068) 0:00:45.363 ******* 2020-11-20T12:09:03.329 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.361 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.064) 0:00:45.428 ******* 2020-11-20T12:09:03.388 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.074) 0:00:45.502 ******* 2020-11-20T12:09:03.464 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:09:03.466 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.076) 0:00:45.579 ******* 2020-11-20T12:09:03.538 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-11-20T12:09:03.540 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.576 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.064) 0:00:45.643 ******* 2020-11-20T12:09:03.614 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T12:09:03.616 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.659 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.082) 0:00:45.726 ******* 2020-11-20T12:09:03.678 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi066.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-11-20T12:09:03.689 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.729 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.070) 0:00:45.796 ******* 2020-11-20T12:09:03.758 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:03.792 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:03 +0000 (0:00:00.062) 0:00:45.859 ******* 2020-11-20T12:09:04.181 INFO:teuthology.task.ansible.out: 2020-11-20T12:09:04.182 INFO:teuthology.task.ansible.out:TASK [common : Configure local epel mirrorlists] ******************************* ok: [smithi066.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-11-20T12:09:04.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.428) 0:00:46.288 ******* 2020-11-20T12:09:04.250 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-11-20T12:09:04.251 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.283 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.061) 0:00:46.350 ******* 2020-11-20T12:09:04.320 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:09:04.322 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.360 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.076) 0:00:46.427 ******* 2020-11-20T12:09:04.389 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.434 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.074) 0:00:46.501 ******* 2020-11-20T12:09:04.468 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.502 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.068) 0:00:46.569 ******* 2020-11-20T12:09:04.530 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-11-20T12:09:04.532 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.571 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.068) 0:00:46.638 ******* 2020-11-20T12:09:04.600 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.633 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.062) 0:00:46.700 ******* 2020-11-20T12:09:04.660 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-11-20T12:09:04.662 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.696 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.062) 0:00:46.763 ******* 2020-11-20T12:09:04.723 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-11-20T12:09:04.725 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.064) 0:00:46.827 ******* 2020-11-20T12:09:04.788 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-11-20T12:09:04.790 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:04.821 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:04 +0000 (0:00:00.060) 0:00:46.888 ******* 2020-11-20T12:09:05.517 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T12:09:05.519 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T12:09:05.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:05 +0000 (0:00:00.729) 0:00:47.618 ******* 2020-11-20T12:09:05.557 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-11-20T12:09:05.560 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.515629", "end": "2020-11-20 12:09:05.500346", "rc": 0, "start": "2020-11-20 12:09:04.984717", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.545552", "end": "2020-11-20 12:09:05.501400", "rc": 0, "start": "2020-11-20 12:09:03.955848", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:05.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:05 +0000 (0:00:00.043) 0:00:47.662 ******* 2020-11-20T12:09:05.629 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:05 +0000 (0:00:00.033) 0:00:47.696 ******* 2020-11-20T12:09:06.016 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:09:06.018 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T12:09:06.422 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T12:09:06.832 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T12:09:06.868 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:06 +0000 (0:00:01.238) 0:00:48.935 ******* 2020-11-20T12:09:07.052 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T12:09:07.053 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:09:07.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:07 +0000 (0:00:00.219) 0:00:49.154 ******* 2020-11-20T12:09:07.514 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:09:07.516 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T12:09:07.991 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T12:09:08.414 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T12:09:08.449 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:01.361) 0:00:50.516 ******* 2020-11-20T12:09:08.476 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T12:09:08.478 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.510 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.061) 0:00:50.577 ******* 2020-11-20T12:09:08.538 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-11-20T12:09:08.540 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T12:09:08.572 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.061) 0:00:50.639 ******* 2020-11-20T12:09:08.578 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T12:09:08.580 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T12:09:08.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.040) 0:00:50.680 ******* 2020-11-20T12:09:08.619 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T12:09:08.620 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.040) 0:00:50.721 ******* 2020-11-20T12:09:08.681 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-11-20T12:09:08.682 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.060) 0:00:50.781 ******* 2020-11-20T12:09:08.720 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-11-20T12:09:08.760 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.045) 0:00:50.827 ******* 2020-11-20T12:09:08.766 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-11-20T12:09:08.768 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.042) 0:00:50.869 ******* 2020-11-20T12:09:08.808 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-11-20T12:09:08.810 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Check for epel] ************************************************* changed: [smithi093.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:09:08.844 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.041) 0:00:50.911 ******* 2020-11-20T12:09:08.875 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.030) 0:00:50.942 ******* 2020-11-20T12:09:08.881 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T12:09:08.882 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Update apt cache] *********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.041) 0:00:50.983 ******* 2020-11-20T12:09:08.949 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.032) 0:00:51.016 ******* 2020-11-20T12:09:08.955 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T12:09:08.957 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.957 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.957 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi093.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:08.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:08 +0000 (0:00:00.045) 0:00:51.061 ******* 2020-11-20T12:09:09.025 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:09 +0000 (0:00:00.031) 0:00:51.092 ******* 2020-11-20T12:09:09.032 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-11-20T12:09:09.034 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:09.068 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:09 +0000 (0:00:00.042) 0:00:51.135 ******* 2020-11-20T12:09:09.432 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-11-20T12:09:09.435 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T12:09:09.472 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:09 +0000 (0:00:00.404) 0:00:51.539 ******* 2020-11-20T12:09:09.565 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-11-20T12:09:09.606 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:09 +0000 (0:00:00.133) 0:00:51.673 ******* 2020-11-20T12:09:11.458 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T12:09:11.459 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T12:09:11.608 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:11 +0000 (0:00:02.002) 0:00:53.676 ******* 2020-11-20T12:09:11.635 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T12:09:11.637 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:11.671 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:11 +0000 (0:00:00.062) 0:00:53.738 ******* 2020-11-20T12:09:11.890 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T12:09:11.891 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T12:09:11.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:11 +0000 (0:00:00.254) 0:00:53.992 ******* 2020-11-20T12:09:12.109 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T12:09:12.111 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T12:09:12.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:12 +0000 (0:00:00.217) 0:00:54.210 ******* 2020-11-20T12:09:12.150 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-11-20T12:09:12.151 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-11-20T12:09:12.185 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:12 +0000 (0:00:00.041) 0:00:54.252 ******* 2020-11-20T12:09:12.379 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:09:12.381 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T12:09:12.588 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T12:09:12.594 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T12:09:12.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:12 +0000 (0:00:00.437) 0:00:54.689 ******* 2020-11-20T12:09:12.660 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T12:09:12.662 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:12.694 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:12 +0000 (0:00:00.071) 0:00:54.761 ******* 2020-11-20T12:09:12.712 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi066.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-11-20T12:09:12.809 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T12:09:12.906 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* ok: [smithi093.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:09:12.940 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:12 +0000 (0:00:00.245) 0:00:55.007 ******* 2020-11-20T12:09:13.180 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:09:13.182 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-11-20T12:09:13.223 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-11-20T12:09:13.225 INFO:teuthology.task.ansible.out:fatal: [smithi093.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T12:09:13.262 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:00.321) 0:00:55.329 ******* 2020-11-20T12:09:13.270 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-11-20T12:09:13.272 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T12:09:13.309 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:00.046) 0:00:55.376 ******* 2020-11-20T12:09:13.315 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T12:09:13.318 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:13.361 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:00.051) 0:00:55.428 ******* 2020-11-20T12:09:13.484 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T12:09:13.485 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:09:13.531 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:00.170) 0:00:55.598 ******* 2020-11-20T12:09:13.613 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi066.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-11-20T12:09:13.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:00.116) 0:00:55.714 ******* 2020-11-20T12:09:13.802 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T12:09:13.839 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:00.191) 0:00:55.906 ******* 2020-11-20T12:09:13.845 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-11-20T12:09:13.847 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:09:13.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:13 +0000 (0:00:00.042) 0:00:55.948 ******* 2020-11-20T12:09:13.999 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:09:14.001 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T12:09:14.391 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-11-20T12:09:14.446 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-11-20T12:09:14.536 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T12:09:14.537 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:07:22 UTC", "ActiveEnterTimestampMonotonic": "15694630", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service time-sync.target network.target tmp.mount systemd-journald.socket basic.target system.slice nss-lookup.target -.mount var-run.mount local-fs.target sysinit.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:07:22 UTC", "AssertTimestampMonotonic": "15693005", "Before": "xdm.service getty@tty1.service plymouth-quit.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:07:22 UTC", "ConditionTimestampMonotonic": "15693004", "ConfigurationDirectoryMode": " 2020-11-20T12:09:14.539 INFO:teuthology.task.ansible.out:0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "968", "ExecMainStartTimestamp": "Fri 2020-11-20 12:07:22 UTC", "ExecMainStartTimestampMonotonic": "15694581", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:22 UTC] ; stop_time=[n/a] ; pid=968 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:07:22 UTC", "InactiveExitTimestampMonotonic": "15694630", "InvocationID": "379cf1632d0845598bc42e37a0592ede", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T12:09:14.541 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127236", "LimitNPROCSoft": "127236", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127236", "LimitSIGPENDINGSoft": "127236", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "968", "MemoryAccounting": "yes", "MemoryCurrent": "1380352", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T12:09:14.544 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:07:22 UTC", "StateChangeTimestampMonotonic": "15694630", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203578", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:07:22 UTC", "WatchdogTimestampMonotonic": "15694628", "WatchdogUSec": "0"}} 2020-11-20T12:09:14.573 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.691) 0:00:56.640 ******* 2020-11-20T12:09:14.763 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T12:09:14.765 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001749", "end": "2020-11-20 12:09:14.737420", "rc": 0, "start": "2020-11-20 12:09:14.735671", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T12:09:14.798 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.225) 0:00:56.866 ******* 2020-11-20T12:09:14.876 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:09:14.878 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} ok: [smithi132.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T12:09:14.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.117) 0:00:56.983 ******* 2020-11-20T12:09:14.963 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T12:09:14.965 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:14.997 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:14 +0000 (0:00:00.081) 0:00:57.065 ******* 2020-11-20T12:09:15.027 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T12:09:15.029 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T12:09:15.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.063) 0:00:57.128 ******* 2020-11-20T12:09:15.247 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T12:09:15.249 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:09:15.280 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.218) 0:00:57.347 ******* 2020-11-20T12:09:15.329 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-11-20T12:09:15.334 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.335 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-11-20T12:09:15.337 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-11-20T12:09:15.339 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.341 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.374 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.093) 0:00:57.441 ******* 2020-11-20T12:09:15.383 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.437 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.063) 0:00:57.505 ******* 2020-11-20T12:09:15.444 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-11-20T12:09:15.445 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.041) 0:00:57.546 ******* 2020-11-20T12:09:15.517 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-11-20T12:09:15.518 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-11-20T12:09:15.550 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.071) 0:00:57.617 ******* 2020-11-20T12:09:15.747 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-11-20T12:09:15.748 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:09:15.780 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.229) 0:00:57.847 ******* 2020-11-20T12:09:15.818 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.830 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.840 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.852 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:15.885 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:15 +0000 (0:00:00.105) 0:00:57.953 ******* 2020-11-20T12:09:17.232 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T12:09:17.233 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T12:09:17.267 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:17 +0000 (0:00:01.381) 0:00:59.334 ******* 2020-11-20T12:09:17.935 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T12:09:17.969 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:17 +0000 (0:00:00.701) 0:01:00.036 ******* 2020-11-20T12:09:17.996 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T12:09:17.998 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:18.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:18 +0000 (0:00:00.064) 0:01:00.100 ******* 2020-11-20T12:09:18.459 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-11-20T12:09:18.460 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-11-20T12:09:18.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:18 +0000 (0:00:00.461) 0:01:00.562 ******* 2020-11-20T12:09:18.501 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T12:09:18.503 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T12:09:18.538 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:18 +0000 (0:00:00.043) 0:01:00.606 ******* 2020-11-20T12:09:18.545 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu/Fedora)] ********** 2020-11-20T12:09:18.546 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:18.581 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:18 +0000 (0:00:00.042) 0:01:00.648 ******* 2020-11-20T12:09:18.969 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-11-20T12:09:18.971 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T12:09:19.003 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:18 +0000 (0:00:00.422) 0:01:01.070 ******* 2020-11-20T12:09:19.030 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-11-20T12:09:19.032 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-11-20T12:09:19.064 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.060) 0:01:01.131 ******* 2020-11-20T12:09:19.071 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-11-20T12:09:19.073 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:19.108 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.043) 0:01:01.175 ******* 2020-11-20T12:09:19.336 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T12:09:19.338 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:09:19.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.262) 0:01:01.438 ******* 2020-11-20T12:09:19.557 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-11-20T12:09:19.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.221) 0:01:01.659 ******* 2020-11-20T12:09:19.621 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi066.front.sepia.ceph.com] => (item=DAEMON_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "DAEMON_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:19.632 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=NRPE_OPTS) => {"ansible_loop_var": "item", "changed": false, "item": "NRPE_OPTS", "skip_reason": "Conditional result was False"} 2020-11-20T12:09:19.667 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.074) 0:01:01.734 ******* 2020-11-20T12:09:19.673 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T12:09:19.674 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} TASK [common : Check firewalld status] ***************************************** fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-11-20T12:09:19.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.042) 0:01:01.776 ******* 2020-11-20T12:09:19.742 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.032) 0:01:01.809 ******* 2020-11-20T12:09:19.780 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T12:09:19.782 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:19.821 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.078) 0:01:01.888 ******* 2020-11-20T12:09:19.880 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-11-20T12:09:19.882 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:09:19.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:19 +0000 (0:00:00.095) 0:01:01.984 ******* 2020-11-20T12:09:20.186 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** fatal: [smithi066.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-11-20T12:09:20.188 INFO:teuthology.task.ansible.out:...ignoring 2020-11-20T12:09:20.220 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:20 +0000 (0:00:00.303) 0:01:02.288 ******* 2020-11-20T12:09:20.247 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-11-20T12:09:20.249 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:20.280 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:20 +0000 (0:00:00.059) 0:01:02.347 ******* 2020-11-20T12:09:20.287 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T12:09:20.288 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T12:09:20.323 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:20 +0000 (0:00:00.042) 0:01:02.390 ******* 2020-11-20T12:09:20.528 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T12:09:20.531 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T12:09:20.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:20 +0000 (0:00:00.240) 0:01:02.631 ******* 2020-11-20T12:09:20.655 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T12:09:20.656 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:07:19 UTC", "ActiveEnterTimestampMonotonic": "15877412", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket time-sync.target var-run.mount system.slice systemd-tmpfiles-setup.service local-fs.target tmp.mount sysinit.target -.mount nss-lookup.target network.target basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:07:19 UTC", "AssertTimestampMonotonic": "15875137", "Before": "multi-user.target xdm.service plymouth-quit.service getty@tty1.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:07:19 UTC", "ConditionTimestampMonotonic": "15875137", "ConfigurationDirectoryMode": " 2020-11-20T12:09:20.657 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "976", "ExecMainStartTimestamp": "Fri 2020-11-20 12:07:19 UTC", "ExecMainStartTimestampMonotonic": "15877355", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:19 UTC] ; stop_time=[n/a] ; pid=976 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:07:19 UTC", "InactiveExitTimestampMonotonic": "15877412", "InvocationID": "5480cd50ba7c4db3a17176d526bfb0aa", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T12:09:20.660 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127238", "LimitNPROCSoft": "127238", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127238", "LimitSIGPENDINGSoft": "127238", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "976", "MemoryAccounting": "yes", "MemoryCurrent": "1380352", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T12:09:20.661 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:07:19 UTC", "StateChangeTimestampMonotonic": "15877412", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:07:19 UTC", "WatchdogTimestampMonotonic": "15877411", "WatchdogUSec": "0"}} 2020-11-20T12:09:20.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:20 +0000 (0:00:00.134) 0:01:02.765 ******* 2020-11-20T12:09:20.771 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-11-20T12:09:20.773 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "aa9150d4582f919d7a8504c01c8d86f05e3eeb5d", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1184, "state": "file", "uid": 0} 2020-11-20T12:09:20.819 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:20 +0000 (0:00:00.120) 0:01:02.886 ******* 2020-11-20T12:09:20.882 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T12:09:20.882 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001632", "end": "2020-11-20 12:09:20.857026", "rc": 0, "start": "2020-11-20 12:09:20.855394", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T12:09:20.921 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:20 +0000 (0:00:00.098) 0:01:02.985 ******* 2020-11-20T12:09:21.123 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-11-20T12:09:21.124 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:07:24 UTC", "ActiveEnterTimestampMonotonic": "15620701", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "nss-lookup.target time-sync.target systemd-journald.socket tmp.mount local-fs.target network.target systemd-tmpfiles-setup.service sysinit.target var-run.mount basic.target system.slice -.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:07:24 UTC", "AssertTimestampMonotonic": "15618333", "Before": "getty@tty1.service multi-user.target plymouth-quit.service shutdown.target xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:07:24 UTC", "ConditionTimestampMonotonic": "15618333", "ConfigurationDirectoryMode": " 2020-11-20T12:09:21.126 INFO:teuthology.task.ansible.out:0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "968", "ExecMainStartTimestamp": "Fri 2020-11-20 12:07:24 UTC", "ExecMainStartTimestampMonotonic": "15620627", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:24 UTC] ; stop_time=[n/a] ; pid=968 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "FreezerState": "running", "GID": "984", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:07:24 UTC", "InactiveExitTimestampMonotonic": "15620701", "InvocationID": "1c8e47ccdd784743ac8fff7bf56cca05", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infin 2020-11-20T12:09:21.128 INFO:teuthology.task.ansible.out:ity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127238", "LimitNPROCSoft": "127238", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127238", "LimitSIGPENDINGSoft": "127238", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "968", "MemoryAccounting": "yes", "MemoryCurrent": "1454080", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualSta 2020-11-20T12:09:21.129 INFO:teuthology.task.ansible.out:rt": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice sysinit.target -.mount", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:07:24 UTC", "StateChangeTimestampMonotonic": "15620701", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "988", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:07:24 UTC", "WatchdogTimestampMonotonic": "15620700", "WatchdogUSec": "0"}} 2020-11-20T12:09:21.160 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:21 +0000 (0:00:00.242) 0:01:03.227 ******* 2020-11-20T12:09:21.350 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-11-20T12:09:21.352 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001765", "end": "2020-11-20 12:09:21.321313", "rc": 0, "start": "2020-11-20 12:09:21.319548", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-11-20T12:09:21.386 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:21 +0000 (0:00:00.225) 0:01:03.453 ******* 2020-11-20T12:09:23.466 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-11-20T12:09:23.468 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T12:09:23.502 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:23 +0000 (0:00:02.115) 0:01:05.569 ******* 2020-11-20T12:09:23.943 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-11-20T12:09:23.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:23 +0000 (0:00:00.475) 0:01:06.044 ******* 2020-11-20T12:09:25.963 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-11-20T12:09:25.965 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T12:09:26.010 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:26 +0000 (0:00:02.032) 0:01:08.077 ******* 2020-11-20T12:09:26.547 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-11-20T12:09:26.582 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:26 +0000 (0:00:00.572) 0:01:08.649 ******* 2020-11-20T12:09:26.683 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-11-20T12:09:26.685 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T12:09:26.718 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:26 +0000 (0:00:00.136) 0:01:08.785 ******* 2020-11-20T12:09:27.266 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-11-20T12:09:27.304 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:27 +0000 (0:00:00.585) 0:01:09.371 ******* 2020-11-20T12:09:36.899 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T12:09:36.901 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.152933", "end": "2020-11-20 12:09:36.876338", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:09:20.723405", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T12:09:36.939 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:36 +0000 (0:00:09.634) 0:01:19.006 ******* 2020-11-20T12:09:37.444 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-11-20T12:09:37.446 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T12:09:37.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:37 +0000 (0:00:00.540) 0:01:19.546 ******* 2020-11-20T12:09:37.687 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T12:09:37.689 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.018101", "end": "2020-11-20 12:09:37.667368", "rc": 0, "start": "2020-11-20 12:09:37.649267", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:37.721 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:37 +0000 (0:00:00.241) 0:01:19.788 ******* 2020-11-20T12:09:37.909 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T12:09:37.911 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002175", "end": "2020-11-20 12:09:37.882587", "rc": 0, "start": "2020-11-20 12:09:37.880412", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:37.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:37 +0000 (0:00:00.231) 0:01:20.019 ******* 2020-11-20T12:09:43.118 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T12:09:43.121 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.211226", "end": "2020-11-20 12:09:43.091918", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:09:26.880692", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T12:09:43.168 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:05.215) 0:01:25.235 ******* 2020-11-20T12:09:43.633 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T12:09:43.670 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.501) 0:01:25.736 ******* 2020-11-20T12:09:43.875 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T12:09:43.877 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.015858", "end": "2020-11-20 12:09:43.846618", "rc": 0, "start": "2020-11-20 12:09:43.830760", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:43.908 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:43 +0000 (0:00:00.239) 0:01:25.975 ******* 2020-11-20T12:09:44.108 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-11-20T12:09:44.110 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002374", "end": "2020-11-20 12:09:44.078768", "rc": 0, "start": "2020-11-20 12:09:44.076394", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:44.143 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.235) 0:01:26.211 ******* 2020-11-20T12:09:44.446 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-11-20T12:09:44.448 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.949442", "end": "2020-11-20 12:09:44.415936", "failed_when_result": false, "rc": 0, "start": "2020-11-20 12:09:27.466494", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-11-20T12:09:44.481 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.337) 0:01:26.548 ******* 2020-11-20T12:09:44.943 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-11-20T12:09:44.984 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:44 +0000 (0:00:00.502) 0:01:27.050 ******* 2020-11-20T12:09:45.183 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-11-20T12:09:45.186 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.012538", "end": "2020-11-20 12:09:45.161646", "rc": 0, "start": "2020-11-20 12:09:45.149108", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:45.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.234) 0:01:27.285 ******* 2020-11-20T12:09:45.428 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.026594", "end": "2020-11-20 12:09:45.404892", "rc": 0, "start": "2020-11-20 12:09:45.378298", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:45.460 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:45 +0000 (0:00:00.241) 0:01:27.527 ******* 2020-11-20T12:09:54.239 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T12:09:54.241 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.083614", "end": "2020-11-20 12:09:54.208591", "rc": 0, "start": "2020-11-20 12:09:38.124977", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:09:54.285 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:08.824) 0:01:36.351 ******* 2020-11-20T12:09:54.476 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-11-20T12:09:54.477 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T12:09:54.511 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.226) 0:01:36.578 ******* 2020-11-20T12:09:54.538 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T12:09:54.540 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:54.571 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.060) 0:01:36.638 ******* 2020-11-20T12:09:54.610 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:54.611 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T12:09:54.642 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.070) 0:01:36.709 ******* 2020-11-20T12:09:54.669 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** 2020-11-20T12:09:54.671 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:54.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.060) 0:01:36.770 ******* 2020-11-20T12:09:54.729 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* 2020-11-20T12:09:54.731 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:54.763 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.060) 0:01:36.830 ******* 2020-11-20T12:09:54.821 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T12:09:54.823 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi093.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:09:54.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:54 +0000 (0:00:00.094) 0:01:36.924 ******* 2020-11-20T12:09:55.075 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** 2020-11-20T12:09:55.077 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:09:55.112 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.254) 0:01:37.179 ******* 2020-11-20T12:09:55.602 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T12:09:55.604 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874195.1462965-164169808707984/source", "state": "file", "uid": 0} 2020-11-20T12:09:55.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.528) 0:01:37.708 ******* 2020-11-20T12:09:55.669 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T12:09:55.671 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T12:09:55.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.068) 0:01:37.776 ******* 2020-11-20T12:09:55.759 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T12:09:55.761 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:55.795 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.085) 0:01:37.862 ******* 2020-11-20T12:09:55.832 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T12:09:55.834 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T12:09:55.870 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.075) 0:01:37.937 ******* 2020-11-20T12:09:55.908 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi093.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:09:55.944 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:55 +0000 (0:00:00.074) 0:01:38.011 ******* 2020-11-20T12:09:56.119 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-11-20T12:09:56.120 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:09:56.152 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.208) 0:01:38.220 ******* 2020-11-20T12:09:56.330 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-11-20T12:09:56.332 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T12:09:56.372 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.219) 0:01:38.439 ******* 2020-11-20T12:09:56.399 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T12:09:56.401 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.433 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.061) 0:01:38.500 ******* 2020-11-20T12:09:56.461 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:09:56.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.060) 0:01:38.561 ******* 2020-11-20T12:09:56.705 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T12:09:56.707 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T12:09:56.739 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:56 +0000 (0:00:00.244) 0:01:38.806 ******* 2020-11-20T12:09:57.231 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T12:09:57.233 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T12:09:57.264 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.525) 0:01:39.331 ******* 2020-11-20T12:09:57.302 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi093"}, "changed": false} 2020-11-20T12:09:57.336 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:57 +0000 (0:00:00.071) 0:01:39.402 ******* 2020-11-20T12:09:58.304 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T12:09:58.305 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi093", "ansible_hostname": "smithi093", "ansible_nodename": "smithi093"}, "changed": false, "name": "smithi093"} 2020-11-20T12:09:58.338 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:01.001) 0:01:40.404 ******* 2020-11-20T12:09:58.801 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T12:09:58.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:58 +0000 (0:00:00.499) 0:01:40.903 ******* 2020-11-20T12:09:59.290 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T12:09:59.292 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T12:09:59.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.490) 0:01:41.394 ******* 2020-11-20T12:09:59.916 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi093.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T12:09:59.949 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:09:59 +0000 (0:00:00.622) 0:01:42.016 ******* 2020-11-20T12:10:00.423 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T12:10:00.424 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T12:10:00.458 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.508) 0:01:42.525 ******* 2020-11-20T12:10:00.584 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T12:10:00.585 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.239806", "end": "2020-11-20 12:10:00.556036", "rc": 0, "start": "2020-11-20 12:09:44.316230", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:00.619 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.161) 0:01:42.686 ******* 2020-11-20T12:10:00.650 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:00.652 INFO:teuthology.task.ansible.out:TASK [testnode : Set mode on /etc/fuse.conf] *********************************** ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:10:00.690 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.070) 0:01:42.757 ******* 2020-11-20T12:10:00.810 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T12:10:00.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.198) 0:01:42.955 ******* 2020-11-20T12:10:00.897 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T12:10:00.940 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.050) 0:01:43.006 ******* 2020-11-20T12:10:00.945 INFO:teuthology.task.ansible.out: TASK [common : Check for podman] *********************************************** 2020-11-20T12:10:00.948 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:00.980 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:00 +0000 (0:00:00.041) 0:01:43.047 ******* 2020-11-20T12:10:01.024 INFO:teuthology.task.ansible.out: TASK [common : set_fact] ******************************************************* ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} 2020-11-20T12:10:01.068 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.087) 0:01:43.135 ******* 2020-11-20T12:10:01.096 INFO:teuthology.task.ansible.out: TASK [common : Check for docker] *********************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.130 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.061) 0:01:43.196 ******* 2020-11-20T12:10:01.156 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T12:10:01.159 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} TASK [common : set_fact] ******************************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:01.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.070) 0:01:43.267 ******* 2020-11-20T12:10:01.241 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.040) 0:01:43.308 ******* 2020-11-20T12:10:01.300 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T12:10:01.302 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:10:01.314 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:10:01.352 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.110) 0:01:43.419 ******* 2020-11-20T12:10:01.578 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:10:01.613 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.259) 0:01:43.678 ******* 2020-11-20T12:10:01.652 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T12:10:01.654 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T12:10:01.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:01 +0000 (0:00:00.080) 0:01:43.759 ******* 2020-11-20T12:10:02.133 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874201.63929-240175481737720/source", "state": "file", "uid": 0} 2020-11-20T12:10:02.168 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.475) 0:01:44.235 ******* 2020-11-20T12:10:02.201 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T12:10:02.236 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.067) 0:01:44.303 ******* 2020-11-20T12:10:02.242 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:10:02.244 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T12:10:02.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.043) 0:01:44.346 ******* 2020-11-20T12:10:02.285 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-11-20T12:10:02.287 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:10:02.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.045) 0:01:44.392 ******* 2020-11-20T12:10:02.374 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-11-20T12:10:02.376 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T12:10:02.414 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.089) 0:01:44.481 ******* 2020-11-20T12:10:02.432 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-11-20T12:10:02.434 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.786330", "end": "2020-11-20 12:10:02.406898", "rc": 0, "start": "2020-11-20 12:09:45.620568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:02.470 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.055) 0:01:44.537 ******* 2020-11-20T12:10:02.479 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T12:10:02.481 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:10:02.516 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.046) 0:01:44.583 ******* 2020-11-20T12:10:02.677 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-11-20T12:10:03.214 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:02 +0000 (0:00:00.209) 0:01:44.792 ******* TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} Friday 20 November 2020 12:10:02 +0000 (0:00:00.075) 0:01:44.868 ******* TASK [common : Check for podman] *********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:02 +0000 (0:00:00.061) 0:01:44.929 ******* TASK [common : set_fact] ******************************************************* ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"container_mirror_cert_path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000"}, "changed": false} Friday 20 November 2020 12:10:03 +0000 (0:00:00.147) 0:01:45.077 ******* TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} TASK [common : Check for docker] *********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:03 +0000 (0:00:00.084) 0:01:45.161 ******* Friday 20 November 2020 12:10:03 +0000 (0:00:00.036) 0:01:45.198 ******* TASK [common : set_fact] ******************************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:03 +0000 (0:00:00.044) 0:01:45.242 ******* TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "ski 2020-11-20T12:10:03.216 INFO:teuthology.task.ansible.out:p_reason": "Conditional result was False"} 2020-11-20T12:10:03.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.043) 0:01:45.286 ******* 2020-11-20T12:10:03.242 INFO:teuthology.task.ansible.out: TASK [common : Include encrypted variables] ************************************ 2020-11-20T12:10:03.244 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} ok: [smithi066.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-11-20T12:10:03.283 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.060) 0:01:45.346 ******* 2020-11-20T12:10:03.291 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:03.328 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.048) 0:01:45.395 ******* 2020-11-20T12:10:03.530 INFO:teuthology.task.ansible.out: TASK [common : Create /etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000] *** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:10:03.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.255) 0:01:45.650 ******* 2020-11-20T12:10:03.601 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi132.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T12:10:03.633 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:03 +0000 (0:00:00.048) 0:01:45.699 ******* 2020-11-20T12:10:04.183 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-11-20T12:10:04.187 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T12:10:04.229 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.597) 0:01:46.296 ******* 2020-11-20T12:10:04.238 INFO:teuthology.task.ansible.out: TASK [common : Copy docker-mirror.front.sepia.ceph.com:5000 self-signed cert] *** 2020-11-20T12:10:04.238 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "checksum": "d386a5d594d8bb6c408cf08541a4eb609577a03d", "dest": "/etc/containers/certs.d/docker-mirror.front.sepia.ceph.com:5000/docker-mirror.crt", "gid": 0, "group": "root", "md5sum": "e2cf8b6a8ad65ba91ea9fc53d49f1bf4", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 2236, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1605874203.613424-74135862024355/source", "state": "file", "uid": 0} 2020-11-20T12:10:04.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.065) 0:01:46.362 ******* 2020-11-20T12:10:04.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T12:10:04.304 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi132"}, "changed": false} 2020-11-20T12:10:04.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.055) 0:01:46.417 ******* 2020-11-20T12:10:04.359 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-11-20T12:10:04.360 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-11-20T12:10:04.405 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.052) 0:01:46.470 ******* 2020-11-20T12:10:04.425 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.944776", "end": "2020-11-20 12:10:04.381134", "rc": 0, "start": "2020-11-20 12:10:02.436358", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:04.466 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.061) 0:01:46.532 ******* 2020-11-20T12:10:04.474 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:10:04.515 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.050) 0:01:46.582 ******* 2020-11-20T12:10:04.522 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T12:10:04.524 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:04.560 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.044) 0:01:46.627 ******* 2020-11-20T12:10:04.569 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "epel_packages": ["dbench"], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["dnf-utils", "git-all", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "podman", "podman-docker", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "autoconf", "gdb", "iozone", "lvm2"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/redhat_8.yml"} 2020-11-20T12:10:04.606 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.045) 0:01:46.673 ******* 2020-11-20T12:10:04.646 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-11-20T12:10:04.648 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-11-20T12:10:04.685 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.079) 0:01:46.752 ******* 2020-11-20T12:10:04.889 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-11-20T12:10:04.929 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.237) 0:01:46.990 ******* 2020-11-20T12:10:04.940 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-11-20T12:10:04.942 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi132", "ansible_hostname": "smithi132", "ansible_nodename": "smithi132"}, "changed": false, "name": "smithi132"} 2020-11-20T12:10:04.979 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:04 +0000 (0:00:00.053) 0:01:47.044 ******* 2020-11-20T12:10:05.048 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T12:10:05.050 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T12:10:05.090 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.112) 0:01:47.156 ******* 2020-11-20T12:10:05.118 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T12:10:05.120 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "name": "ubuntu", "state": "present", "system": false} 2020-11-20T12:10:05.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.065) 0:01:47.222 ******* 2020-11-20T12:10:05.191 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.035) 0:01:47.257 ******* 2020-11-20T12:10:05.197 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-11-20T12:10:05.199 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.236 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.045) 0:01:47.303 ******* 2020-11-20T12:10:05.248 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T12:10:05.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.045) 0:01:47.348 ******* 2020-11-20T12:10:05.290 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.326 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.045) 0:01:47.393 ******* 2020-11-20T12:10:05.333 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T12:10:05.337 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.377 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.045) 0:01:47.439 ******* 2020-11-20T12:10:05.415 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T12:10:05.419 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.449 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.076) 0:01:47.516 ******* 2020-11-20T12:10:05.456 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T12:10:05.458 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T12:10:05.494 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.044) 0:01:47.561 ******* 2020-11-20T12:10:05.500 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-11-20T12:10:05.502 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.545 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.050) 0:01:47.612 ******* 2020-11-20T12:10:05.556 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-11-20T12:10:05.558 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-11-20T12:10:05.597 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.051) 0:01:47.663 ******* 2020-11-20T12:10:05.604 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:05.607 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.641 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.044) 0:01:47.708 ******* 2020-11-20T12:10:05.691 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.087) 0:01:47.795 ******* 2020-11-20T12:10:05.766 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:05.768 INFO:teuthology.task.ansible.out:TASK [testnode : Removing saved yum transactions] ****************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:05.805 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.076) 0:01:47.872 ******* 2020-11-20T12:10:05.938 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T12:10:05.940 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T12:10:05.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:05 +0000 (0:00:00.168) 0:01:48.040 ******* 2020-11-20T12:10:06.003 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi093.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007008", "end": "2020-11-20 12:10:05.978475", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:10:05.971467", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T12:10:06.039 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:06 +0000 (0:00:00.066) 0:01:48.107 ******* 2020-11-20T12:10:06.079 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:06.115 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:06 +0000 (0:00:00.075) 0:01:48.182 ******* 2020-11-20T12:10:06.155 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-11-20T12:10:06.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:06 +0000 (0:00:00.074) 0:01:48.256 ******* 2020-11-20T12:10:06.217 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-11-20T12:10:06.219 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi066"}, "changed": false} 2020-11-20T12:10:06.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:06 +0000 (0:00:00.062) 0:01:48.318 ******* 2020-11-20T12:10:06.562 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T12:10:06.595 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:06 +0000 (0:00:00.342) 0:01:48.661 ******* 2020-11-20T12:10:06.832 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi066", "ansible_hostname": "smithi066", "ansible_nodename": "smithi066"}, "changed": false, "name": "smithi066"} 2020-11-20T12:10:06.867 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:06 +0000 (0:00:00.273) 0:01:48.934 ******* 2020-11-20T12:10:07.075 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T12:10:07.077 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T12:10:07.110 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:07 +0000 (0:00:00.242) 0:01:49.177 ******* 2020-11-20T12:10:07.309 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:10:07.311 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:10:07.347 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:07 +0000 (0:00:00.237) 0:01:49.415 ******* 2020-11-20T12:10:07.357 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-11-20T12:10:07.359 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-11-20T12:10:07.392 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:07 +0000 (0:00:00.044) 0:01:49.459 ******* 2020-11-20T12:10:07.529 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T12:10:07.531 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T12:10:07.564 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:07 +0000 (0:00:00.171) 0:01:49.631 ******* 2020-11-20T12:10:07.771 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi132.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T12:10:07.802 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:07 +0000 (0:00:00.238) 0:01:49.869 ******* 2020-11-20T12:10:07.840 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-11-20T12:10:07.841 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-11-20T12:10:07.877 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:07 +0000 (0:00:00.073) 0:01:49.943 ******* 2020-11-20T12:10:08.350 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T12:10:08.384 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:08 +0000 (0:00:00.508) 0:01:50.452 ******* 2020-11-20T12:10:08.520 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-11-20T12:10:08.524 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-11-20T12:10:08.566 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:08 +0000 (0:00:00.178) 0:01:50.630 ******* 2020-11-20T12:10:08.861 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:10:08.862 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T12:10:08.917 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:08 +0000 (0:00:00.354) 0:01:50.984 ******* 2020-11-20T12:10:09.059 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-11-20T12:10:09.060 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-11-20T12:10:09.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:09 +0000 (0:00:00.175) 0:01:51.160 ******* 2020-11-20T12:10:09.301 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:10:09.303 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:10:09.335 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:09 +0000 (0:00:00.241) 0:01:51.402 ******* 2020-11-20T12:10:09.535 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T12:10:09.537 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-11-20T12:10:09.569 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:09 +0000 (0:00:00.233) 0:01:51.636 ******* 2020-11-20T12:10:09.801 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi066.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1236, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-11-20T12:10:09.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:09 +0000 (0:00:00.265) 0:01:51.902 ******* 2020-11-20T12:10:10.312 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T12:10:10.314 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-11-20T12:10:10.346 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:10 +0000 (0:00:00.511) 0:01:52.413 ******* 2020-11-20T12:10:10.817 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-11-20T12:10:10.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:10 +0000 (0:00:00.504) 0:01:52.917 ******* 2020-11-20T12:10:11.201 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T12:10:11.203 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.097750", "end": "2020-11-20 12:10:11.173072", "rc": 0, "start": "2020-11-20 12:10:09.075322", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:11.237 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:11 +0000 (0:00:00.386) 0:01:53.304 ******* 2020-11-20T12:10:11.264 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T12:10:11.266 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:11.299 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:11 +0000 (0:00:00.061) 0:01:53.366 ******* 2020-11-20T12:10:11.821 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T12:10:11.822 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T12:10:11.860 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:11 +0000 (0:00:00.561) 0:01:53.927 ******* 2020-11-20T12:10:11.887 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T12:10:11.925 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:11 +0000 (0:00:00.064) 0:01:53.992 ******* 2020-11-20T12:10:11.957 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T12:10:11.989 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:11 +0000 (0:00:00.064) 0:01:54.056 ******* 2020-11-20T12:10:12.016 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T12:10:12.018 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:12.050 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.060) 0:01:54.117 ******* 2020-11-20T12:10:12.099 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-11-20T12:10:12.101 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:12.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.083) 0:01:54.200 ******* 2020-11-20T12:10:12.172 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:12.208 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.074) 0:01:54.275 ******* 2020-11-20T12:10:12.235 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:12.237 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:12.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.061) 0:01:54.336 ******* 2020-11-20T12:10:12.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T12:10:12.300 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:12.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.062) 0:01:54.399 ******* 2020-11-20T12:10:12.369 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T12:10:12.370 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:12.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.070) 0:01:54.469 ******* 2020-11-20T12:10:12.430 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T12:10:12.432 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T12:10:12.468 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.065) 0:01:54.535 ******* 2020-11-20T12:10:12.595 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007015", "end": "2020-11-20 12:10:12.571151", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:10:12.564136", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T12:10:12.630 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.161) 0:01:54.696 ******* 2020-11-20T12:10:12.680 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:12.712 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:12 +0000 (0:00:00.083) 0:01:54.779 ******* 2020-11-20T12:10:13.084 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T12:10:13.086 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.038359", "end": "2020-11-20 12:10:13.050046", "rc": 0, "start": "2020-11-20 12:10:11.011687", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:13.118 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:00.405) 0:01:55.185 ******* 2020-11-20T12:10:13.146 INFO:teuthology.task.ansible.out: TASK [testnode : Configure local mirrorlists] ********************************** 2020-11-20T12:10:13.148 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:13.180 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:00.061) 0:01:55.247 ******* 2020-11-20T12:10:13.664 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-11-20T12:10:13.668 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item={'key': 'lab-extras', 'value': {'name': 'lab-extras', 'baseurl': 'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/', 'enabled': 1, 'gpgcheck': 0}}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-11-20T12:10:13.712 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:00.531) 0:01:55.779 ******* 2020-11-20T12:10:13.741 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-11-20T12:10:13.775 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:00.062) 0:01:55.842 ******* 2020-11-20T12:10:13.804 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-11-20T12:10:13.843 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:00.066) 0:01:55.909 ******* 2020-11-20T12:10:13.871 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-11-20T12:10:13.873 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:13.913 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:13 +0000 (0:00:00.071) 0:01:55.980 ******* 2020-11-20T12:10:13.964 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:13.975 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.008 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.095) 0:01:56.075 ******* 2020-11-20T12:10:14.036 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.069 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.060) 0:01:56.136 ******* 2020-11-20T12:10:14.097 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:14.099 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.131 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.061) 0:01:56.198 ******* 2020-11-20T12:10:14.170 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-11-20T12:10:14.172 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.205 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.072) 0:01:56.271 ******* 2020-11-20T12:10:14.242 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-11-20T12:10:14.244 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.282 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.078) 0:01:56.349 ******* 2020-11-20T12:10:14.494 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-11-20T12:10:14.496 INFO:teuthology.task.ansible.out:fatal: [smithi066.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.007309", "end": "2020-11-20 12:10:14.464686", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:10:14.457377", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-11-20T12:10:14.530 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.245) 0:01:56.595 ******* 2020-11-20T12:10:14.556 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:14.599 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:14 +0000 (0:00:00.070) 0:01:56.666 ******* 2020-11-20T12:10:18.266 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:10:18.268 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T12:10:18.301 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:18 +0000 (0:00:03.702) 0:02:00.368 ******* 2020-11-20T12:10:18.999 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T12:10:19.050 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:19 +0000 (0:00:00.747) 0:02:01.116 ******* 2020-11-20T12:10:21.320 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64", "Removed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64"]} 2020-11-20T12:10:21.354 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:21 +0000 (0:00:02.304) 0:02:03.421 ******* 2020-11-20T12:10:24.914 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:10:24.921 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T12:10:24.952 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:24 +0000 (0:00:03.597) 0:02:07.019 ******* 2020-11-20T12:10:25.178 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:25.180 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64"]} 2020-11-20T12:10:25.214 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:25 +0000 (0:00:00.262) 0:02:07.282 ******* 2020-11-20T12:10:27.400 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:10:27.401 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-10.el8.x86_64", "Removed: boost-random-1.66.0-10.el8.x86_64"]} 2020-11-20T12:10:27.436 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:02.220) 0:02:09.502 ******* 2020-11-20T12:10:27.814 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T12:10:27.815 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T12:10:27.848 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:27 +0000 (0:00:00.413) 0:02:09.915 ******* 2020-11-20T12:10:30.255 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:10:30.257 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T12:10:30.290 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:30 +0000 (0:00:02.442) 0:02:12.357 ******* 2020-11-20T12:10:30.318 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:10:30.321 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:30.359 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:30 +0000 (0:00:00.068) 0:02:12.426 ******* 2020-11-20T12:10:30.678 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice dbus.service polkit.service sysinit.target basic.target dbus.socket", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "iptables.service ip6tables.service ebtables.service nftables.service shutdown.target ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryM 2020-11-20T12:10:30.681 INFO:teuthology.task.ansible.out:in": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESof 2020-11-20T12:10:30.684 INFO:teuthology.task.ansible.out:t": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127236", "LimitNPROCSoft": "127236", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127236", "LimitSIGPENDINGSoft": "127236", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "n 2020-11-20T12:10:30.686 INFO:teuthology.task.ansible.out:ull", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203578", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T12:10:30.710 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:30 +0000 (0:00:00.350) 0:02:12.777 ******* 2020-11-20T12:10:30.991 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T12:10:30.993 INFO:teuthology.task.ansible.out:fatal: [smithi093.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T12:10:31.026 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:31 +0000 (0:00:00.315) 0:02:13.093 ******* 2020-11-20T12:10:31.699 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T12:10:31.701 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T12:10:31.733 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:31 +0000 (0:00:00.706) 0:02:13.800 ******* 2020-11-20T12:10:31.759 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T12:10:31.761 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:31.796 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:31 +0000 (0:00:00.063) 0:02:13.863 ******* 2020-11-20T12:10:31.830 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:31.863 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:31 +0000 (0:00:00.067) 0:02:13.930 ******* 2020-11-20T12:10:31.891 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T12:10:31.893 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Install packages] ********************************************* changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64"]} 2020-11-20T12:10:31.926 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:31 +0000 (0:00:00.062) 0:02:13.993 ******* 2020-11-20T12:10:31.960 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:31 +0000 (0:00:00.033) 0:02:14.027 ******* 2020-11-20T12:10:31.966 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T12:10:31.967 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:31 +0000 (0:00:00.045) 0:02:14.072 ******* 2020-11-20T12:10:32.034 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.076 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.070) 0:02:14.143 ******* 2020-11-20T12:10:32.103 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T12:10:32.105 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.137 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.061) 0:02:14.204 ******* 2020-11-20T12:10:32.164 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T12:10:32.199 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.062) 0:02:14.266 ******* 2020-11-20T12:10:32.227 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T12:10:32.229 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.263 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.064) 0:02:14.330 ******* 2020-11-20T12:10:32.290 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T12:10:32.292 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.325 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.061) 0:02:14.392 ******* 2020-11-20T12:10:32.355 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T12:10:32.357 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.366 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.086) 0:02:14.478 ******* 2020-11-20T12:10:32.441 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T12:10:32.443 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.495 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.083) 0:02:14.562 ******* 2020-11-20T12:10:32.522 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T12:10:32.555 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.060) 0:02:14.622 ******* 2020-11-20T12:10:32.597 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T12:10:32.599 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.634 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.079) 0:02:14.701 ******* 2020-11-20T12:10:32.665 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-11-20T12:10:32.667 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.709 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.074) 0:02:14.776 ******* 2020-11-20T12:10:32.738 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.772 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.062) 0:02:14.839 ******* 2020-11-20T12:10:32.799 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:10:32.801 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.834 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.061) 0:02:14.901 ******* 2020-11-20T12:10:32.862 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T12:10:32.864 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.895 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.061) 0:02:14.962 ******* 2020-11-20T12:10:32.932 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:32.934 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:32.966 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:32 +0000 (0:00:00.070) 0:02:15.033 ******* 2020-11-20T12:10:32.997 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T12:10:32.999 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.066) 0:02:15.099 ******* 2020-11-20T12:10:33.064 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.098 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.064) 0:02:15.164 ******* 2020-11-20T12:10:33.123 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T12:10:33.125 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.170 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.073) 0:02:15.237 ******* 2020-11-20T12:10:33.200 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.234 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.063) 0:02:15.301 ******* 2020-11-20T12:10:33.261 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.295 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.060) 0:02:15.362 ******* 2020-11-20T12:10:33.322 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T12:10:33.324 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.358 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.063) 0:02:15.425 ******* 2020-11-20T12:10:33.386 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T12:10:33.388 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.419 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.060) 0:02:15.486 ******* 2020-11-20T12:10:33.446 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T12:10:33.448 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.479 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.060) 0:02:15.547 ******* 2020-11-20T12:10:33.507 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.545 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.065) 0:02:15.612 ******* 2020-11-20T12:10:33.573 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.610 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.064) 0:02:15.677 ******* 2020-11-20T12:10:33.644 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-11-20T12:10:33.646 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.095) 0:02:15.772 ******* 2020-11-20T12:10:33.735 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.769 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.063) 0:02:15.836 ******* 2020-11-20T12:10:33.797 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:10:33.798 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.842 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.073) 0:02:15.909 ******* 2020-11-20T12:10:33.870 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-11-20T12:10:33.872 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.068) 0:02:15.978 ******* 2020-11-20T12:10:33.938 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T12:10:33.940 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:33.977 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:33 +0000 (0:00:00.065) 0:02:16.044 ******* 2020-11-20T12:10:34.004 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:10:34.005 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.039 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.062) 0:02:16.106 ******* 2020-11-20T12:10:34.079 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:34.080 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.113 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.072) 0:02:16.179 ******* 2020-11-20T12:10:34.140 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:10:34.141 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.181 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.067) 0:02:16.247 ******* 2020-11-20T12:10:34.213 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:34.215 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.246 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.066) 0:02:16.314 ******* 2020-11-20T12:10:34.273 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:10:34.275 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.307 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.060) 0:02:16.375 ******* 2020-11-20T12:10:34.334 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T12:10:34.339 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.060) 0:02:16.435 ******* 2020-11-20T12:10:34.395 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.428 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.060) 0:02:16.495 ******* 2020-11-20T12:10:34.435 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-11-20T12:10:34.436 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T12:10:34.475 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.044) 0:02:16.539 ******* 2020-11-20T12:10:34.478 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T12:10:34.480 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.045) 0:02:16.585 ******* 2020-11-20T12:10:34.548 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.584 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.065) 0:02:16.651 ******* 2020-11-20T12:10:34.612 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:34.614 INFO:teuthology.task.ansible.out:TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.648 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.064) 0:02:16.715 ******* 2020-11-20T12:10:34.666 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:34.668 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Installed: dnf-utils", "Installed: git-all", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: podman", "Installed: podman-docker", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: autoconf", "Installed: gdb", "Installed: iozone", "Installed: lvm2", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:4.2.0-34.module+el8.3.0+7976+077be4ec.x86_64", "Installed: boost-program-options-1.66.0-10.el8.x86_64", "Installed: boost-random-1.66.0-10.el8.x86_64", "Installed: librados2-1:12.2.7-9.el8.x86_64"]} 2020-11-20T12:10:34.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.055) 0:02:16.771 ******* 2020-11-20T12:10:34.711 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:34.713 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.748 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.044) 0:02:16.815 ******* 2020-11-20T12:10:34.777 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T12:10:34.779 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.811 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.062) 0:02:16.878 ******* 2020-11-20T12:10:34.850 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.073) 0:02:16.951 ******* 2020-11-20T12:10:34.923 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:34.955 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:34 +0000 (0:00:00.071) 0:02:17.023 ******* 2020-11-20T12:10:34.989 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.101 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:35 +0000 (0:00:00.065) 0:02:17.088 ******* TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.061) 0:02:17.150 ******* TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.062) 0:02:17.212 ******* TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.059) 0:02:17.272 ******* TASK [testnode : Set grub config.] ********************************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.062) 0:02:17.334 ******* TASK [testnode : Remove /etc/ceph] ********************************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.063) 0:02:17.398 ******* TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.062) 0:02:17.460 ******* TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0 2020-11-20T12:10:36.103 INFO:teuthology.task.ansible.out::00:00.090) 0:02:17.550 ******* TASK [testnode : Upload weekly kernel-clean crontab.] ************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.062) 0:02:17.613 ******* TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.073) 0:02:17.687 ******* TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.061) 0:02:17.748 ******* TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.060) 0:02:17.809 ******* TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.061) 0:02:17.870 ******* TASK [testnode : Stop collectl] ************************************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.060) 0:02:17.931 ******* TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.060) 0:02:17.991 ******* TASK 2020-11-20T12:10:36.105 INFO:teuthology.task.ansible.out:[testnode : Check to see if we need to edit /etc/profile.] **************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:35 +0000 (0:00:00.060) 0:02:18.051 ******* TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:36 +0000 (0:00:00.075) 0:02:18.127 ******* TASK [testnode : set_fact] ***************************************************** ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T12:10:36.122 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.061) 0:02:18.189 ******* 2020-11-20T12:10:36.159 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T12:10:36.161 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.171 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T12:10:36.184 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.193 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.204 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.206 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.216 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.256 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.134) 0:02:18.323 ******* 2020-11-20T12:10:36.475 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T12:10:36.477 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003276", "end": "2020-11-20 12:10:36.451046", "rc": 0, "start": "2020-11-20 12:10:36.447770", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T12:10:36.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.258) 0:02:18.581 ******* 2020-11-20T12:10:36.555 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.592 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.077) 0:02:18.659 ******* 2020-11-20T12:10:36.619 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.062) 0:02:18.722 ******* 2020-11-20T12:10:36.685 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.717 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.062) 0:02:18.785 ******* 2020-11-20T12:10:36.744 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T12:10:36.746 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:36.778 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.060) 0:02:18.845 ******* 2020-11-20T12:10:36.932 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T12:10:36.966 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:36 +0000 (0:00:00.187) 0:02:19.033 ******* 2020-11-20T12:10:36.993 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-11-20T12:10:36.995 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:37.029 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:37 +0000 (0:00:00.063) 0:02:19.096 ******* 2020-11-20T12:10:37.237 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: dbench"]} 2020-11-20T12:10:37.276 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:37 +0000 (0:00:00.246) 0:02:19.343 ******* 2020-11-20T12:10:37.327 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T12:10:37.328 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target dbus.socket dbus.service polkit.service sysinit.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nftables.service ebtables.service iptables.service ip6tables.service ipset.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T12:10:37.330 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T12:10:37.331 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127238", "LimitNPROCSoft": "127238", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127238", "LimitSIGPENDINGSoft": "127238", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T12:10:37.333 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T12:10:37.365 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:37 +0000 (0:00:00.089) 0:02:19.432 ******* 2020-11-20T12:10:37.637 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-11-20T12:10:37.639 INFO:teuthology.task.ansible.out:fatal: [smithi132.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-11-20T12:10:37.674 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:37 +0000 (0:00:00.308) 0:02:19.741 ******* 2020-11-20T12:10:37.935 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T12:10:37.968 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:37 +0000 (0:00:00.294) 0:02:20.035 ******* 2020-11-20T12:10:38.006 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.045 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.075) 0:02:20.111 ******* 2020-11-20T12:10:38.071 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T12:10:38.072 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.063) 0:02:20.174 ******* 2020-11-20T12:10:38.134 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T12:10:38.136 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.169 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.062) 0:02:20.237 ******* 2020-11-20T12:10:38.198 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T12:10:38.200 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.233 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.063) 0:02:20.300 ******* 2020-11-20T12:10:38.260 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.293 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.059) 0:02:20.360 ******* 2020-11-20T12:10:38.319 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T12:10:38.321 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.353 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.059) 0:02:20.420 ******* 2020-11-20T12:10:38.379 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T12:10:38.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.059) 0:02:20.480 ******* 2020-11-20T12:10:38.440 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T12:10:38.441 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.474 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.061) 0:02:20.541 ******* 2020-11-20T12:10:38.502 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T12:10:38.504 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.538 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.061) 0:02:20.602 ******* 2020-11-20T12:10:38.579 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.590 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.632 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.096) 0:02:20.699 ******* 2020-11-20T12:10:38.659 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.693 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.061) 0:02:20.760 ******* 2020-11-20T12:10:38.721 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T12:10:38.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.073) 0:02:20.834 ******* 2020-11-20T12:10:38.796 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.830 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.062) 0:02:20.897 ******* 2020-11-20T12:10:38.858 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.905 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.075) 0:02:20.972 ******* 2020-11-20T12:10:38.934 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-11-20T12:10:38.935 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:38.967 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:38 +0000 (0:00:00.062) 0:02:21.034 ******* 2020-11-20T12:10:38.995 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.032 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.064) 0:02:21.099 ******* 2020-11-20T12:10:39.059 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T12:10:39.060 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.095 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.062) 0:02:21.161 ******* 2020-11-20T12:10:39.121 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:39.124 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.157 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.063) 0:02:21.225 ******* 2020-11-20T12:10:39.185 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-11-20T12:10:39.186 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.221 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.062) 0:02:21.287 ******* 2020-11-20T12:10:39.237 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-11-20T12:10:39.239 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T12:10:39.275 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.054) 0:02:21.342 ******* 2020-11-20T12:10:39.281 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-11-20T12:10:39.283 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.318 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.043) 0:02:21.385 ******* 2020-11-20T12:10:39.323 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T12:10:39.325 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420989952, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153562, 'block_used': 12941546, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153562, "block_size": 4096, "block_total": 240095108, "block_used": 12941546, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420989952, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T12:10:39.361 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.042) 0:02:21.428 ******* 2020-11-20T12:10:39.368 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T12:10:39.369 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.042) 0:02:21.471 ******* 2020-11-20T12:10:39.430 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T12:10:39.432 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.468 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.064) 0:02:21.535 ******* 2020-11-20T12:10:39.495 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T12:10:39.497 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.529 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.061) 0:02:21.596 ******* 2020-11-20T12:10:39.546 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T12:10:39.549 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005045", "end": "2020-11-20 12:10:39.519670", "rc": 0, "start": "2020-11-20 12:10:39.514625", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:39.580 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.050) 0:02:21.647 ******* 2020-11-20T12:10:39.587 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T12:10:39.588 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.622 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.042) 0:02:21.689 ******* 2020-11-20T12:10:39.630 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T12:10:39.631 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420989952, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153562, 'block_used': 12941546, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153562, "block_size": 4096, "block_total": 240095108, "block_used": 12941546, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420989952, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.667 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.044) 0:02:21.734 ******* 2020-11-20T12:10:39.674 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T12:10:39.690 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.708 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.041) 0:02:21.775 ******* 2020-11-20T12:10:39.715 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T12:10:39.751 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.042) 0:02:21.818 ******* 2020-11-20T12:10:39.758 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-11-20T12:10:39.761 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.794 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.043) 0:02:21.861 ******* 2020-11-20T12:10:39.822 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:10:39.824 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.856 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.061) 0:02:21.923 ******* 2020-11-20T12:10:39.864 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:10:39.866 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-11-20T12:10:39.906 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.050) 0:02:21.973 ******* 2020-11-20T12:10:39.913 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T12:10:39.914 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.949 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.042) 0:02:22.016 ******* 2020-11-20T12:10:39.955 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:39.992 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:39 +0000 (0:00:00.042) 0:02:22.059 ******* 2020-11-20T12:10:39.998 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:40.000 INFO:teuthology.task.ansible.out:TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.033 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.041) 0:02:22.100 ******* 2020-11-20T12:10:40.061 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.093 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.060) 0:02:22.161 ******* 2020-11-20T12:10:40.120 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:10:40.122 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.154 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.060) 0:02:22.221 ******* 2020-11-20T12:10:40.181 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.214 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.060) 0:02:22.281 ******* 2020-11-20T12:10:40.241 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T12:10:40.242 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.274 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.059) 0:02:22.341 ******* 2020-11-20T12:10:40.292 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-11-20T12:10:40.294 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket sysinit.target dbus.service system.slice polkit.service basic.target", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "nftables.service ebtables.service ipset.service ip6tables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "D 2020-11-20T12:10:40.296 INFO:teuthology.task.ansible.out:evicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "Limi 2020-11-20T12:10:40.297 INFO:teuthology.task.ansible.out:tNOFILESoft": "1024", "LimitNPROC": "127238", "LimitNPROCSoft": "127238", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127238", "LimitSIGPENDINGSoft": "127238", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "dbus.socket system.slice sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "S 2020-11-20T12:10:40.299 INFO:teuthology.task.ansible.out:tartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-11-20T12:10:40.327 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.052) 0:02:22.394 ******* 2020-11-20T12:10:40.334 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:10:40.336 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.371 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.043) 0:02:22.438 ******* 2020-11-20T12:10:40.400 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:40.402 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.445 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.074) 0:02:22.512 ******* 2020-11-20T12:10:40.474 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-11-20T12:10:40.475 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.063) 0:02:22.575 ******* 2020-11-20T12:10:40.536 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.074) 0:02:22.650 ******* 2020-11-20T12:10:40.615 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi066.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.647 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.064) 0:02:22.714 ******* 2020-11-20T12:10:40.681 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.033) 0:02:22.748 ******* 2020-11-20T12:10:40.723 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.758 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.076) 0:02:22.825 ******* 2020-11-20T12:10:40.795 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T12:10:40.797 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.835 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.076) 0:02:22.902 ******* 2020-11-20T12:10:40.861 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T12:10:40.863 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.895 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.060) 0:02:22.962 ******* 2020-11-20T12:10:40.923 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:40.957 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.061) 0:02:23.024 ******* 2020-11-20T12:10:40.964 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-11-20T12:10:40.965 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-11-20T12:10:41.000 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:40 +0000 (0:00:00.042) 0:02:23.067 ******* 2020-11-20T12:10:41.006 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T12:10:41.008 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.043 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.043) 0:02:23.110 ******* 2020-11-20T12:10:41.050 INFO:teuthology.task.ansible.out: TASK [testnode : Install abrt] ************************************************* 2020-11-20T12:10:41.051 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.086 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.042) 0:02:23.153 ******* 2020-11-20T12:10:41.092 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:41.094 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.128 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.042) 0:02:23.195 ******* 2020-11-20T12:10:41.134 INFO:teuthology.task.ansible.out: TASK [testnode : Enable abrt-auto-reporting] *********************************** 2020-11-20T12:10:41.136 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.171 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.042) 0:02:23.237 ******* 2020-11-20T12:10:41.178 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.212 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.041) 0:02:23.279 ******* 2020-11-20T12:10:41.218 INFO:teuthology.task.ansible.out: TASK [testnode : Set OpenGPGCheck in abrt-action-save-package-data.conf] ******* 2020-11-20T12:10:41.220 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.255 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.042) 0:02:23.321 ******* 2020-11-20T12:10:41.262 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:41.262 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQco4GKYCoj9HwYO1uM6KDHukQkk1c7dgKI'], 'uuids': ['681de935-e494-439a-944c-784029ad9b26'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.266111", "end": "2020-11-20 12:10:41.200851", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQco4GKYCoj9HwYO1uM6KDHukQkk1c7dgKI"], "labels": [], "masters": [], "uuids": ["681de935-e494-439a-944c-784029ad9b26"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:39.934740", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:41.264 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.299 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.044) 0:02:23.366 ******* 2020-11-20T12:10:41.305 INFO:teuthology.task.ansible.out: TASK [testnode : Set ProcessUnpackaged in abrt-action-save-package-data.conf] *** 2020-11-20T12:10:41.307 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.342 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.042) 0:02:23.408 ******* 2020-11-20T12:10:41.348 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T12:10:41.351 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.046) 0:02:23.455 ******* 2020-11-20T12:10:41.393 INFO:teuthology.task.ansible.out: TASK [testnode : Restart abrtd] ************************************************ 2020-11-20T12:10:41.395 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.429 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.041) 0:02:23.496 ******* 2020-11-20T12:10:41.435 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T12:10:41.440 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.471 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.042) 0:02:23.538 ******* 2020-11-20T12:10:41.477 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-11-20T12:10:41.479 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.046) 0:02:23.585 ******* 2020-11-20T12:10:41.526 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.561 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.042) 0:02:23.628 ******* 2020-11-20T12:10:41.568 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-11-20T12:10:41.604 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.043) 0:02:23.671 ******* 2020-11-20T12:10:41.611 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-11-20T12:10:41.612 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.649 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.044) 0:02:23.716 ******* 2020-11-20T12:10:41.656 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-11-20T12:10:41.658 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.705 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.056) 0:02:23.773 ******* 2020-11-20T12:10:41.717 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T12:10:41.719 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.773 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.067) 0:02:23.840 ******* 2020-11-20T12:10:41.783 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-11-20T12:10:41.784 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.831 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.056) 0:02:23.896 ******* 2020-11-20T12:10:41.839 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.888 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.058) 0:02:23.955 ******* 2020-11-20T12:10:41.899 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-11-20T12:10:41.901 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.935 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.046) 0:02:24.002 ******* 2020-11-20T12:10:41.941 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T12:10:41.943 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:41.981 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:41 +0000 (0:00:00.046) 0:02:24.048 ******* 2020-11-20T12:10:41.992 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-11-20T12:10:41.997 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.031 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.049) 0:02:24.098 ******* 2020-11-20T12:10:42.038 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T12:10:42.040 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.073 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.041) 0:02:24.140 ******* 2020-11-20T12:10:42.079 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-11-20T12:10:42.117 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.043) 0:02:24.183 ******* 2020-11-20T12:10:42.123 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:42.125 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.160 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.044) 0:02:24.227 ******* 2020-11-20T12:10:42.166 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-11-20T12:10:42.168 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.204 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.043) 0:02:24.271 ******* 2020-11-20T12:10:42.211 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T12:10:42.213 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.248 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.044) 0:02:24.315 ******* 2020-11-20T12:10:42.255 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.042) 0:02:24.358 ******* 2020-11-20T12:10:42.300 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.361 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.065) 0:02:24.424 ******* 2020-11-20T12:10:42.369 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.416 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.058) 0:02:24.483 ******* 2020-11-20T12:10:42.425 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.046) 0:02:24.530 ******* 2020-11-20T12:10:42.472 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.507 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.042) 0:02:24.573 ******* 2020-11-20T12:10:42.516 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Gipk9g-Boz6-tIC3-KJTm-lWyk-iOcm-7OO0ey', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040150400BGN', 'nvme-nvme.8086-50484654363230343031353034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.091580", "end": "2020-11-20 12:10:42.484983", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Gipk9g-Boz6-tIC3-KJTm-lWyk-iOcm-7OO0ey", "nvme-INTEL_SSDPEDMD400G4_PHFT62040150400BGN", "nvme-nvme.8086-50484654363230343031353034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "n 2020-11-20T12:10:42.517 INFO:teuthology.task.ansible.out:one", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:41.393403", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:42.551 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.043) 0:02:24.616 ******* 2020-11-20T12:10:42.555 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-11-20T12:10:42.557 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.055) 0:02:24.672 ******* 2020-11-20T12:10:42.614 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-11-20T12:10:42.617 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.661 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.050) 0:02:24.723 ******* 2020-11-20T12:10:42.675 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:42.678 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.713 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.053) 0:02:24.776 ******* 2020-11-20T12:10:42.716 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T12:10:42.718 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.757 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.047) 0:02:24.824 ******* 2020-11-20T12:10:42.763 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.040) 0:02:24.864 ******* 2020-11-20T12:10:42.804 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-11-20T12:10:42.806 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.839 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.041) 0:02:24.906 ******* 2020-11-20T12:10:42.846 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.881 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.041) 0:02:24.948 ******* 2020-11-20T12:10:42.888 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T12:10:42.890 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.922 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.041) 0:02:24.989 ******* 2020-11-20T12:10:42.929 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-11-20T12:10:42.930 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:42.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:42 +0000 (0:00:00.041) 0:02:25.030 ******* 2020-11-20T12:10:42.970 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T12:10:42.972 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.005 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.041) 0:02:25.072 ******* 2020-11-20T12:10:43.011 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-11-20T12:10:43.013 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.047 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.041) 0:02:25.114 ******* 2020-11-20T12:10:43.053 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:43.055 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T12:10:43.090 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.043) 0:02:25.157 ******* 2020-11-20T12:10:43.096 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-11-20T12:10:43.100 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.132 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.041) 0:02:25.199 ******* 2020-11-20T12:10:43.138 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T12:10:43.140 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} ok: [smithi132.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T12:10:43.151 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.162 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-11-20T12:10:43.164 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi132.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.200 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.068) 0:02:25.267 ******* 2020-11-20T12:10:43.207 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.209 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.249 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.049) 0:02:25.317 ******* 2020-11-20T12:10:43.256 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-11-20T12:10:43.258 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.291 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.041) 0:02:25.358 ******* 2020-11-20T12:10:43.319 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.352 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.060) 0:02:25.419 ******* 2020-11-20T12:10:43.379 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-11-20T12:10:43.381 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.060) 0:02:25.480 ******* 2020-11-20T12:10:43.440 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-11-20T12:10:43.442 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.476 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.062) 0:02:25.543 ******* 2020-11-20T12:10:43.482 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-11-20T12:10:43.484 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004829", "end": "2020-11-20 12:10:43.430582", "rc": 0, "start": "2020-11-20 12:10:43.425753", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T12:10:43.526 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.050) 0:02:25.593 ******* 2020-11-20T12:10:43.533 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.574 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.047) 0:02:25.641 ******* 2020-11-20T12:10:43.582 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-11-20T12:10:43.584 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.623 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.048) 0:02:25.690 ******* 2020-11-20T12:10:43.629 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-11-20T12:10:43.631 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.665 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.041) 0:02:25.732 ******* 2020-11-20T12:10:43.671 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T12:10:43.673 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.041) 0:02:25.773 ******* 2020-11-20T12:10:43.712 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-11-20T12:10:43.714 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.747 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.040) 0:02:25.814 ******* 2020-11-20T12:10:43.754 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T12:10:43.756 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.791 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.043) 0:02:25.858 ******* 2020-11-20T12:10:43.800 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.803 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcDfjk9PdgTiVCPXcH8oWP6VRkEd7KDSeV'], 'uuids': ['c8a2d8d2-76e6-4061-a875-83b0bceed25e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.067454", "end": "2020-11-20 12:10:43.749360", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcDfjk9PdgTiVCPXcH8oWP6VRkEd7KDSeV"], "labels": [], "masters": [], "uuids": ["c8a2d8d2-76e6-4061-a875-83b0bceed25e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:42.681906", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk usi 2020-11-20T12:10:43.807 INFO:teuthology.task.ansible.out:ng fdisk or", "other utilities."]} 2020-11-20T12:10:43.837 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.046) 0:02:25.904 ******* 2020-11-20T12:10:43.844 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-11-20T12:10:43.846 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.879 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.042) 0:02:25.947 ******* 2020-11-20T12:10:43.886 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-11-20T12:10:43.888 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.923 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.043) 0:02:25.990 ******* 2020-11-20T12:10:43.950 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-11-20T12:10:43.952 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:43.984 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:43 +0000 (0:00:00.061) 0:02:26.052 ******* 2020-11-20T12:10:44.013 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.046 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.061) 0:02:26.113 ******* 2020-11-20T12:10:44.074 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.107 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.061) 0:02:26.174 ******* 2020-11-20T12:10:44.134 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-11-20T12:10:44.136 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.168 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.060) 0:02:26.235 ******* 2020-11-20T12:10:44.195 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.230 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.060) 0:02:26.295 ******* 2020-11-20T12:10:44.266 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T12:10:44.310 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:10:44 +0000 (0:00:00.077) 0:02:26.373 ******* 2020-11-20T12:10:44.356 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.389 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.083) 0:02:26.456 ******* 2020-11-20T12:10:44.419 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.452 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.062) 0:02:26.519 ******* 2020-11-20T12:10:44.480 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T12:10:44.482 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.517 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.061) 0:02:26.581 ******* 2020-11-20T12:10:44.541 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T12:10:44.543 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.577 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.061) 0:02:26.642 ******* 2020-11-20T12:10:44.602 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:44.604 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.637 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.061) 0:02:26.703 ******* 2020-11-20T12:10:44.674 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-11-20T12:10:44.676 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.720 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.083) 0:02:26.787 ******* 2020-11-20T12:10:44.750 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-11-20T12:10:44.752 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.785 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.065) 0:02:26.852 ******* 2020-11-20T12:10:44.814 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.850 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.065) 0:02:26.917 ******* 2020-11-20T12:10:44.877 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T12:10:44.878 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.061) 0:02:26.978 ******* 2020-11-20T12:10:44.939 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:44.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:44 +0000 (0:00:00.061) 0:02:27.040 ******* 2020-11-20T12:10:45.000 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.034 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.061) 0:02:27.101 ******* 2020-11-20T12:10:45.041 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:45.043 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcEj1ENEUf29F4piIqQPlCktSjWTu9xopQ'], 'uuids': ['aeeccfa4-10c1-4367-8d44-86742b246169'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.052432", "end": "2020-11-20 12:10:44.991554", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcEj1ENEUf29F4piIqQPlCktSjWTu9xopQ"], "labels": [], "masters": [], "uuids": ["aeeccfa4-10c1-4367-8d44-86742b246169"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:43.939122", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:45.053 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-11-20T12:10:45.055 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.087 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.052) 0:02:27.154 ******* 2020-11-20T12:10:45.114 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.148 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.061) 0:02:27.215 ******* 2020-11-20T12:10:45.176 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-11-20T12:10:45.178 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.210 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.062) 0:02:27.277 ******* 2020-11-20T12:10:45.248 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-11-20T12:10:45.250 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.287 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.076) 0:02:27.354 ******* 2020-11-20T12:10:45.314 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-11-20T12:10:45.316 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.367 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.080) 0:02:27.434 ******* 2020-11-20T12:10:45.423 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-11-20T12:10:45.425 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.457 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.089) 0:02:27.524 ******* 2020-11-20T12:10:45.484 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.518 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.061) 0:02:27.585 ******* 2020-11-20T12:10:45.546 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.583 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.064) 0:02:27.650 ******* 2020-11-20T12:10:45.621 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.656 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.072) 0:02:27.722 ******* 2020-11-20T12:10:45.685 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.727 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.071) 0:02:27.794 ******* 2020-11-20T12:10:45.755 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-11-20T12:10:45.757 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.788 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.061) 0:02:27.855 ******* 2020-11-20T12:10:45.816 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.849 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.060) 0:02:27.916 ******* 2020-11-20T12:10:45.877 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-11-20T12:10:45.879 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.061) 0:02:27.978 ******* 2020-11-20T12:10:45.940 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-11-20T12:10:45.942 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:45.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:45 +0000 (0:00:00.062) 0:02:28.041 ******* 2020-11-20T12:10:46.001 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-11-20T12:10:46.034 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.060) 0:02:28.102 ******* 2020-11-20T12:10:46.083 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-11-20T12:10:46.085 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.095 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-11-20T12:10:46.097 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.106 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.118 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.131 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.169 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.134) 0:02:28.236 ******* 2020-11-20T12:10:46.299 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:46.301 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc40aB9OgOPxv7zRrjVVLCrPgndW9JgdSe'], 'uuids': ['cf31aeb2-c0a5-4d24-be89-e51522f616c3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.089234", "end": "2020-11-20 12:10:46.263081", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc40aB9OgOPxv7zRrjVVLCrPgndW9JgdSe"], "labels": [], "masters": [], "uuids": ["cf31aeb2-c0a5-4d24-be89-e51522f616c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:45.173847", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:46.312 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L5Z8', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5L5Z8', 'scsi-35000c500918e738f', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8', 'wwn-0x5000c500918e738f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5L5Z8', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500918e738f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L5Z8-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5L5Z8-part1', 'scsi-35000c500918e738f-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1', 'wwn-0x5000c500918e738f-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L5Z8", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5L5Z8", "scsi-35000c500918e738f", "scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8", "wwn-0x5000c500918e738f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L5Z8-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T12:10:46.314 INFO:teuthology.task.ansible.out:Z1W5L5Z8-part1", "scsi-35000c500918e738f-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1", "wwn-0x5000c500918e738f-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L5Z8", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e738f"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.324 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T12:10:46.380 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.209) 0:02:28.446 ******* 2020-11-20T12:10:46.418 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:46.420 INFO:teuthology.task.ansible.out:TASK [testnode : Check for teuthology-lock command] **************************** changed: [smithi066.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.005939", "end": "2020-11-20 12:10:46.374719", "rc": 0, "start": "2020-11-20 12:10:46.368780", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-11-20T12:10:46.464 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.082) 0:02:28.528 ******* 2020-11-20T12:10:46.472 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi132.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T12:10:46.508 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.045) 0:02:28.574 ******* 2020-11-20T12:10:46.513 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.553 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.046) 0:02:28.620 ******* 2020-11-20T12:10:46.591 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-11-20T12:10:46.593 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.626 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.071) 0:02:28.692 ******* 2020-11-20T12:10:46.654 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-11-20T12:10:46.657 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.688 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.062) 0:02:28.755 ******* 2020-11-20T12:10:46.705 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-11-20T12:10:46.707 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.004960", "end": "2020-11-20 12:10:46.674528", "rc": 0, "start": "2020-11-20 12:10:46.669568", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:46.739 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.051) 0:02:28.806 ******* 2020-11-20T12:10:46.746 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.782 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.042) 0:02:28.849 ******* 2020-11-20T12:10:46.790 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** skipping: [smithi132.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:46.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.049) 0:02:28.898 ******* 2020-11-20T12:10:46.859 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T12:10:46.892 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:46 +0000 (0:00:00.061) 0:02:28.959 ******* 2020-11-20T12:10:47.591 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:47.594 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc3gBXYutxySOXDUhWeGOcWyTQIOXS0X0q'], 'uuids': ['a2c555cf-180c-4968-824b-0928c0af004d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.063355", "end": "2020-11-20 12:10:47.550551", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc3gBXYutxySOXDUhWeGOcWyTQIOXS0X0q"], "labels": [], "masters": [], "uuids": ["a2c555cf-180c-4968-824b-0928c0af004d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:46.487196", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:47.637 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:47 +0000 (0:00:00.744) 0:02:29.704 ******* 2020-11-20T12:10:48.018 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQco4GKYCoj9HwYO1uM6KDHukQkk1c7dgKI'], 'uuids': ['681de935-e494-439a-944c-784029ad9b26'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138234", "end": "2020-11-20 12:10:47.978634", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQco4GKYCoj9HwYO1uM6KDHukQkk1c7dgKI"], "labels": [], "masters": [], "uuids": ["681de935-e494-439a-944c-784029ad9b26"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:47.840400", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135599 s, 851 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135599 s, 851 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:48.219 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-Gipk9g-Boz6-tIC3-KJTm-lWyk-iOcm-7OO0ey', 'nvme-INTEL_SSDPEDMD400G4_PHFT62040150400BGN', 'nvme-nvme.8086-50484654363230343031353034303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037185", "end": "2020-11-20 12:10:48.189016", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-Gipk9g-Boz6-tIC3-KJTm-lWyk-iOcm-7OO0ey", "nvme-INTEL_SSDPEDMD400G4_PHFT62040150400BGN", "nvme-nvme.8086-50484654363230343031353034303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:48.151831", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0345834 s, 3.3 GB/s", "std 2020-11-20T12:10:48.221 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0345834 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:48.421 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:48.423 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5gR00Z9OEP5pqWbM0KEMSBezvJHXeirv0'], 'uuids': ['1ac988d9-79ed-49f2-82fd-213030838e84'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.317436", "end": "2020-11-20 12:10:48.388233", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5gR00Z9OEP5pqWbM0KEMSBezvJHXeirv0"], "labels": [], "masters": [], "uuids": ["1ac988d9-79ed-49f2-82fd-213030838e84"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:47.070797", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:48.529 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcDfjk9PdgTiVCPXcH8oWP6VRkEd7KDSeV'], 'uuids': ['c8a2d8d2-76e6-4061-a875-83b0bceed25e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.138925", "end": "2020-11-20 12:10:48.499290", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcDfjk9PdgTiVCPXcH8oWP6VRkEd7KDSeV"], "labels": [], "masters": [], "uuids": ["c8a2d8d2-76e6-4061-a875-83b0bceed25e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:48.360365", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136424 s, 845 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136424 s, 845 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:48.834 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcEj1ENEUf29F4piIqQPlCktSjWTu9xopQ'], 'uuids': ['aeeccfa4-10c1-4367-8d44-86742b246169'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.138664", "end": "2020-11-20 12:10:48.806376", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQcEj1ENEUf29F4piIqQPlCktSjWTu9xopQ"], "labels": [], "masters": [], "uuids": ["aeeccfa4-10c1-4367-8d44-86742b246169"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:48.667712", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.13603 s, 848 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.13603 s, 848 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:49.141 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc40aB9OgOPxv7zRrjVVLCrPgndW9JgdSe'], 'uuids': ['cf31aeb2-c0a5-4d24-be89-e51522f616c3'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.142458", "end": "2020-11-20 12:10:49.115788", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc40aB9OgOPxv7zRrjVVLCrPgndW9JgdSe"], "labels": [], "masters": [], "uuids": ["cf31aeb2-c0a5-4d24-be89-e51522f616c3"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:48.973330", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139881 s, 825 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139881 s, 825 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:49.153 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L5Z8', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5L5Z8', 'scsi-35000c500918e738f', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8', 'wwn-0x5000c500918e738f'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5L5Z8', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500918e738f', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5L5Z8-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5L5Z8-part1', 'scsi-35000c500918e738f-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1', 'wwn-0x5000c500918e738f-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L5Z8", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5L5Z8", "scsi-35000c500918e738f", "scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8", "wwn-0x5000c500918e738f"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5L5Z8-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T12:10:49.156 INFO:teuthology.task.ansible.out:Z1W5L5Z8-part1", "scsi-35000c500918e738f-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5L5Z8-part1", "wwn-0x5000c500918e738f-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5L5Z8", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500918e738f"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.376 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-11-20T12:10:49.410 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:01.773) 0:02:31.477 ******* 2020-11-20T12:10:49.461 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi066.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442567680, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158830, 'block_used': 12936278, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158830, "block_size": 4096, "block_total": 240095108, "block_used": 12936278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442567680, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}} 2020-11-20T12:10:49.461 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:49.462 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc3gBXYutxySOXDUhWeGOcWyTQIOXS0X0q'], 'uuids': ['a2c555cf-180c-4968-824b-0928c0af004d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.138843", "end": "2020-11-20 12:10:49.430793", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-DqcAR3MfdclYhbBwc3NCzIIjSTuAekQc3gBXYutxySOXDUhWeGOcWyTQIOXS0X0q"], "labels": [], "masters": [], "uuids": ["a2c555cf-180c-4968-824b-0928c0af004d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:49.291950", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136263 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136263 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:49.502 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.091) 0:02:31.569 ******* 2020-11-20T12:10:49.535 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.032) 0:02:31.602 ******* 2020-11-20T12:10:49.703 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:49.712 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-9Gf76g-tKnW-wYvm-Mlgh-oNIp-XnWv-pa1oD4', 'nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN', 'nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.094055", "end": "2020-11-20 12:10:49.664354", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-9Gf76g-tKnW-wYvm-Mlgh-oNIp-XnWv-pa1oD4", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN", "nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:48.570299", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T12:10:49.713 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005131", "end": "2020-11-20 12:10:49.671218", "rc": 0, "start": "2020-11-20 12:10:49.666087", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:49.752 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.217) 0:02:31.819 ******* 2020-11-20T12:10:49.782 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi093.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.057277", "end": "2020-11-20 12:10:49.748565", "rc": 0, "start": "2020-11-20 12:10:49.691288", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:49.836 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.082) 0:02:31.902 ******* 2020-11-20T12:10:49.845 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-11-20T12:10:49.846 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442567680, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158830, 'block_used': 12936278, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158830, "block_size": 4096, "block_total": 240095108, "block_used": 12936278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442567680, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:49.884 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.049) 0:02:31.952 ******* 2020-11-20T12:10:49.913 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-11-20T12:10:49.957 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:49 +0000 (0:00:00.072) 0:02:32.024 ******* 2020-11-20T12:10:50.081 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T12:10:50.084 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.058285", "end": "2020-11-20 12:10:50.057167", "rc": 0, "start": "2020-11-20 12:10:49.998882", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:50.120 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.162) 0:02:32.186 ******* 2020-11-20T12:10:50.148 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T12:10:50.190 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.070) 0:02:32.257 ******* 2020-11-20T12:10:50.228 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T12:10:50.230 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:50.269 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.079) 0:02:32.336 ******* 2020-11-20T12:10:50.306 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T12:10:50.309 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:50.343 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.074) 0:02:32.410 ******* 2020-11-20T12:10:50.374 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:50.411 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.067) 0:02:32.478 ******* 2020-11-20T12:10:50.451 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-11-20T12:10:50.453 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:50.486 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.074) 0:02:32.553 ******* 2020-11-20T12:10:50.677 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T12:10:50.679 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:10:50.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.236) 0:02:32.789 ******* 2020-11-20T12:10:50.776 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ skipping: [smithi093.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930420989952, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227153562, 'block_used': 12941546, 'inode_total': 61054976, 'inode_available': 60986954, 'inode_used': 68022, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227153562, "block_size": 4096, "block_total": 240095108, "block_used": 12941546, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986954, "inode_total": 61054976, "inode_used": 68022, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930420989952, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:50.838 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.115) 0:02:32.905 ******* 2020-11-20T12:10:50.880 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:50.916 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.078) 0:02:32.983 ******* 2020-11-20T12:10:50.955 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:50.957 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:50.990 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:50 +0000 (0:00:00.074) 0:02:33.058 ******* 2020-11-20T12:10:51.000 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:51.002 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5RYXmjWR2oXrSvwqDZ2KwUso0IVWBv14F'], 'uuids': ['4b72c3fb-eae8-494d-820e-c6ebfe67ffb7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.088479", "end": "2020-11-20 12:10:50.953400", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5RYXmjWR2oXrSvwqDZ2KwUso0IVWBv14F"], "labels": [], "masters": [], "uuids": ["4b72c3fb-eae8-494d-820e-c6ebfe67ffb7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:49.864921", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:51.025 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:51.027 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:51.061 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:51 +0000 (0:00:00.070) 0:02:33.128 ******* 2020-11-20T12:10:51.100 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:51.147 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:51 +0000 (0:00:00.085) 0:02:33.213 ******* 2020-11-20T12:10:51.186 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T12:10:51.188 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:51.223 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:51 +0000 (0:00:00.076) 0:02:33.290 ******* 2020-11-20T12:10:51.250 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T12:10:51.252 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:51.306 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:51 +0000 (0:00:00.082) 0:02:33.373 ******* 2020-11-20T12:10:51.613 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedIh5ejUQ3IeC9a3aIVCoCOuOZV1rq0PBJ'], 'uuids': ['923acb1f-2d4a-41f9-8e99-8aada5f981fc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.382323", "end": "2020-11-20 12:10:51.528469", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedIh5ejUQ3IeC9a3aIVCoCOuOZV1rq0PBJ"], "labels": [], "masters": [], "uuids": ["923acb1f-2d4a-41f9-8e99-8aada5f981fc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:50.146146", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2020-11-20T12:10:51.623 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2020-11-20T12:10:52.175 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T12:10:52.176 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:52.214 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:52 +0000 (0:00:00.907) 0:02:34.280 ******* 2020-11-20T12:10:52.231 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:52.233 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5r3r5C3Ai8vlanO6UXsm3P6z97V3KdlHb'], 'uuids': ['abfa4fa6-5e63-42c2-93ea-986a7e5fca0f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.057761", "end": "2020-11-20 12:10:52.190683", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5r3r5C3Ai8vlanO6UXsm3P6z97V3KdlHb"], "labels": [], "masters": [], "uuids": ["abfa4fa6-5e63-42c2-93ea-986a7e5fca0f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:51.132922", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:52.862 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:52.921 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:52.923 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-9VUZHE-MkIL-tEZu-Hlff-HsyY-81uK-OQLWCZ', 'nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN', 'nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.058489", "end": "2020-11-20 12:10:52.869035", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-9VUZHE-MkIL-tEZu-Hlff-HsyY-81uK-OQLWCZ", "nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN", "nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:51.810546", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! 2020-11-20T12:10:52.927 INFO:teuthology.task.ansible.out:You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:53.186 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:53.472 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5WdGmd6UvkNyDhl5T0QAHmdHIfNZRLmda'], 'uuids': ['1ad5042c-2667-4919-bd4e-45aa3cc08b15'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.050925", "end": "2020-11-20 12:10:53.440337", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5WdGmd6UvkNyDhl5T0QAHmdHIfNZRLmda"], "labels": [], "masters": [], "uuids": ["1ad5042c-2667-4919-bd4e-45aa3cc08b15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:52.389412", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2020-11-20T12:10:53.474 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2020-11-20T12:10:53.484 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM6D', 'scsi-35000c500929332c1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D', 'wwn-0x5000c500929332c1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XM6D', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500929332c1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM6D-part1', 'scsi-35000c500929332c1-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D-part1', 'wwn-0x5000c500929332c1-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM6D", "scsi-35000c500929332c1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D", "wwn-0x5000c500929332c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T12:10:53.486 INFO:teuthology.task.ansible.out:Z1W5XM6D-part1", "scsi-35000c500929332c1-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D-part1", "wwn-0x5000c500929332c1-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM6D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929332c1"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:53.516 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:10:53.518 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:53.841 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:54.155 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:54.157 INFO:teuthology.task.ansible.out:TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedndbn3ydo7rTPNDl4hz67CTFGIh2FCW03'], 'uuids': ['80ccade1-baa6-41e1-8b0d-3476fc2e5c23'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.041552", "end": "2020-11-20 12:10:54.121666", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedndbn3ydo7rTPNDl4hz67CTFGIh2FCW03"], "labels": [], "masters": [], "uuids": ["80ccade1-baa6-41e1-8b0d-3476fc2e5c23"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:53.080114", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using 2020-11-20T12:10:54.159 INFO:teuthology.task.ansible.out: fdisk or", "other utilities."]} 2020-11-20T12:10:54.206 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:54 +0000 (0:00:01.992) 0:02:36.273 ******* 2020-11-20T12:10:54.386 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T12:10:54.387 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T12:10:54.420 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:54 +0000 (0:00:00.213) 0:02:36.487 ******* 2020-11-20T12:10:54.630 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T12:10:54.632 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:54.731 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:54.733 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5hC0lHg92NOd71isHMxRzI5Xel4LQDin6'], 'uuids': ['bfac9d79-a465-4e54-8f98-b16e8075b14e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.067960", "end": "2020-11-20 12:10:54.699657", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5hC0lHg92NOd71isHMxRzI5Xel4LQDin6"], "labels": [], "masters": [], "uuids": ["bfac9d79-a465-4e54-8f98-b16e8075b14e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:53.631697", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:54.800 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:54 +0000 (0:00:00.378) 0:02:36.866 ******* 2020-11-20T12:10:54.821 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:54.959 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:55.134 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:10:55.136 INFO:teuthology.task.ansible.out: 2020-11-20T12:10:55.273 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:55.461 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:55 +0000 (0:00:00.659) 0:02:37.526 ******* 2020-11-20T12:10:55.467 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:55.469 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5gR00Z9OEP5pqWbM0KEMSBezvJHXeirv0'], 'uuids': ['1ac988d9-79ed-49f2-82fd-213030838e84'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138857", "end": "2020-11-20 12:10:55.279369", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5gR00Z9OEP5pqWbM0KEMSBezvJHXeirv0"], "labels": [], "masters": [], "uuids": ["1ac988d9-79ed-49f2-82fd-213030838e84"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:55.140512", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136164 s, 847 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136164 s, 847 MB/s"], "stdout": "", "stdout_lines": []} TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:55.469 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedzHGxu4iO68ndpmWFmsM89LTKo7cxbhc8'], 'uuids': ['e25e1908-fc9e-4e8e-a07d-b30da3515d94'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 's 2020-11-20T12:10:55.471 INFO:teuthology.task.ansible.out:as_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.048431", "end": "2020-11-20 12:10:55.371078", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedzHGxu4iO68ndpmWFmsM89LTKo7cxbhc8"], "labels": [], "masters": [], "uuids": ["e25e1908-fc9e-4e8e-a07d-b30da3515d94"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:54.322647", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:55.557 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:55.559 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-9Gf76g-tKnW-wYvm-Mlgh-oNIp-XnWv-pa1oD4', 'nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN', 'nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037444", "end": "2020-11-20 12:10:55.525775", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-9Gf76g-tKnW-wYvm-Mlgh-oNIp-XnWv-pa1oD4", "nvme-INTEL_SSDPEDMD400G4_CVFT6232000B400BGN", "nvme-nvme.8086-43564654363233323030304234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:55.488331", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0348385 s, 3.3 GB/s", "std 2020-11-20T12:10:55.560 INFO:teuthology.task.ansible.out:err_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0348385 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:55.647 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:10:55.682 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:55 +0000 (0:00:00.223) 0:02:37.749 ******* 2020-11-20T12:10:55.709 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:55.745 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:55 +0000 (0:00:00.062) 0:02:37.812 ******* 2020-11-20T12:10:55.889 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5RYXmjWR2oXrSvwqDZ2KwUso0IVWBv14F'], 'uuids': ['4b72c3fb-eae8-494d-820e-c6ebfe67ffb7'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.139229", "end": "2020-11-20 12:10:55.839370", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5RYXmjWR2oXrSvwqDZ2KwUso0IVWBv14F"], "labels": [], "masters": [], "uuids": ["4b72c3fb-eae8-494d-820e-c6ebfe67ffb7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:55.700141", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136687 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136687 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:56.176 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi093.front.sepia.ceph.com] => {"changed": true} 2020-11-20T12:10:56.213 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.467) 0:02:38.279 ******* 2020-11-20T12:10:56.219 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:56.221 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5r3r5C3Ai8vlanO6UXsm3P6z97V3KdlHb'], 'uuids': ['abfa4fa6-5e63-42c2-93ea-986a7e5fca0f'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.141296", "end": "2020-11-20 12:10:56.175780", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5r3r5C3Ai8vlanO6UXsm3P6z97V3KdlHb"], "labels": [], "masters": [], "uuids": ["abfa4fa6-5e63-42c2-93ea-986a7e5fca0f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:56.034484", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.138677 s, 832 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.138677 s, 832 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:56.521 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5WdGmd6UvkNyDhl5T0QAHmdHIfNZRLmda'], 'uuids': ['1ad5042c-2667-4919-bd4e-45aa3cc08b15'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.142478", "end": "2020-11-20 12:10:56.493564", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5WdGmd6UvkNyDhl5T0QAHmdHIfNZRLmda"], "labels": [], "masters": [], "uuids": ["1ad5042c-2667-4919-bd4e-45aa3cc08b15"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:56.351086", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.139978 s, 824 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.139978 s, 824 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:56.538 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM6D', 'scsi-35000c500929332c1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D', 'wwn-0x5000c500929332c1'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W5XM6D', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c500929332c1', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM6D-part1', 'scsi-35000c500929332c1-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D-part1', 'wwn-0x5000c500929332c1-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W5XM6D", "scsi-35000c500929332c1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D", "wwn-0x5000c500929332c1"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XM6D-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W5XM6D-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T12:10:56.540 INFO:teuthology.task.ansible.out:Z1W5XM6D-part1", "scsi-35000c500929332c1-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W5XM6D-part1", "wwn-0x5000c500929332c1-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XM6D", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c500929332c1"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:56.651 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T12:10:56.654 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T12:10:56.685 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.472) 0:02:38.752 ******* 2020-11-20T12:10:56.692 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-11-20T12:10:56.693 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswed9b1nJyW7g1zZEEuCOrnKNce41exuJMJ9'], 'uuids': ['2684e529-96f5-410f-a228-5b3bb852750d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.056834", "end": "2020-11-20 12:10:56.655655", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswed9b1nJyW7g1zZEEuCOrnKNce41exuJMJ9"], "labels": [], "masters": [], "uuids": ["2684e529-96f5-410f-a228-5b3bb852750d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:55.598821", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-11-20T12:10:56.699 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4W2RJ', 'scsi-35000c50087b90a26', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ', 'wwn-0x5000c50087b90a26'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4W2RJ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50087b90a26', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4W2RJ-part1', 'scsi-35000c50087b90a26-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1', 'wwn-0x5000c50087b90a26-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4W2RJ", "scsi-35000c50087b90a26", "scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ", "wwn-0x5000c50087b90a26"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T12:10:56.701 INFO:teuthology.task.ansible.out:Z1W4W2RJ-part1", "scsi-35000c50087b90a26-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1", "wwn-0x5000c50087b90a26-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2RJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b90a26"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:56.722 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T12:10:56.724 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:56.755 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.070) 0:02:38.822 ******* 2020-11-20T12:10:56.784 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T12:10:56.785 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:56.817 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.061) 0:02:38.884 ******* 2020-11-20T12:10:56.846 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-11-20T12:10:56.847 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:56.849 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5hC0lHg92NOd71isHMxRzI5Xel4LQDin6'], 'uuids': ['bfac9d79-a465-4e54-8f98-b16e8075b14e'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.148261", "end": "2020-11-20 12:10:56.824330", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-gBaSnEuf5DsKEEpOTdMctxckYiMCmoa5hC0lHg92NOd71isHMxRzI5Xel4LQDin6"], "labels": [], "masters": [], "uuids": ["bfac9d79-a465-4e54-8f98-b16e8075b14e"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:56.676069", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.14571 s, 792 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.14571 s, 792 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:56.897 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.079) 0:02:38.964 ******* 2020-11-20T12:10:56.931 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.034) 0:02:38.998 ******* 2020-11-20T12:10:56.938 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-11-20T12:10:56.940 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:56.973 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:56 +0000 (0:00:00.041) 0:02:39.040 ******* 2020-11-20T12:10:56.999 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.040 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.064) 0:02:39.105 ******* 2020-11-20T12:10:57.072 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.114 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.075) 0:02:39.181 ******* 2020-11-20T12:10:57.186 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T12:10:57.197 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Remove all LVM data] ****************************************** changed: [smithi132.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.056756", "end": "2020-11-20 12:10:57.144019", "rc": 0, "start": "2020-11-20 12:10:57.087263", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:57.222 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.107) 0:02:39.289 ******* 2020-11-20T12:10:57.257 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.032) 0:02:39.321 ******* 2020-11-20T12:10:57.261 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.299 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.045) 0:02:39.366 ******* 2020-11-20T12:10:57.356 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.388 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.088) 0:02:39.455 ******* 2020-11-20T12:10:57.420 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.457 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.069) 0:02:39.524 ******* 2020-11-20T12:10:57.488 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.522 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.064) 0:02:39.589 ******* 2020-11-20T12:10:57.529 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.052756", "end": "2020-11-20 12:10:57.501949", "rc": 0, "start": "2020-11-20 12:10:57.449193", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:57.567 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.043) 0:02:39.632 ******* 2020-11-20T12:10:57.596 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T12:10:57.635 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.068) 0:02:39.701 ******* 2020-11-20T12:10:57.660 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-11-20T12:10:57.662 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.697 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.063) 0:02:39.764 ******* 2020-11-20T12:10:57.725 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T12:10:57.727 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.067) 0:02:39.831 ******* 2020-11-20T12:10:57.792 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.832 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.064) 0:02:39.895 ******* 2020-11-20T12:10:57.868 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:57.911 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:57 +0000 (0:00:00.082) 0:02:39.978 ******* 2020-11-20T12:10:57.968 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedJLb2bnMALjXs4h0AY2i0twiy3auEwqcD'], 'uuids': ['50649420-608f-4dfe-9207-62ddc57b0a81'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.060824", "end": "2020-11-20 12:10:57.922140", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedJLb2bnMALjXs4h0AY2i0twiy3auEwqcD"], "labels": [], "masters": [], "uuids": ["50649420-608f-4dfe-9207-62ddc57b0a81"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:56.861316", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk u 2020-11-20T12:10:57.969 INFO:teuthology.task.ansible.out:sing fdisk or", "other utilities."]} 2020-11-20T12:10:58.021 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.110) 0:02:40.088 ******* 2020-11-20T12:10:58.029 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-11-20T12:10:58.032 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T12:10:58.066 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.045) 0:02:40.133 ******* 2020-11-20T12:10:58.130 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-11-20T12:10:58.132 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-11-20T12:10:58.166 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.099) 0:02:40.233 ******* 2020-11-20T12:10:58.204 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-11-20T12:10:58.206 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442608640, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158840, 'block_used': 12936268, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158840, "block_size": 4096, "block_total": 240095108, "block_used": 12936268, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442608640, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.239 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.072) 0:02:40.306 ******* 2020-11-20T12:10:58.266 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.303 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.063) 0:02:40.370 ******* 2020-11-20T12:10:58.330 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:58.332 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.366 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.063) 0:02:40.433 ******* 2020-11-20T12:10:58.385 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T12:10:58.386 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:07:22 UTC", "ActiveEnterTimestampMonotonic": "15790371", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount basic.target sysinit.target ntpd.service ntpdate.service system.slice systemd-tmpfiles-setup.service systemd-journald.socket sntp.service tmp.mount", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:07:21 UTC", "AssertTimestampMonotonic": "14499764", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:07:21 UTC", "ConditionTimestampMonotonic": "14499727", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGro 2020-11-20T12:10:58.389 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "899", "ExecMainStartTimestamp": "Fri 2020-11-20 12:07:22 UTC", "ExecMainStartTimestampMonotonic": "15687398", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:21 UTC] ; stop_time=[Fri 2020-11-20 12:07:22 UTC] ; pid=874 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:22 UTC] ; stop_time=[Fri 2020-11-20 12:07:22 UTC] ; pid=966 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:07:21 UTC", "InactiveExitTimestampMonotonic": "14531392", "InvocationID": "8e6ac6c09ffe46458d24e16862fbf89e", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T12:10:58.391 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127236", "LimitNPROCSoft": "127236", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127236", "LimitSIGPENDINGSoft": "127236", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "899", "MemoryAccounting": "yes", "MemoryCurrent": "3211264", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T12:10:58.392 INFO:teuthology.task.ansible.out:equires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:07:22 UTC", "StateChangeTimestampMonotonic": "15790371", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203578", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:07:22 UTC", "WatchdogTimestampMonotonic": "15687413", "WatchdogUSec": "0"}} 2020-11-20T12:10:58.431 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.063) 0:02:40.496 ******* 2020-11-20T12:10:58.436 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:10:58.438 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:58.438 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-1', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_2', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedIh5ejUQ3IeC9a3aIVCoCOuOZV1rq0PBJ'], 'uuids': ['923acb1f-2d4a-41f9-8e99-8aada5f981fc'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.139092", "end": "2020-11-20 12:10:58.371523", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedIh5ejUQ3IeC9a3aIVCoCOuOZV1rq0PBJ"], "labels": [], "masters": [], "uuids": ["923acb1f-2d4a-41f9-8e99-8aada5f981fc"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:58.232431", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136288 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136288 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:58.476 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.047) 0:02:40.544 ******* 2020-11-20T12:10:58.484 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T12:10:58.520 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.043) 0:02:40.587 ******* 2020-11-20T12:10:58.526 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-11-20T12:10:58.528 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.042) 0:02:40.630 ******* 2020-11-20T12:10:58.574 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T12:10:58.607 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.044) 0:02:40.675 ******* 2020-11-20T12:10:58.614 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T12:10:58.616 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.660 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.052) 0:02:40.727 ******* 2020-11-20T12:10:58.667 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T12:10:58.669 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:58.669 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'nvme0n1', 'value': {'virtual': 1, 'links': {'ids': ['lvm-pv-uuid-9VUZHE-MkIL-tEZu-Hlff-HsyY-81uK-OQLWCZ', 'nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN', 'nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001'], 'uuids': [], 'labels': [], 'masters': ['dm-0', 'dm-1', 'dm-2', 'dm-3', 'dm-4']}, 'vendor': None, 'model': 'INTEL SSDPEDMD400G4', 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': 'none', 'sectors': '781422768', 'sectorsize': '512', 'size': '372.61 GB', 'host': 'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', 'holders': ['vg_nvme-lv_2', 'vg_nvme-lv_5', 'vg_nvme-lv_3', 'vg_nvme-lv_1', 'vg_nvme-lv_4']}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.036750", "end": "2020-11-20 12:10:58.611839", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_2", "vg_nvme-lv_5", "vg_nvme-lv_3", "vg_nvme-lv_1", "vg_nvme-lv_4"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-9VUZHE-MkIL-tEZu-Hlff-HsyY-81uK-OQLWCZ", "nvme-INTEL_SSDPEDMD400G4_CVFT53430091400BGN", "nvme-nvme.8086-43564654353334333030393134303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", " 2020-11-20T12:10:58.671 INFO:teuthology.task.ansible.out:vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:58.575089", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0340169 s, 3.4 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0340169 s, 3.4 GB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:58.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.054) 0:02:40.781 ******* 2020-11-20T12:10:58.722 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T12:10:58.723 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.766 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.051) 0:02:40.833 ******* 2020-11-20T12:10:58.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-11-20T12:10:58.775 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.058) 0:02:40.892 ******* 2020-11-20T12:10:58.853 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T12:10:58.855 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:10:58.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:58 +0000 (0:00:00.063) 0:02:40.955 ******* 2020-11-20T12:10:58.996 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:58.998 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-4', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_5', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedndbn3ydo7rTPNDl4hz67CTFGIh2FCW03'], 'uuids': ['80ccade1-baa6-41e1-8b0d-3476fc2e5c23'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '31252480', 'sectorsize': '512', 'size': '14.90 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.141618", "end": "2020-11-20 12:10:58.947628", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedndbn3ydo7rTPNDl4hz67CTFGIh2FCW03"], "labels": [], "masters": [], "uuids": ["80ccade1-baa6-41e1-8b0d-3476fc2e5c23"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:58.806010", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.1388 s, 831 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.1388 s, 831 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:59.084 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T12:10:59.086 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T12:10:59.120 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:59 +0000 (0:00:00.231) 0:02:41.187 ******* 2020-11-20T12:10:59.215 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T12:10:59.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:59 +0000 (0:00:00.131) 0:02:41.319 ******* 2020-11-20T12:10:59.302 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:59.304 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-2', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_3', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedzHGxu4iO68ndpmWFmsM89LTKo7cxbhc8'], 'uuids': ['e25e1908-fc9e-4e8e-a07d-b30da3515d94'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.137912", "end": "2020-11-20 12:10:59.270440", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedzHGxu4iO68ndpmWFmsM89LTKo7cxbhc8"], "labels": [], "masters": [], "uuids": ["e25e1908-fc9e-4e8e-a07d-b30da3515d94"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:59.132528", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135236 s, 853 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135236 s, 853 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:59.569 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T12:10:59.571 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T12:10:59.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:59 +0000 (0:00:00.353) 0:02:41.672 ******* 2020-11-20T12:10:59.624 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-0', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_1', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswed9b1nJyW7g1zZEEuCOrnKNce41exuJMJ9'], 'uuids': ['2684e529-96f5-410f-a228-5b3bb852750d'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.139778", "end": "2020-11-20 12:10:59.588783", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswed9b1nJyW7g1zZEEuCOrnKNce41exuJMJ9"], "labels": [], "masters": [], "uuids": ["2684e529-96f5-410f-a228-5b3bb852750d"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:59.449005", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.137063 s, 842 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.137063 s, 842 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:59.635 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'sda', 'value': {'virtual': 1, 'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4W2RJ', 'scsi-35000c50087b90a26', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ', 'wwn-0x5000c50087b90a26'], 'uuids': [], 'labels': [], 'masters': []}, 'vendor': 'ATA', 'model': 'ST1000NM0033-9ZM', 'sas_address': None, 'sas_device_handle': None, 'serial': 'Z1W4W2RJ', 'removable': '0', 'support_discard': '0', 'wwn': '0x5000c50087b90a26', 'partitions': {'sda1': {'links': {'ids': ['ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1', 'scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1', 'scsi-1ATA_ST1000NM0033-9ZM173_Z1W4W2RJ-part1', 'scsi-35000c50087b90a26-part1', 'scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1', 'wwn-0x5000c50087b90a26-part1'], 'uuids': ['782d0384-b480-44b3-9c95-fe95daf886ae'], 'labels': [], 'masters': []}, 'start': '2048', 'sectors': '1953522688', 'sectorsize': 512, 'size': '931.51 GB', 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae', 'holders': []}}, 'rotational': '1', 'scheduler_mode': 'mq-deadline', 'sectors': '1953525168', 'sectorsize': '512', 'size': '931.51 GB', 'host': 'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', 'holders': []}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ", "scsi-1ATA_ST1000NM0033-9ZM173_Z1W4W2RJ", "scsi-35000c50087b90a26", "scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ", "wwn-0x5000c50087b90a26"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4W2RJ-part1", "scsi-0ATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1", "scsi-1ATA_ST1000NM0033-9ZM173_ 2020-11-20T12:10:59.637 INFO:teuthology.task.ansible.out:Z1W4W2RJ-part1", "scsi-35000c50087b90a26-part1", "scsi-SATA_ST1000NM0033-9ZM_Z1W4W2RJ-part1", "wwn-0x5000c50087b90a26-part1"], "labels": [], "masters": [], "uuids": ["782d0384-b480-44b3-9c95-fe95daf886ae"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4W2RJ", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50087b90a26"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:10:59.948 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-11-20T12:10:59.950 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'dm-3', 'value': {'virtual': 1, 'links': {'ids': ['dm-name-vg_nvme-lv_4', 'dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedJLb2bnMALjXs4h0AY2i0twiy3auEwqcD'], 'uuids': ['50649420-608f-4dfe-9207-62ddc57b0a81'], 'labels': [], 'masters': []}, 'vendor': None, 'model': None, 'sas_address': None, 'sas_device_handle': None, 'removable': '0', 'support_discard': '512', 'partitions': {}, 'rotational': '0', 'scheduler_mode': '', 'sectors': '187490304', 'sectorsize': '512', 'size': '89.40 GB', 'host': '', 'holders': []}}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.139270", "end": "2020-11-20 12:10:59.919140", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-0I5Oo1iJmn9MNLDDWdrQDq3RMpWIswedJLb2bnMALjXs4h0AY2i0twiy3auEwqcD"], "labels": [], "masters": [], "uuids": ["50649420-608f-4dfe-9207-62ddc57b0a81"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-11-20 12:10:59.779870", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136605 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136605 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-11-20T12:10:59.994 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:10:59 +0000 (0:00:00.389) 0:02:42.062 ******* 2020-11-20T12:11:00.002 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:11:00.005 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:00.238 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-11-20T12:11:00.240 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.053862", "end": "2020-11-20 12:11:00.206697", "rc": 0, "start": "2020-11-20 12:11:00.152835", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:00.272 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.277) 0:02:42.339 ******* 2020-11-20T12:11:00.300 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:11:00.302 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:00.504 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-11-20T12:11:00.506 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.049297", "end": "2020-11-20 12:11:00.479833", "rc": 0, "start": "2020-11-20 12:11:00.430536", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:00.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.267) 0:02:42.607 ******* 2020-11-20T12:11:00.567 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-11-20T12:11:00.605 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.065) 0:02:42.672 ******* 2020-11-20T12:11:00.622 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:00.633 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.669 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.064) 0:02:42.736 ******* 2020-11-20T12:11:00.697 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-11-20T12:11:00.699 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.731 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.060) 0:02:42.797 ******* 2020-11-20T12:11:00.747 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T12:11:00.749 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T12:11:00.781 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.050) 0:02:42.847 ******* 2020-11-20T12:11:00.787 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T12:11:00.789 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.827 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.046) 0:02:42.894 ******* 2020-11-20T12:11:00.834 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T12:11:00.835 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.869 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.041) 0:02:42.936 ******* 2020-11-20T12:11:00.877 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:00.910 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.041) 0:02:42.977 ******* 2020-11-20T12:11:00.918 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T12:11:00.920 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T12:11:00.962 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:00 +0000 (0:00:00.051) 0:02:43.029 ******* 2020-11-20T12:11:01.594 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} Friday 20 November 2020 12:11:01 +0000 (0:00:00.062) 0:02:43.091 ******* TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ ok: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} Friday 20 November 2020 12:11:01 +0000 (0:00:00.120) 0:02:43.212 ******* TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi093.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} Friday 20 November 2020 12:11:01 +0000 (0:00:00.073) 0:02:43.286 ******* TASK [testnode : Set root disk] ************************************************ skipping: [smithi066.front.sepia.ceph.com] => (item={'mount': '/', 'device': '/dev/sda1', 'fstype': 'ext4', 'options': 'rw,seclabel,relatime', 'size_total': 983429562368, 'size_available': 930442567680, 'block_size': 4096, 'block_total': 240095108, 'block_available': 227158830, 'block_used': 12936278, 'inode_total': 61054976, 'inode_available': 60986977, 'inode_used': 67999, 'uuid': '782d0384-b480-44b3-9c95-fe95daf886ae'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227158830, "block_size": 4096, "block_total": 240095108, "block_used": 12936278, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60986977, "inode_total": 61054976, "inode_used": 67999, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930442567680, "size_total": 983429562368, "uuid": "782d0384-b480-44b3-9c95-fe95daf886ae"}, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:01 +0000 (0:00:00.043) 0:02:43.330 ******* TASK [tes 2020-11-20T12:11:01.596 INFO:teuthology.task.ansible.out:tnode : Erase /scratch_devs so we know it's accurate] ***************** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:01 +0000 (0:00:00.043) 0:02:43.373 ******* Friday 20 November 2020 12:11:01 +0000 (0:00:00.031) 0:02:43.404 ******* TASK [testnode : Combine list of non-root disks] ******************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi093.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} Friday 20 November 2020 12:11:01 +0000 (0:00:00.042) 0:02:43.446 ******* Friday 20 November 2020 12:11:01 +0000 (0:00:00.031) 0:02:43.478 ******* TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:01 +0000 (0:00:00.050) 0:02:43.528 ******* TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:01 +0000 (0:00:00.041) 0:02:43.569 ******* TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:01 +0000 (0:00:00.043) 0:02:43.612 ******* TASK [testnode : Write /scratch_devs] ****************************** 2020-11-20T12:11:01.597 INFO:teuthology.task.ansible.out:************ changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} TASK [testnode : Create volume_groups dict] ************************************ skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:01.609 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:01 +0000 (0:00:00.063) 0:02:43.676 ******* 2020-11-20T12:11:01.637 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-11-20T12:11:01.638 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:01.670 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:01 +0000 (0:00:00.060) 0:02:43.737 ******* 2020-11-20T12:11:01.687 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T12:11:01.689 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T12:11:01.725 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:01 +0000 (0:00:00.054) 0:02:43.792 ******* 2020-11-20T12:11:01.731 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-11-20T12:11:01.733 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:11:01.770 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:01 +0000 (0:00:00.042) 0:02:43.835 ******* 2020-11-20T12:11:01.876 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:11:01.922 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi093.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T12:11:01.956 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:01 +0000 (0:00:00.187) 0:02:44.023 ******* 2020-11-20T12:11:01.984 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.019 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.062) 0:02:44.085 ******* 2020-11-20T12:11:02.056 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi093.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.059 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.068 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.076 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.108 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.084) 0:02:44.170 ******* 2020-11-20T12:11:02.110 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T12:11:02.110 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:11:02.112 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.150 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.047) 0:02:44.217 ******* 2020-11-20T12:11:02.157 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-11-20T12:11:02.158 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi093.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.170 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.171 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.181 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.067) 0:02:44.285 ******* 2020-11-20T12:11:02.246 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.283 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.064) 0:02:44.349 ******* 2020-11-20T12:11:02.289 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'vg_nvme', 'value': {'pvs': '/dev/nvme0n1'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-11-20T12:11:02.324 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.041) 0:02:44.390 ******* 2020-11-20T12:11:02.332 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.368 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.045) 0:02:44.435 ******* 2020-11-20T12:11:02.374 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T12:11:02.378 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:11:02.413 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.044) 0:02:44.480 ******* 2020-11-20T12:11:02.420 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T12:11:02.421 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.463 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.049) 0:02:44.530 ******* 2020-11-20T12:11:02.474 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.514 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.051) 0:02:44.581 ******* 2020-11-20T12:11:02.524 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.563 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.048) 0:02:44.630 ******* 2020-11-20T12:11:02.593 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.628 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.065) 0:02:44.695 ******* 2020-11-20T12:11:02.656 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T12:11:02.658 INFO:teuthology.task.ansible.out:skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.692 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.064) 0:02:44.759 ******* 2020-11-20T12:11:02.698 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:11:02.701 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:02.721 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.761 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.068) 0:02:44.828 ******* 2020-11-20T12:11:02.791 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi093.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:02.831 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.068) 0:02:44.897 ******* 2020-11-20T12:11:02.841 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* changed: [smithi132.front.sepia.ceph.com] => {"changed": true} 2020-11-20T12:11:02.887 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:02 +0000 (0:00:00.057) 0:02:44.954 ******* 2020-11-20T12:11:03.063 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:11:03.069 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:03.092 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T12:11:03.094 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005065", "end": "2020-11-20 12:11:03.045911", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 12:11:03.040846", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:03.249 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T12:11:03.281 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.394) 0:02:45.348 ******* 2020-11-20T12:11:03.308 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.364 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.081) 0:02:45.430 ******* 2020-11-20T12:11:03.377 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi093.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003024", "end": "2020-11-20 12:11:03.258957", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 12:11:03.255933", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:03.398 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.448 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.085) 0:02:45.515 ******* 2020-11-20T12:11:03.456 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-11-20T12:11:03.459 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:03.479 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.523 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.074) 0:02:45.590 ******* 2020-11-20T12:11:03.537 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi093.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002802", "end": "2020-11-20 12:11:03.468573", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:11:03.465771", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:03.559 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.593 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.070) 0:02:45.660 ******* 2020-11-20T12:11:03.621 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.654 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.061) 0:02:45.722 ******* 2020-11-20T12:11:03.681 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T12:11:03.683 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.722 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.064) 0:02:45.786 ******* 2020-11-20T12:11:03.729 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T12:11:03.732 INFO:teuthology.task.ansible.out:ok: [smithi093.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.022773", "end": "2020-11-20 12:11:03.666991", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 12:11:03.644218", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:03.768 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.048) 0:02:45.835 ******* 2020-11-20T12:11:03.775 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:03.810 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.042) 0:02:45.877 ******* 2020-11-20T12:11:03.817 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T12:11:03.865 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.054) 0:02:45.932 ******* 2020-11-20T12:11:03.871 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-11-20T12:11:03.873 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.912 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.047) 0:02:45.979 ******* 2020-11-20T12:11:03.941 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:03.976 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:03 +0000 (0:00:00.063) 0:02:46.043 ******* 2020-11-20T12:11:04.017 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:04.067 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.090) 0:02:46.134 ******* 2020-11-20T12:11:04.078 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T12:11:04.081 INFO:teuthology.task.ansible.out:changed: [smithi093.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:11:04.128 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:04.130 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-11-20T12:11:04.164 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.096) 0:02:46.230 ******* 2020-11-20T12:11:04.218 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.054) 0:02:46.285 ******* 2020-11-20T12:11:04.357 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-11-20T12:11:04.360 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-11-20T12:11:04.404 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.185) 0:02:46.470 ******* 2020-11-20T12:11:04.624 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_1', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:11:04.691 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T12:11:04.728 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:04 +0000 (0:00:00.324) 0:02:46.795 ******* 2020-11-20T12:11:04.802 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_2', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:11:04.974 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_3', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-11-20T12:11:05.009 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T12:11:05.010 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:07:18 UTC", "ActiveEnterTimestampMonotonic": "15558380", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "ntpd.service tmp.mount systemd-journald.socket systemd-tmpfiles-setup.service sysinit.target ntpdate.service -.mount sntp.service basic.target system.slice", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:07:17 UTC", "AssertTimestampMonotonic": "14471109", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:07:17 UTC", "ConditionTimestampMonotonic": "14471074", "ConfigurationDirectoryMode": "0755", "Conflicts": "ntpd.service systemd-timesyncd.service shutdown.target", "ControlGro 2020-11-20T12:11:05.012 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "903", "ExecMainStartTimestamp": "Fri 2020-11-20 12:07:18 UTC", "ExecMainStartTimestampMonotonic": "15515538", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:17 UTC] ; stop_time=[Fri 2020-11-20 12:07:18 UTC] ; pid=860 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:18 UTC] ; stop_time=[Fri 2020-11-20 12:07:18 UTC] ; pid=962 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:07:17 UTC", "InactiveExitTimestampMonotonic": "14549340", "InvocationID": "044ee39be0094020adf3c461d60afbd8", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T12:11:05.013 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127238", "LimitNPROCSoft": "127238", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127238", "LimitSIGPENDINGSoft": "127238", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "903", "MemoryAccounting": "yes", "MemoryCurrent": "3190784", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T12:11:05.018 INFO:teuthology.task.ansible.out:equires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:07:18 UTC", "StateChangeTimestampMonotonic": "15558380", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:07:18 UTC", "WatchdogTimestampMonotonic": "15515548", "WatchdogUSec": "0"}} 2020-11-20T12:11:05.045 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.317) 0:02:47.112 ******* 2020-11-20T12:11:05.073 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T12:11:05.109 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.062) 0:02:47.175 ******* 2020-11-20T12:11:05.145 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T12:11:05.181 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.073) 0:02:47.248 ******* 2020-11-20T12:11:05.187 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-11-20T12:11:05.189 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_4', 'value': {'vg': 'vg_nvme', 'size': '89.4G', 'scratch_dev': True}}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} skipping: [smithi066.front.sepia.ceph.com] => (item={'key': 'lv_5', 'value': {'vg': 'vg_nvme', 'size': '14.9G'}}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.226 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.045) 0:02:47.293 ******* 2020-11-20T12:11:05.233 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-11-20T12:11:05.235 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.270 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.043) 0:02:47.337 ******* 2020-11-20T12:11:05.298 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.332 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.061) 0:02:47.399 ******* 2020-11-20T12:11:05.358 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T12:11:05.360 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.393 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.061) 0:02:47.461 ******* 2020-11-20T12:11:05.435 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-11-20T12:11:05.437 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-11-20T12:11:05.472 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.078) 0:02:47.539 ******* 2020-11-20T12:11:05.502 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:05.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.067) 0:02:47.606 ******* 2020-11-20T12:11:05.588 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-11-20T12:11:05.590 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T12:11:05.628 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:05 +0000 (0:00:00.088) 0:02:47.694 ******* 2020-11-20T12:11:06.067 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-11-20T12:11:06.100 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:06 +0000 (0:00:00.472) 0:02:48.167 ******* 2020-11-20T12:11:06.822 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-11-20T12:11:06.824 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true} 2020-11-20T12:11:06.857 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:06 +0000 (0:00:00.756) 0:02:48.924 ******* 2020-11-20T12:11:07.097 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T12:11:07.099 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T12:11:07.133 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.275) 0:02:49.199 ******* 2020-11-20T12:11:07.159 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-11-20T12:11:07.161 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.194 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.061) 0:02:49.261 ******* 2020-11-20T12:11:07.200 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-11-20T12:11:07.202 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-11-20T12:11:07.235 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.041) 0:02:49.303 ******* 2020-11-20T12:11:07.242 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T12:11:07.244 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T12:11:07.277 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.041) 0:02:49.344 ******* 2020-11-20T12:11:07.282 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-11-20T12:11:07.284 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.317 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.040) 0:02:49.384 ******* 2020-11-20T12:11:07.344 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-11-20T12:11:07.346 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.379 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.061) 0:02:49.446 ******* 2020-11-20T12:11:07.421 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.459 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.078) 0:02:49.525 ******* 2020-11-20T12:11:07.464 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-11-20T12:11:07.467 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T12:11:07.503 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.044) 0:02:49.569 ******* 2020-11-20T12:11:07.521 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.557 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.054) 0:02:49.624 ******* 2020-11-20T12:11:07.563 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T12:11:07.566 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.609 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.052) 0:02:49.676 ******* 2020-11-20T12:11:07.619 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.656 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.047) 0:02:49.723 ******* 2020-11-20T12:11:07.663 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi132.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T12:11:07.698 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.042) 0:02:49.765 ******* 2020-11-20T12:11:07.705 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-11-20T12:11:07.707 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.740 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.041) 0:02:49.807 ******* 2020-11-20T12:11:07.747 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T12:11:07.749 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.782 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.041) 0:02:49.849 ******* 2020-11-20T12:11:07.788 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-11-20T12:11:07.790 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.823 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.041) 0:02:49.890 ******* 2020-11-20T12:11:07.854 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.065) 0:02:49.956 ******* 2020-11-20T12:11:07.917 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-11-20T12:11:07.919 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:07.951 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:07 +0000 (0:00:00.061) 0:02:50.018 ******* 2020-11-20T12:11:07.968 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T12:11:07.970 INFO:teuthology.task.ansible.out:changed: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T12:11:08.003 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.052) 0:02:50.071 ******* 2020-11-20T12:11:08.011 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.049 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.044) 0:02:50.116 ******* 2020-11-20T12:11:08.077 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-11-20T12:11:08.079 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.112 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.063) 0:02:50.179 ******* 2020-11-20T12:11:08.185 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi132.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T12:11:08.220 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.107) 0:02:50.287 ******* 2020-11-20T12:11:08.258 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.292 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.072) 0:02:50.359 ******* 2020-11-20T12:11:08.329 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-11-20T12:11:08.331 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.340 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.342 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.352 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.387 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.094) 0:02:50.454 ******* 2020-11-20T12:11:08.496 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.501 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi132.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.540 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.153) 0:02:50.607 ******* 2020-11-20T12:11:08.568 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.607 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.064) 0:02:50.672 ******* 2020-11-20T12:11:08.633 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.668 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.063) 0:02:50.735 ******* 2020-11-20T12:11:08.681 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-11-20T12:11:08.714 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.044) 0:02:50.780 ******* 2020-11-20T12:11:08.720 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.759 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.045) 0:02:50.826 ******* 2020-11-20T12:11:08.799 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.834 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.075) 0:02:50.901 ******* 2020-11-20T12:11:08.862 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.898 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.063) 0:02:50.965 ******* 2020-11-20T12:11:08.925 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T12:11:08.927 INFO:teuthology.task.ansible.out:skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:08.965 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:08 +0000 (0:00:00.067) 0:02:51.032 ******* 2020-11-20T12:11:08.994 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:09.040 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.074) 0:02:51.106 ******* 2020-11-20T12:11:09.067 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2020-11-20T12:11:09.069 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Fri 2020-11-20 12:07:24 UTC", "ActiveEnterTimestampMonotonic": "15557241", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket sysinit.target sntp.service system.slice tmp.mount -.mount ntpdate.service basic.target systemd-tmpfiles-setup.service ntpd.service", "AllowIsolate": "no", "AllowedCPUs": "", "AllowedMemoryNodes": "", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Fri 2020-11-20 12:07:22 UTC", "AssertTimestampMonotonic": "14467778", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUAffinity": "", "CPUQuotaPerSecUSec": "infinity", "CPUQuotaPeriodUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanFreeze": "yes", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Fri 2020-11-20 12:07:22 UTC", "ConditionTimestampMonotonic": "14467744", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target ntpd.service systemd-timesyncd.service", "ControlGro 2020-11-20T12:11:09.072 INFO:teuthology.task.ansible.out:up": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "DefaultMemoryLow": "0", "DefaultMemoryMin": "0", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EffectiveCPUs": "", "EffectiveMemoryNodes": "", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "889", "ExecMainStartTimestamp": "Fri 2020-11-20 12:07:23 UTC", "ExecMainStartTimestampMonotonic": "15459470", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:22 UTC] ; stop_time=[Fri 2020-11-20 12:07:23 UTC] ; pid=878 ; code=exited ; status=0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[Fri 2020-11-20 12:07:23 UTC] ; stop_time=[Fri 2020-11-20 12:07:24 UTC] ; pid=958 ; code=exited ; status=0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "FreezerState": "running", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Fri 2020-11-20 12:07:22 UTC", "InactiveExitTimestampMonotonic": "14520282", "InvocationID": "ed09a1a1837141cca4e96f54c7b4ab5c", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "Limit 2020-11-20T12:11:09.074 INFO:teuthology.task.ansible.out:AS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "65536", "LimitMEMLOCKSoft": "65536", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "262144", "LimitNOFILESoft": "1024", "LimitNPROC": "127238", "LimitNPROCSoft": "127238", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127238", "LimitSIGPENDINGSoft": "127238", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogRateLimitBurst": "0", "LogRateLimitIntervalUSec": "0", "LogsDirectoryMode": "0755", "MainPID": "889", "MemoryAccounting": "yes", "MemoryCurrent": "3125248", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemoryMin": "0", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "NUMAMask": "", "NUMAPolicy": "n/a", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "R 2020-11-20T12:11:09.076 INFO:teuthology.task.ansible.out:equires": "sysinit.target -.mount system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "RestrictSUIDSGID": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Fri 2020-11-20 12:07:24 UTC", "StateChangeTimestampMonotonic": "15557241", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "203580", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Fri 2020-11-20 12:07:23 UTC", "WatchdogTimestampMonotonic": "15459486", "WatchdogUSec": "0"}} TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi132.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:09.103 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.063) 0:02:51.170 ******* 2020-11-20T12:11:09.135 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.031) 0:02:51.202 ******* 2020-11-20T12:11:09.141 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-11-20T12:11:09.144 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"pip_executable": "pip", "pip_version": "python-pip"}, "changed": false} 2020-11-20T12:11:09.179 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.043) 0:02:51.245 ******* 2020-11-20T12:11:09.218 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"ansible_python_interpreter": "/usr/bin/python3", "pip_executable": "pip3", "pip_version": "python3-pip"}, "changed": false} 2020-11-20T12:11:09.251 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.072) 0:02:51.318 ******* 2020-11-20T12:11:09.290 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:09.324 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.072) 0:02:51.391 ******* 2020-11-20T12:11:09.362 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:09.402 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.078) 0:02:51.469 ******* 2020-11-20T12:11:09.409 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-11-20T12:11:09.411 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005079", "end": "2020-11-20 12:11:09.336798", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 12:11:09.331719", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:09.433 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-11-20T12:11:09.435 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:09.466 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.064) 0:02:51.533 ******* 2020-11-20T12:11:09.561 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi132.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003015", "end": "2020-11-20 12:11:09.517645", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 12:11:09.514630", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:09.667 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-11-20T12:11:09.706 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.239) 0:02:51.773 ******* 2020-11-20T12:11:09.729 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi132.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002821", "end": "2020-11-20 12:11:09.694654", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:11:09.691833", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:09.915 INFO:teuthology.task.ansible.out:ok: [smithi132.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.019731", "end": "2020-11-20 12:11:09.889859", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 12:11:09.870128", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:09.964 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:09 +0000 (0:00:00.258) 0:02:52.031 ******* 2020-11-20T12:11:09.993 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T12:11:10.027 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:10 +0000 (0:00:00.063) 0:02:52.095 ******* 2020-11-20T12:11:10.206 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-11-20T12:11:10.208 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1236, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} TASK [testnode : Touch /ceph-qa-ready] ***************************************** changed: [smithi132.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:11:10.241 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:10 +0000 (0:00:00.213) 0:02:52.308 ******* 2020-11-20T12:11:11.291 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-11-20T12:11:11.293 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-11-20T12:11:11.328 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:11 +0000 (0:00:01.086) 0:02:53.395 ******* 2020-11-20T12:11:11.355 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:11.390 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:11 +0000 (0:00:00.062) 0:02:53.457 ******* 2020-11-20T12:11:11.417 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-11-20T12:11:11.419 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-11-20T12:11:11.454 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:11 +0000 (0:00:00.063) 0:02:53.521 ******* 2020-11-20T12:11:11.639 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** ok: [smithi066.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-11-20T12:11:11.676 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:11 +0000 (0:00:00.221) 0:02:53.743 ******* 2020-11-20T12:11:11.702 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-11-20T12:11:11.704 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:11.736 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:11 +0000 (0:00:00.060) 0:02:53.803 ******* 2020-11-20T12:11:11.763 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-11-20T12:11:11.765 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-11-20T12:11:11.797 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:11 +0000 (0:00:00.061) 0:02:53.865 ******* 2020-11-20T12:11:11.824 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-11-20T12:11:11.826 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:11.858 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:11 +0000 (0:00:00.059) 0:02:53.925 ******* 2020-11-20T12:11:12.041 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-11-20T12:11:12.043 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-11-20T12:11:12.075 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:12 +0000 (0:00:00.218) 0:02:54.143 ******* 2020-11-20T12:11:12.267 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* changed: [smithi066.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-11-20T12:11:12.666 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:12 +0000 (0:00:00.238) 0:02:54.382 ******* TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:12 +0000 (0:00:00.081) 0:02:54.464 ******* TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi066.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:12 +0000 (0:00:00.087) 0:02:54.551 ******* TASK [testnode : Define net_to_configure var] ********************************** skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'lo', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason' 2020-11-20T12:11:12.668 INFO:teuthology.task.ansible.out:: 'Conditional result was False', 'item': 'enp3s0f1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'enp3s0f0', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno2', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi066.front.sepia.ceph.com] => (item={'changed': False, 'skipped': True, 'skip_reason': 'Conditional result was False', 'item': 'eno1', 'ansible_loop_var': 'item'}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:12 +0000 (0:00:00.096) 0:02:54.648 ******* TASK [testnode : set_fact] ***************************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Friday 20 November 2020 12:11:12 +0000 (0:00:00.062) 0:02:54.710 ******* 2020-11-20T12:11:12.670 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:12.703 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:12 +0000 (0:00:00.060) 0:02:54.770 ******* 2020-11-20T12:11:12.730 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-11-20T12:11:12.731 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:12.765 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:12 +0000 (0:00:00.061) 0:02:54.832 ******* 2020-11-20T12:11:12.791 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-11-20T12:11:12.793 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:12.825 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:12 +0000 (0:00:00.059) 0:02:54.892 ******* 2020-11-20T12:11:12.851 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:12.889 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:12 +0000 (0:00:00.064) 0:02:54.957 ******* 2020-11-20T12:11:12.916 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-11-20T12:11:12.919 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:12.953 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:12 +0000 (0:00:00.063) 0:02:55.020 ******* 2020-11-20T12:11:12.980 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-11-20T12:11:12.982 INFO:teuthology.task.ansible.out:skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:13.015 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:13 +0000 (0:00:00.062) 0:02:55.082 ******* 2020-11-20T12:11:13.044 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi066.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-11-20T12:11:13.080 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:13 +0000 (0:00:00.062) 0:02:55.145 ******* 2020-11-20T12:11:13.378 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi066.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005429", "end": "2020-11-20 12:11:13.326727", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-11-20 12:11:13.321298", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:13.582 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.003037", "end": "2020-11-20 12:11:13.542340", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-11-20 12:11:13.539303", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:13.786 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002951", "end": "2020-11-20 12:11:13.752133", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-11-20 12:11:13.749182", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:13.976 INFO:teuthology.task.ansible.out:ok: [smithi066.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.021217", "end": "2020-11-20 12:11:13.943368", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-11-20 12:11:13.922151", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-11-20T12:11:14.030 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:14 +0000 (0:00:00.951) 0:02:56.097 ******* 2020-11-20T12:11:14.056 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-11-20T12:11:14.089 INFO:teuthology.task.ansible.out:Friday 20 November 2020 12:11:14 +0000 (0:00:00.059) 0:02:56.156 ******* 2020-11-20T12:11:14.276 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-11-20T12:11:14.278 INFO:teuthology.task.ansible.out:changed: [smithi066.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-11-20T12:11:14.370 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-11-20T12:11:14.374 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** 2020-11-20T12:11:14.375 INFO:teuthology.task.ansible.out:skipping: no hosts matched 2020-11-20T12:11:14.378 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** 2020-11-20T12:11:14.379 INFO:teuthology.task.ansible.out:skipping: no hosts matched PLAY RECAP ********************************************************************* smithi066.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi093.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 smithi132.front.sepia.ceph.com : ok=125 changed=35 unreachable=0 failed=0 skipped=171 rescued=0 ignored=4 Friday 20 November 2020 12:11:14 +0000 (0:00:00.288) 0:02:56.445 ******* =============================================================================== common : Register with subscription-manager. --------------------------- 10.78s common : nrpe - Remove SELinux policy package --------------------------- 9.63s common : nrpe - Load SELinux policy package ----------------------------- 8.82s testnode : Ensure ceph packages are not present. ------------------------ 3.70s testnode : Ensure ceph dependency packages are not present. ------------- 3.60s common : nrpe - Install SELinux dependencies ---------------------------- 2.12s common : nrpe - Ensure SELinux policy is up to date --------------------- 2.03s common : Make sure smartmontools is installed --------------------------- 2.00s Gathering Facts --------------------------------------------------------- 1.67s common : Install nrpe package and dependencies (RHEL/CentOS) ------------ 1.38s common : Install Kerberos Packages (RedHat) ----------------------------- 1.24s common : Disable all rhsm repos ----------------------------------------- 1.10s testnode : Install packages via pip ------------------------------------- 1.09s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.95s ansible-managed : Add authorized keys for the ansible user. ------------- 0.77s common : Install CA Cert from Satellite Server -------------------------- 0.76s ansible-managed : Create the cephlab_sudo sudoers.d file. 2020-11-20T12:11:14.381 INFO:teuthology.task.ansible.out: --------------- 0.74s common : Set the hardware clock ----------------------------------------- 0.73s common : List CDN releases available to system -------------------------- 0.71s common : Get list of enabled RHSM repos --------------------------------- 0.70s 2020-11-20T12:11:14.717 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi093.front.sepia.ceph.com'), Remote(name='ubuntu@smithi066.front.sepia.ceph.com'), Remote(name='ubuntu@smithi132.front.sepia.ceph.com')] 2020-11-20T12:11:14.718 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:11:14.719 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi093.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:11:14.851 INFO:teuthology.orchestra.run.smithi093:> true 2020-11-20T12:11:14.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:11:14.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi066.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:11:15.037 INFO:teuthology.orchestra.run.smithi066:> true 2020-11-20T12:11:15.142 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-11-20T12:11:15.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2020-11-20T12:11:15.230 INFO:teuthology.orchestra.run.smithi132:> true 2020-11-20T12:11:15.330 INFO:teuthology.run_tasks:Running task clock... 2020-11-20T12:11:15.349 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-11-20T12:11:15.350 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T12:11:15.350 INFO:teuthology.orchestra.run.smithi093:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T12:11:15.393 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T12:11:15.408 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T12:11:15.444 INFO:teuthology.orchestra.run.smithi093.stderr:sudo: ntpd: command not found 2020-11-20T12:11:15.455 INFO:teuthology.orchestra.run.smithi093.stdout:506 Cannot talk to daemon 2020-11-20T12:11:15.469 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T12:11:15.484 INFO:teuthology.orchestra.run.smithi093.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T12:11:15.541 INFO:teuthology.orchestra.run.smithi093.stderr:bash: ntpq: command not found 2020-11-20T12:11:15.545 INFO:teuthology.orchestra.run.smithi093.stdout:210 Number of sources = 4 2020-11-20T12:11:15.545 INFO:teuthology.orchestra.run.smithi093.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T12:11:15.546 INFO:teuthology.orchestra.run.smithi093.stdout:=============================================================================== 2020-11-20T12:11:15.546 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.546 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.547 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.547 INFO:teuthology.orchestra.run.smithi093.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.548 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T12:11:15.549 INFO:teuthology.orchestra.run.smithi066:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T12:11:15.591 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T12:11:15.607 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T12:11:15.642 INFO:teuthology.orchestra.run.smithi066.stderr:sudo: ntpd: command not found 2020-11-20T12:11:15.654 INFO:teuthology.orchestra.run.smithi066.stdout:506 Cannot talk to daemon 2020-11-20T12:11:15.670 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T12:11:15.684 INFO:teuthology.orchestra.run.smithi066.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T12:11:15.752 INFO:teuthology.orchestra.run.smithi066.stderr:bash: ntpq: command not found 2020-11-20T12:11:15.754 INFO:teuthology.orchestra.run.smithi066.stdout:210 Number of sources = 4 2020-11-20T12:11:15.755 INFO:teuthology.orchestra.run.smithi066.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T12:11:15.755 INFO:teuthology.orchestra.run.smithi066.stdout:=============================================================================== 2020-11-20T12:11:15.755 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.755 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.756 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.756 INFO:teuthology.orchestra.run.smithi066.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.757 INFO:teuthology.orchestra.run:Running command with timeout 360 2020-11-20T12:11:15.757 INFO:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-11-20T12:11:15.798 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-11-20T12:11:15.815 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-11-20T12:11:15.852 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2020-11-20T12:11:15.865 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2020-11-20T12:11:15.878 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-11-20T12:11:15.893 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-11-20T12:11:15.947 INFO:teuthology.orchestra.run.smithi132.stderr:bash: ntpq: command not found 2020-11-20T12:11:15.951 INFO:teuthology.orchestra.run.smithi132.stdout:210 Number of sources = 4 2020-11-20T12:11:15.951 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-11-20T12:11:15.952 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2020-11-20T12:11:15.952 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.952 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.952 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.952 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-11-20T12:11:15.954 INFO:teuthology.run_tasks:Running task install... 2020-11-20T12:11:15.965 DEBUG:teuthology.task.install:project ceph 2020-11-20T12:11:15.966 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}} 2020-11-20T12:11:15.966 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'} 2020-11-20T12:11:15.966 INFO:teuthology.task.install:Using flavor: basic 2020-11-20T12:11:15.974 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-11-20T12:11:15.975 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-11-20T12:11:15.975 INFO:teuthology.orchestra.run.smithi093:> sudo lsb_release -is 2020-11-20T12:11:16.017 INFO:teuthology.orchestra.run.smithi093.stdout:RedHatEnterprise 2020-11-20T12:11:16.018 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:11:16.018 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-11-20T12:11:16.019 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T12:11:16.020 INFO:teuthology.orchestra.run.smithi093:> sudo lsb_release -is 2020-11-20T12:11:16.058 INFO:teuthology.orchestra.run.smithi066.stdout:RedHatEnterprise 2020-11-20T12:11:16.059 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:11:16.059 INFO:teuthology.orchestra.run.smithi132:> sudo lsb_release -is 2020-11-20T12:11:16.060 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T12:11:16.060 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-11-20T12:11:16.094 INFO:teuthology.orchestra.run.smithi093.stdout:RedHatEnterprise 2020-11-20T12:11:16.095 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:11:16.097 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:11:16.103 INFO:teuthology.orchestra.run.smithi132.stdout:RedHatEnterprise 2020-11-20T12:11:16.104 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:11:16.105 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'flavor': 'basic', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tag': None, 'wait_for_package': False} 2020-11-20T12:11:16.105 INFO:teuthology.orchestra.run.smithi132:> sudo lsb_release -is 2020-11-20T12:11:16.136 INFO:teuthology.orchestra.run.smithi066.stdout:RedHatEnterprise 2020-11-20T12:11:16.138 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:11:16.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:11:16.176 INFO:teuthology.orchestra.run.smithi132.stdout:RedHatEnterprise 2020-11-20T12:11:16.177 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:11:16.178 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:11:16.269 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T12:11:16.270 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T12:11:16.306 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T12:11:16.307 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T12:11:16.341 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/ 2020-11-20T12:11:16.342 INFO:teuthology.task.install.rpm:Package version is 16.0.0-7397.gb86e691b 2020-11-20T12:11:16.403 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T12:11:16.404 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:11:16.404 INFO:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:16.417 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:16.427 INFO:teuthology.orchestra.run.smithi093.stderr:1+1 records in 2020-11-20T12:11:16.427 INFO:teuthology.orchestra.run.smithi093.stderr:1+1 records out 2020-11-20T12:11:16.428 INFO:teuthology.orchestra.run.smithi093.stderr:676 bytes copied, 3.5629e-05 s, 19.0 MB/s 2020-11-20T12:11:16.429 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T12:11:16.429 INFO:teuthology.orchestra.run.smithi093:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T12:11:16.432 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T12:11:16.433 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:11:16.433 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:16.448 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:16.459 INFO:teuthology.orchestra.run.smithi066.stderr:1+1 records in 2020-11-20T12:11:16.460 INFO:teuthology.orchestra.run.smithi066.stderr:1+1 records out 2020-11-20T12:11:16.460 INFO:teuthology.orchestra.run.smithi066.stderr:676 bytes copied, 4.3704e-05 s, 15.5 MB/s 2020-11-20T12:11:16.461 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T12:11:16.461 INFO:teuthology.orchestra.run.smithi066:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T12:11:16.467 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20201120.053228/b86e691bf191566922a8f08e2a5abf64fde8cfcb/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2020-11-20T12:11:16.467 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:11:16.468 INFO:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:16.481 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd of=/etc/yum.repos.d/ceph.repo 2020-11-20T12:11:16.491 INFO:teuthology.orchestra.run.smithi132.stderr:1+1 records in 2020-11-20T12:11:16.491 INFO:teuthology.orchestra.run.smithi132.stderr:1+1 records out 2020-11-20T12:11:16.491 INFO:teuthology.orchestra.run.smithi132.stderr:676 bytes copied, 3.7899e-05 s, 17.8 MB/s 2020-11-20T12:11:16.492 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2020-11-20T12:11:16.493 INFO:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/b86e691bf191566922a8f08e2a5abf64fde8cfcb/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-11-20T12:11:16.496 INFO:teuthology.orchestra.run.smithi093:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T12:11:16.528 INFO:teuthology.orchestra.run.smithi066:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T12:11:16.562 INFO:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-11-20T12:11:16.572 INFO:teuthology.orchestra.run.smithi093:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T12:11:16.605 INFO:teuthology.orchestra.run.smithi066:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T12:11:16.633 INFO:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-11-20T12:11:16.635 INFO:teuthology.orchestra.run.smithi093.stdout:check_obsoletes = 1 2020-11-20T12:11:16.637 INFO:teuthology.orchestra.run.smithi093:> sudo yum clean all 2020-11-20T12:11:16.671 INFO:teuthology.orchestra.run.smithi066.stdout:check_obsoletes = 1 2020-11-20T12:11:16.672 INFO:teuthology.orchestra.run.smithi066:> sudo yum clean all 2020-11-20T12:11:16.695 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2020-11-20T12:11:16.697 INFO:teuthology.orchestra.run.smithi132:> sudo yum clean all 2020-11-20T12:11:16.939 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2020-11-20T12:11:17.029 INFO:teuthology.orchestra.run.smithi066.stdout:Updating Subscription Management repositories. 2020-11-20T12:11:17.040 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2020-11-20T12:11:17.215 INFO:teuthology.orchestra.run.smithi093.stdout:38 files removed 2020-11-20T12:11:17.251 INFO:teuthology.orchestra.run.smithi093:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T12:11:17.362 INFO:teuthology.orchestra.run.smithi132.stdout:38 files removed 2020-11-20T12:11:17.375 INFO:teuthology.orchestra.run.smithi066.stdout:38 files removed 2020-11-20T12:11:17.399 INFO:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T12:11:17.414 INFO:teuthology.orchestra.run.smithi066:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2020-11-20T12:11:17.514 INFO:teuthology.orchestra.run.smithi093.stdout:Updating Subscription Management repositories. 2020-11-20T12:11:17.663 INFO:teuthology.orchestra.run.smithi132.stdout:Updating Subscription Management repositories. 2020-11-20T12:11:17.697 INFO:teuthology.orchestra.run.smithi066.stdout:Updating Subscription Management repositories. 2020-11-20T12:11:18.540 INFO:teuthology.orchestra.run.smithi093.stdout:ceph packages for x86_64 119 kB/s | 72 kB 00:00 2020-11-20T12:11:18.714 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 112 kB/s | 72 kB 00:00 2020-11-20T12:11:18.876 INFO:teuthology.orchestra.run.smithi066.stdout:ceph packages for x86_64 101 kB/s | 72 kB 00:00 2020-11-20T12:11:19.149 INFO:teuthology.orchestra.run.smithi093.stdout:ceph noarch packages 26 kB/s | 15 kB 00:00 2020-11-20T12:11:19.287 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 27 kB/s | 15 kB 00:00 2020-11-20T12:11:19.415 INFO:teuthology.orchestra.run.smithi066.stdout:ceph noarch packages 29 kB/s | 15 kB 00:00 2020-11-20T12:11:19.704 INFO:teuthology.orchestra.run.smithi093.stdout:ceph source packages 2.7 kB/s | 1.4 kB 00:00 2020-11-20T12:11:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 2.6 kB/s | 1.4 kB 00:00 2020-11-20T12:11:19.993 INFO:teuthology.orchestra.run.smithi066.stdout:ceph source packages 2.6 kB/s | 1.4 kB 00:00 2020-11-20T12:11:20.237 INFO:teuthology.orchestra.run.smithi093.stdout:Extra Packages for Enterprise Linux 16 MB/s | 8.3 MB 00:00 2020-11-20T12:11:20.305 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 19 MB/s | 8.3 MB 00:00 2020-11-20T12:11:20.443 INFO:teuthology.orchestra.run.smithi066.stdout:Extra Packages for Enterprise Linux 19 MB/s | 8.3 MB 00:00 2020-11-20T12:11:21.900 INFO:teuthology.orchestra.run.smithi093.stdout:lab-extras 5.4 MB/s | 23 kB 00:00 2020-11-20T12:11:21.980 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 4.5 MB/s | 23 kB 00:00 2020-11-20T12:11:22.170 INFO:teuthology.orchestra.run.smithi093.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 109 MB/s | 24 MB 00:00 2020-11-20T12:11:22.171 INFO:teuthology.orchestra.run.smithi066.stdout:lab-extras 4.6 MB/s | 23 kB 00:00 2020-11-20T12:11:22.249 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 115 MB/s | 25 MB 00:00 2020-11-20T12:11:22.496 INFO:teuthology.orchestra.run.smithi066.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 89 MB/s | 24 MB 00:00 2020-11-20T12:11:25.893 INFO:teuthology.orchestra.run.smithi093.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 117 MB/s | 25 MB 00:00 2020-11-20T12:11:25.935 INFO:teuthology.orchestra.run.smithi132.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 107 MB/s | 24 MB 00:00 2020-11-20T12:11:26.581 INFO:teuthology.orchestra.run.smithi066.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 94 MB/s | 25 MB 00:00 2020-11-20T12:11:31.486 INFO:teuthology.orchestra.run.smithi093.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:31.487 INFO:teuthology.orchestra.run.smithi093.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:31.493 INFO:teuthology.orchestra.run.smithi093.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T12:11:31.494 INFO:teuthology.orchestra.run.smithi093.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T12:11:31.494 INFO:teuthology.orchestra.run.smithi093.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T12:11:31.495 INFO:teuthology.orchestra.run.smithi093.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T12:11:31.496 INFO:teuthology.orchestra.run.smithi093.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T12:11:31.499 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T12:11:31.499 INFO:teuthology.orchestra.run.smithi093.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T12:11:31.571 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:31.571 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:31.578 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T12:11:31.579 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T12:11:31.579 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T12:11:31.580 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T12:11:31.581 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T12:11:31.583 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T12:11:31.583 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T12:11:31.814 INFO:teuthology.orchestra.run.smithi093.stdout:Dependencies resolved. 2020-11-20T12:11:31.836 INFO:teuthology.orchestra.run.smithi093.stdout:====================================================================================================================== 2020-11-20T12:11:31.839 INFO:teuthology.orchestra.run.smithi093.stdout: Package Arch Version Repository Size 2020-11-20T12:11:31.839 INFO:teuthology.orchestra.run.smithi093.stdout:====================================================================================================================== 2020-11-20T12:11:31.840 INFO:teuthology.orchestra.run.smithi093.stdout:Installing: 2020-11-20T12:11:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T12:11:31.840 INFO:teuthology.orchestra.run.smithi093.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T12:11:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T12:11:31.841 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T12:11:31.842 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T12:11:31.843 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T12:11:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T12:11:31.844 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T12:11:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T12:11:31.845 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T12:11:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T12:11:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T12:11:31.846 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T12:11:31.847 INFO:teuthology.orchestra.run.smithi093.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T12:11:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T12:11:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T12:11:31.848 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T12:11:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T12:11:31.849 INFO:teuthology.orchestra.run.smithi093.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T12:11:31.850 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T12:11:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T12:11:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T12:11:31.851 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T12:11:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T12:11:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T12:11:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T12:11:31.852 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T12:11:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T12:11:31.853 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrading: 2020-11-20T12:11:31.853 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T12:11:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T12:11:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T12:11:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T12:11:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:31.854 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T12:11:31.855 INFO:teuthology.orchestra.run.smithi093.stdout:Installing dependencies: 2020-11-20T12:11:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T12:11:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T12:11:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T12:11:31.855 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T12:11:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T12:11:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T12:11:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T12:11:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T12:11:31.856 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T12:11:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T12:11:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T12:11:31.857 INFO:teuthology.orchestra.run.smithi093.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T12:11:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T12:11:31.858 INFO:teuthology.orchestra.run.smithi093.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T12:11:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T12:11:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T12:11:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T12:11:31.859 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T12:11:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T12:11:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T12:11:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T12:11:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T12:11:31.860 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T12:11:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T12:11:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T12:11:31.861 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T12:11:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T12:11:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T12:11:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T12:11:31.862 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T12:11:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T12:11:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T12:11:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T12:11:31.863 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T12:11:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T12:11:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T12:11:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T12:11:31.864 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T12:11:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T12:11:31.865 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T12:11:31.866 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T12:11:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T12:11:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T12:11:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T12:11:31.868 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T12:11:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T12:11:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T12:11:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T12:11:31.869 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T12:11:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T12:11:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T12:11:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T12:11:31.870 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T12:11:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T12:11:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T12:11:31.871 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T12:11:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T12:11:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T12:11:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T12:11:31.873 INFO:teuthology.orchestra.run.smithi093.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T12:11:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T12:11:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T12:11:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T12:11:31.874 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T12:11:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T12:11:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T12:11:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T12:11:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T12:11:31.875 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T12:11:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T12:11:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T12:11:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T12:11:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T12:11:31.876 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T12:11:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T12:11:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T12:11:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T12:11:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T12:11:31.878 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T12:11:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T12:11:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T12:11:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T12:11:31.879 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T12:11:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T12:11:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T12:11:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T12:11:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T12:11:31.880 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T12:11:31.882 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T12:11:31.883 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T12:11:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T12:11:31.884 INFO:teuthology.orchestra.run.smithi093.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T12:11:31.885 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T12:11:31.886 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T12:11:31.887 INFO:teuthology.orchestra.run.smithi093.stdout:Installing weak dependencies: 2020-11-20T12:11:31.887 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T12:11:31.888 INFO:teuthology.orchestra.run.smithi093.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T12:11:31.889 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:11:31.889 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction Summary 2020-11-20T12:11:31.889 INFO:teuthology.orchestra.run.smithi093.stdout:====================================================================================================================== 2020-11-20T12:11:31.890 INFO:teuthology.orchestra.run.smithi093.stdout:Install 127 Packages 2020-11-20T12:11:31.890 INFO:teuthology.orchestra.run.smithi093.stdout:Upgrade 6 Packages 2020-11-20T12:11:31.890 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:11:31.891 INFO:teuthology.orchestra.run.smithi093.stdout:Total download size: 199 M 2020-11-20T12:11:31.891 INFO:teuthology.orchestra.run.smithi093.stdout:Downloading Packages: 2020-11-20T12:11:31.905 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2020-11-20T12:11:31.938 INFO:teuthology.orchestra.run.smithi132.stdout:====================================================================================================================== 2020-11-20T12:11:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2020-11-20T12:11:31.939 INFO:teuthology.orchestra.run.smithi132.stdout:====================================================================================================================== 2020-11-20T12:11:31.939 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2020-11-20T12:11:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T12:11:31.939 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T12:11:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T12:11:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T12:11:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T12:11:31.940 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T12:11:31.941 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T12:11:31.941 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T12:11:31.941 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T12:11:31.941 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T12:11:31.942 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T12:11:31.942 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T12:11:31.942 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T12:11:31.943 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T12:11:31.943 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T12:11:31.943 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T12:11:31.943 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T12:11:31.944 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T12:11:31.944 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T12:11:31.944 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T12:11:31.944 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T12:11:31.944 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:31.945 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T12:11:31.945 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T12:11:31.945 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T12:11:31.945 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T12:11:31.945 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T12:11:31.946 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T12:11:31.946 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T12:11:31.946 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2020-11-20T12:11:31.946 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T12:11:31.947 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T12:11:31.947 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T12:11:31.947 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T12:11:31.947 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:31.947 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T12:11:31.948 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2020-11-20T12:11:31.948 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T12:11:31.948 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T12:11:31.948 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T12:11:31.948 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T12:11:31.949 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T12:11:31.949 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T12:11:31.949 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T12:11:31.949 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T12:11:31.949 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T12:11:31.950 INFO:teuthology.orchestra.run.smithi132.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T12:11:31.950 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T12:11:31.950 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T12:11:31.950 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T12:11:31.950 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T12:11:31.951 INFO:teuthology.orchestra.run.smithi132.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T12:11:31.951 INFO:teuthology.orchestra.run.smithi132.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T12:11:31.951 INFO:teuthology.orchestra.run.smithi132.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T12:11:31.951 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T12:11:31.951 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T12:11:31.952 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T12:11:31.952 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T12:11:31.952 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T12:11:31.952 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T12:11:31.953 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T12:11:31.953 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:31.953 INFO:teuthology.orchestra.run.smithi132.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T12:11:31.953 INFO:teuthology.orchestra.run.smithi132.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T12:11:31.953 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T12:11:31.954 INFO:teuthology.orchestra.run.smithi132.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T12:11:31.954 INFO:teuthology.orchestra.run.smithi132.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T12:11:31.954 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T12:11:31.954 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T12:11:31.954 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T12:11:31.955 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T12:11:31.955 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T12:11:31.955 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T12:11:31.955 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T12:11:31.955 INFO:teuthology.orchestra.run.smithi132.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T12:11:31.956 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T12:11:31.956 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T12:11:31.956 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T12:11:31.956 INFO:teuthology.orchestra.run.smithi132.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T12:11:31.956 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T12:11:31.957 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T12:11:31.957 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T12:11:31.957 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T12:11:31.957 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T12:11:31.957 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T12:11:31.958 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T12:11:31.958 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T12:11:31.958 INFO:teuthology.orchestra.run.smithi132.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T12:11:31.958 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T12:11:31.958 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T12:11:31.959 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T12:11:31.959 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T12:11:31.959 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T12:11:31.959 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T12:11:31.959 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T12:11:31.960 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T12:11:31.960 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T12:11:31.960 INFO:teuthology.orchestra.run.smithi132.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T12:11:31.960 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T12:11:31.960 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T12:11:31.961 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T12:11:31.961 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T12:11:31.961 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T12:11:31.961 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T12:11:31.961 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T12:11:31.962 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T12:11:31.962 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T12:11:31.962 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T12:11:31.962 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T12:11:31.962 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T12:11:31.963 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T12:11:31.963 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T12:11:31.963 INFO:teuthology.orchestra.run.smithi132.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T12:11:31.963 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T12:11:31.963 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T12:11:31.964 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T12:11:31.964 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T12:11:31.964 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T12:11:31.964 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T12:11:31.964 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T12:11:31.965 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T12:11:31.965 INFO:teuthology.orchestra.run.smithi132.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T12:11:31.965 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T12:11:31.965 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T12:11:31.965 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T12:11:31.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T12:11:31.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T12:11:31.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T12:11:31.966 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T12:11:31.966 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T12:11:31.967 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T12:11:31.967 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T12:11:31.967 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2020-11-20T12:11:31.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T12:11:31.967 INFO:teuthology.orchestra.run.smithi132.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T12:11:31.968 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:11:31.968 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2020-11-20T12:11:31.968 INFO:teuthology.orchestra.run.smithi132.stdout:====================================================================================================================== 2020-11-20T12:11:31.968 INFO:teuthology.orchestra.run.smithi132.stdout:Install 127 Packages 2020-11-20T12:11:31.968 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 6 Packages 2020-11-20T12:11:31.969 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:11:31.969 INFO:teuthology.orchestra.run.smithi093.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 64 kB/s | 6.4 kB 00:00 2020-11-20T12:11:31.970 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 199 M 2020-11-20T12:11:31.970 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2020-11-20T12:11:32.057 INFO:teuthology.orchestra.run.smithi132.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 62 kB/s | 6.4 kB 00:00 2020-11-20T12:11:32.110 INFO:teuthology.orchestra.run.smithi093.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 3.9 MB/s | 632 kB 00:00 2020-11-20T12:11:32.156 INFO:teuthology.orchestra.run.smithi093.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 4.3 MB/s | 204 kB 00:00 2020-11-20T12:11:32.563 INFO:teuthology.orchestra.run.smithi093.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 5.3 MB/s | 2.1 MB 00:00 2020-11-20T12:11:32.636 INFO:teuthology.orchestra.run.smithi066.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:32.637 INFO:teuthology.orchestra.run.smithi066.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-11-20T12:11:32.645 INFO:teuthology.orchestra.run.smithi066.stdout:Package NetworkManager-1:1.26.0-8.el8.x86_64 is already installed. 2020-11-20T12:11:32.645 INFO:teuthology.orchestra.run.smithi066.stdout:Package iproute-5.3.0-5.el8.x86_64 is already installed. 2020-11-20T12:11:32.646 INFO:teuthology.orchestra.run.smithi066.stdout:Package util-linux-2.32.1-24.el8.x86_64 is already installed. 2020-11-20T12:11:32.647 INFO:teuthology.orchestra.run.smithi066.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-11-20T12:11:32.648 INFO:teuthology.orchestra.run.smithi066.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-11-20T12:11:32.650 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-11-20T12:11:32.650 INFO:teuthology.orchestra.run.smithi066.stdout:Package xfsprogs-5.0.0-4.el8.x86_64 is already installed. 2020-11-20T12:11:32.850 INFO:teuthology.orchestra.run.smithi132.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 798 kB/s | 632 kB 00:00 2020-11-20T12:11:32.878 INFO:teuthology.orchestra.run.smithi093.stdout:(5/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 5.8 MB/s | 6.0 MB 00:01 2020-11-20T12:11:32.885 INFO:teuthology.orchestra.run.smithi093.stdout:(6/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 4.8 MB/s | 1.5 MB 00:00 2020-11-20T12:11:32.989 INFO:teuthology.orchestra.run.smithi066.stdout:Dependencies resolved. 2020-11-20T12:11:33.016 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================================================== 2020-11-20T12:11:33.017 INFO:teuthology.orchestra.run.smithi066.stdout: Package Arch Version Repository Size 2020-11-20T12:11:33.017 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================================================== 2020-11-20T12:11:33.017 INFO:teuthology.orchestra.run.smithi066.stdout:Installing: 2020-11-20T12:11:33.017 INFO:teuthology.orchestra.run.smithi066.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2020-11-20T12:11:33.017 INFO:teuthology.orchestra.run.smithi066.stdout: ceph x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.4 k 2020-11-20T12:11:33.019 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 6.0 M 2020-11-20T12:11:33.019 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 632 k 2020-11-20T12:11:33.019 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:33.020 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 1.5 M 2020-11-20T12:11:33.020 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 66 k 2020-11-20T12:11:33.021 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 3.2 M 2020-11-20T12:11:33.021 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.6 M 2020-11-20T12:11:33.021 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 27 k 2020-11-20T12:11:33.021 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 12 M 2020-11-20T12:11:33.022 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 48 M 2020-11-20T12:11:33.022 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 57 k 2020-11-20T12:11:33.022 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel x86_64 0.180-1.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2020-11-20T12:11:33.022 INFO:teuthology.orchestra.run.smithi066.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2020-11-20T12:11:33.022 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2020-11-20T12:11:33.023 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 24 k 2020-11-20T12:11:33.023 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 562 k 2020-11-20T12:11:33.023 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 131 k 2020-11-20T12:11:33.023 INFO:teuthology.orchestra.run.smithi066.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2020-11-20T12:11:33.023 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel x86_64 2.32.1-24.el8 rhel-8-for-x86_64-baseos-rpms 96 k 2020-11-20T12:11:33.024 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel x86_64 1:1.1.1g-11.el8 rhel-8-for-x86_64-baseos-rpms 2.3 M 2020-11-20T12:11:33.024 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 204 k 2020-11-20T12:11:33.024 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 375 k 2020-11-20T12:11:33.024 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 353 k 2020-11-20T12:11:33.024 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 113 k 2020-11-20T12:11:33.025 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 88 k 2020-11-20T12:11:33.025 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.2 M 2020-11-20T12:11:33.025 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 171 k 2020-11-20T12:11:33.025 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel x86_64 5.0.0-4.el8 rhel-8-for-x86_64-baseos-rpms 69 k 2020-11-20T12:11:33.025 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrading: 2020-11-20T12:11:33.026 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 2.4 M 2020-11-20T12:11:33.026 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 1.7 M 2020-11-20T12:11:33.026 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 141 k 2020-11-20T12:11:33.026 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui x86_64 1:1.26.0-9.el8_3 rhel-8-for-x86_64-baseos-rpms 320 k 2020-11-20T12:11:33.027 INFO:teuthology.orchestra.run.smithi066.stdout: librados2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:33.027 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.4 M 2020-11-20T12:11:33.027 INFO:teuthology.orchestra.run.smithi066.stdout:Installing dependencies: 2020-11-20T12:11:33.027 INFO:teuthology.orchestra.run.smithi066.stdout: automake noarch 1.16.1-6.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2020-11-20T12:11:33.027 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 23 M 2020-11-20T12:11:33.028 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 24 k 2020-11-20T12:11:33.028 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 2.1 M 2020-11-20T12:11:33.028 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 198 k 2020-11-20T12:11:33.028 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 5.0 M 2020-11-20T12:11:33.028 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 18 M 2020-11-20T12:11:33.029 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts noarch 2:16.0.0-7397.gb86e691b.el8 ceph-noarch 8.8 k 2020-11-20T12:11:33.029 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 25 k 2020-11-20T12:11:33.029 INFO:teuthology.orchestra.run.smithi066.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2020-11-20T12:11:33.029 INFO:teuthology.orchestra.run.smithi066.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2020-11-20T12:11:33.029 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-common x86_64 3.2.1-12.el8 rhel-8-for-x86_64-baseos-rpms 21 k 2020-11-20T12:11:33.030 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs x86_64 2.7-6.el8 epel 315 k 2020-11-20T12:11:33.030 INFO:teuthology.orchestra.run.smithi066.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2020-11-20T12:11:33.030 INFO:teuthology.orchestra.run.smithi066.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2020-11-20T12:11:33.030 INFO:teuthology.orchestra.run.smithi066.stdout: krb5-devel x86_64 1.18.2-5.el8 rhel-8-for-x86_64-baseos-rpms 558 k 2020-11-20T12:11:33.030 INFO:teuthology.orchestra.run.smithi066.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2020-11-20T12:11:33.031 INFO:teuthology.orchestra.run.smithi066.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2020-11-20T12:11:33.031 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2020-11-20T12:11:33.032 INFO:teuthology.orchestra.run.smithi066.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2020-11-20T12:11:33.032 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath x86_64 8.3.1-5.1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2020-11-20T12:11:33.032 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq x86_64 0.9.0-2.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2020-11-20T12:11:33.032 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 486 k 2020-11-20T12:11:33.032 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2020-11-20T12:11:33.033 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2 x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 3.7 M 2020-11-20T12:11:33.033 INFO:teuthology.orchestra.run.smithi066.stdout: libselinux-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 199 k 2020-11-20T12:11:33.033 INFO:teuthology.orchestra.run.smithi066.stdout: libsepol-devel x86_64 2.9-1.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2020-11-20T12:11:33.033 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2020-11-20T12:11:33.033 INFO:teuthology.orchestra.run.smithi066.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2020-11-20T12:11:33.034 INFO:teuthology.orchestra.run.smithi066.stdout: libxslt x86_64 1.1.32-5.el8 rhel-8-for-x86_64-baseos-rpms 250 k 2020-11-20T12:11:33.034 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2020-11-20T12:11:33.034 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2020-11-20T12:11:33.034 INFO:teuthology.orchestra.run.smithi066.stdout: openblas x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.3 M 2020-11-20T12:11:33.035 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-threads x86_64 0.3.3-5.el8 rhel-8-for-x86_64-appstream-rpms 4.4 M 2020-11-20T12:11:33.035 INFO:teuthology.orchestra.run.smithi066.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2020-11-20T12:11:33.035 INFO:teuthology.orchestra.run.smithi066.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2020-11-20T12:11:33.035 INFO:teuthology.orchestra.run.smithi066.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2020-11-20T12:11:33.036 INFO:teuthology.orchestra.run.smithi066.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2020-11-20T12:11:33.036 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asn1crypto noarch 0.24.0-3.el8 rhel-8-for-x86_64-baseos-rpms 181 k 2020-11-20T12:11:33.036 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2020-11-20T12:11:33.036 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2020-11-20T12:11:33.037 INFO:teuthology.orchestra.run.smithi066.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2020-11-20T12:11:33.037 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2020-11-20T12:11:33.037 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 40 k 2020-11-20T12:11:33.037 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common x86_64 2:16.0.0-7397.gb86e691b.el8 ceph 73 k 2020-11-20T12:11:33.037 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2020-11-20T12:11:33.038 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2020-11-20T12:11:33.038 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot noarch 8.2.1-1.el8 epel 145 k 2020-11-20T12:11:33.038 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2020-11-20T12:11:33.038 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography x86_64 2.3-3.el8 rhel-8-for-x86_64-baseos-rpms 511 k 2020-11-20T12:11:33.038 INFO:teuthology.orchestra.run.smithi066.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2020-11-20T12:11:33.039 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2020-11-20T12:11:33.039 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2020-11-20T12:11:33.039 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2020-11-20T12:11:33.039 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2020-11-20T12:11:33.039 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T12:11:33.040 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2020-11-20T12:11:33.040 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T12:11:33.040 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes noarch 11.0.0-2.el8 epel 1.2 M 2020-11-20T12:11:33.040 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2020-11-20T12:11:33.041 INFO:teuthology.orchestra.run.smithi066.stdout: python3-lxml x86_64 4.2.3-1.el8 rhel-8-for-x86_64-appstream-rpms 1.5 M 2020-11-20T12:11:33.041 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2020-11-20T12:11:33.041 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2020-11-20T12:11:33.041 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2020-11-20T12:11:33.042 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2020-11-20T12:11:33.042 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2020-11-20T12:11:33.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2020-11-20T12:11:33.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2020-11-20T12:11:33.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2020-11-20T12:11:33.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2020-11-20T12:11:33.043 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL noarch 18.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2020-11-20T12:11:33.044 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2020-11-20T12:11:33.045 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2020-11-20T12:11:33.045 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2020-11-20T12:11:33.045 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2020-11-20T12:11:33.046 INFO:teuthology.orchestra.run.smithi066.stdout: python3-remoto noarch 1.1.4-4.el8 epel 48 k 2020-11-20T12:11:33.046 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2020-11-20T12:11:33.046 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2020-11-20T12:11:33.046 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2020-11-20T12:11:33.046 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa noarch 3.4.2-15.el8 epel 73 k 2020-11-20T12:11:33.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2020-11-20T12:11:33.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2020-11-20T12:11:33.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2020-11-20T12:11:33.047 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2020-11-20T12:11:33.048 INFO:teuthology.orchestra.run.smithi066.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2020-11-20T12:11:33.048 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress noarch 1.2.1-2.el8.1 epel 241 k 2020-11-20T12:11:33.048 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webencodings noarch 0.5.1-6.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2020-11-20T12:11:33.048 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2020-11-20T12:11:33.048 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2020-11-20T12:11:33.049 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2020-11-20T12:11:33.049 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2020-11-20T12:11:33.049 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2020-11-20T12:11:33.049 INFO:teuthology.orchestra.run.smithi066.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2020-11-20T12:11:33.050 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet x86_64 1.6.1-11.el8 epel 69 k 2020-11-20T12:11:33.050 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel x86_64 1.2.11-16.el8_2 rhel-8-for-x86_64-baseos-rpms 57 k 2020-11-20T12:11:33.050 INFO:teuthology.orchestra.run.smithi066.stdout:Installing weak dependencies: 2020-11-20T12:11:33.050 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cssselect noarch 0.9.2-10.el8 epel 40 k 2020-11-20T12:11:33.051 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib noarch 1:0.999999999-6.el8 rhel-8-for-x86_64-appstream-rpms 214 k 2020-11-20T12:11:33.051 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:11:33.051 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction Summary 2020-11-20T12:11:33.051 INFO:teuthology.orchestra.run.smithi066.stdout:====================================================================================================================== 2020-11-20T12:11:33.051 INFO:teuthology.orchestra.run.smithi066.stdout:Install 127 Packages 2020-11-20T12:11:33.052 INFO:teuthology.orchestra.run.smithi066.stdout:Upgrade 6 Packages 2020-11-20T12:11:33.052 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:11:33.053 INFO:teuthology.orchestra.run.smithi132.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 1.1 MB/s | 204 kB 00:00 2020-11-20T12:11:33.053 INFO:teuthology.orchestra.run.smithi066.stdout:Total download size: 199 M 2020-11-20T12:11:33.053 INFO:teuthology.orchestra.run.smithi066.stdout:Downloading Packages: 2020-11-20T12:11:33.293 INFO:teuthology.orchestra.run.smithi066.stdout:(1/133): ceph-16.0.0-7397.gb86e691b.el8.x86_64. 25 kB/s | 6.4 kB 00:00 2020-11-20T12:11:33.697 INFO:teuthology.orchestra.run.smithi093.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 6.1 MB/s | 5.0 MB 00:00 2020-11-20T12:11:33.882 INFO:teuthology.orchestra.run.smithi066.stdout:(2/133): ceph-fuse-16.0.0-7397.gb86e691b.el8.x8 1.0 MB/s | 632 kB 00:00 2020-11-20T12:11:34.036 INFO:teuthology.orchestra.run.smithi066.stdout:(3/133): ceph-immutable-object-cache-16.0.0-739 1.3 MB/s | 204 kB 00:00 2020-11-20T12:11:34.195 INFO:teuthology.orchestra.run.smithi132.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.8 MB/s | 2.1 MB 00:01 2020-11-20T12:11:34.740 INFO:teuthology.orchestra.run.smithi132.stdout:(5/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 2.8 MB/s | 1.5 MB 00:00 2020-11-20T12:11:35.445 INFO:teuthology.orchestra.run.smithi066.stdout:(4/133): ceph-mds-16.0.0-7397.gb86e691b.el8.x86 1.5 MB/s | 2.1 MB 00:01 2020-11-20T12:11:35.526 INFO:teuthology.orchestra.run.smithi066.stdout:(5/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 2.4 MB/s | 6.0 MB 00:02 2020-11-20T12:11:35.804 INFO:teuthology.orchestra.run.smithi093.stdout:(8/133): ceph-common-16.0.0-7397.gb86e691b.el8. 5.8 MB/s | 23 MB 00:03 2020-11-20T12:11:35.867 INFO:teuthology.orchestra.run.smithi093.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 394 kB/s | 25 kB 00:00 2020-11-20T12:11:36.244 INFO:teuthology.orchestra.run.smithi093.stdout:(10/133): ceph-radosgw-16.0.0-7397.gb86e691b.el 4.7 MB/s | 12 MB 00:02 2020-11-20T12:11:36.275 INFO:teuthology.orchestra.run.smithi132.stdout:(6/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 3.2 MB/s | 5.0 MB 00:01 2020-11-20T12:11:36.944 INFO:teuthology.orchestra.run.smithi066.stdout:(6/133): ceph-mgr-16.0.0-7397.gb86e691b.el8.x86 1.6 MB/s | 1.5 MB 00:00 2020-11-20T12:11:36.944 INFO:teuthology.orchestra.run.smithi066.stdout:(7/133): ceph-mon-16.0.0-7397.gb86e691b.el8.x86 3.9 MB/s | 5.0 MB 00:01 2020-11-20T12:11:36.944 INFO:teuthology.orchestra.run.smithi093.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 384 kB/s | 24 kB 00:00 2020-11-20T12:11:36.944 INFO:teuthology.orchestra.run.smithi093.stdout:(12/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 4.9 MB/s | 18 MB 00:03 2020-11-20T12:11:36.945 INFO:teuthology.orchestra.run.smithi093.stdout:(13/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 2.4 MB/s | 562 kB 00:00 2020-11-20T12:11:36.945 INFO:teuthology.orchestra.run.smithi093.stdout:(14/133): librados-devel-16.0.0-7397.gb86e691b. 2.2 MB/s | 131 kB 00:00 2020-11-20T12:11:36.945 INFO:teuthology.orchestra.run.smithi093.stdout:(15/133): libradosstriper1-16.0.0-7397.gb86e691 3.4 MB/s | 486 kB 00:00 2020-11-20T12:11:36.945 INFO:teuthology.orchestra.run.smithi093.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 597 kB/s | 40 kB 00:00 2020-11-20T12:11:36.946 INFO:teuthology.orchestra.run.smithi093.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.1 MB/s | 73 kB 00:00 2020-11-20T12:11:36.946 INFO:teuthology.orchestra.run.smithi093.stdout:(18/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.7 MB/s | 204 kB 00:00 2020-11-20T12:11:36.954 INFO:teuthology.orchestra.run.smithi093.stdout:(19/133): python3-rados-16.0.0-7397.gb86e691b.e 4.5 MB/s | 375 kB 00:00 2020-11-20T12:11:37.034 INFO:teuthology.orchestra.run.smithi093.stdout:(20/133): python3-rbd-16.0.0-7397.gb86e691b.el8 4.4 MB/s | 353 kB 00:00 2020-11-20T12:11:37.105 INFO:teuthology.orchestra.run.smithi093.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 1.6 MB/s | 113 kB 00:00 2020-11-20T12:11:37.175 INFO:teuthology.orchestra.run.smithi093.stdout:(22/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.2 MB/s | 88 kB 00:00 2020-11-20T12:11:37.383 INFO:teuthology.orchestra.run.smithi093.stdout:(23/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 4.7 MB/s | 3.7 MB 00:00 2020-11-20T12:11:37.458 INFO:teuthology.orchestra.run.smithi093.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 2.2 MB/s | 171 kB 00:00 2020-11-20T12:11:37.528 INFO:teuthology.orchestra.run.smithi093.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 344 kB/s | 24 kB 00:00 2020-11-20T12:11:37.606 INFO:teuthology.orchestra.run.smithi093.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 922 kB/s | 66 kB 00:00 2020-11-20T12:11:37.869 INFO:teuthology.orchestra.run.smithi093.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 4.6 MB/s | 3.2 MB 00:00 2020-11-20T12:11:38.385 INFO:teuthology.orchestra.run.smithi093.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 4.0 MB/s | 3.2 MB 00:00 2020-11-20T12:11:38.429 INFO:teuthology.orchestra.run.smithi132.stdout:(7/133): ceph-base-16.0.0-7397.gb86e691b.el8.x8 944 kB/s | 6.0 MB 00:06 2020-11-20T12:11:38.453 INFO:teuthology.orchestra.run.smithi093.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 2.9 MB/s | 198 kB 00:00 2020-11-20T12:11:38.517 INFO:teuthology.orchestra.run.smithi093.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 425 kB/s | 27 kB 00:00 2020-11-20T12:11:38.581 INFO:teuthology.orchestra.run.smithi093.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 139 kB/s | 8.8 kB 00:00 2020-11-20T12:11:38.646 INFO:teuthology.orchestra.run.smithi093.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 879 kB/s | 57 kB 00:00 2020-11-20T12:11:38.731 INFO:teuthology.orchestra.run.smithi093.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.3 MB/s | 116 kB 00:00 2020-11-20T12:11:38.765 INFO:teuthology.orchestra.run.smithi093.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 9.2 MB/s | 315 kB 00:00 2020-11-20T12:11:38.783 INFO:teuthology.orchestra.run.smithi093.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 10 MB/s | 181 kB 00:00 2020-11-20T12:11:38.800 INFO:teuthology.orchestra.run.smithi093.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 3.4 MB/s | 59 kB 00:00 2020-11-20T12:11:38.817 INFO:teuthology.orchestra.run.smithi093.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T12:11:38.833 INFO:teuthology.orchestra.run.smithi093.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-11-20T12:11:38.851 INFO:teuthology.orchestra.run.smithi093.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.4 MB/s | 44 kB 00:00 2020-11-20T12:11:38.868 INFO:teuthology.orchestra.run.smithi093.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 10 MB/s | 185 kB 00:00 2020-11-20T12:11:38.885 INFO:teuthology.orchestra.run.smithi093.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 2.0 MB/s | 33 kB 00:00 2020-11-20T12:11:38.901 INFO:teuthology.orchestra.run.smithi093.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 1.0 MB/s | 16 kB 00:00 2020-11-20T12:11:38.919 INFO:teuthology.orchestra.run.smithi093.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 8.0 MB/s | 145 kB 00:00 2020-11-20T12:11:38.953 INFO:teuthology.orchestra.run.smithi093.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 11 MB/s | 384 kB 00:00 2020-11-20T12:11:38.970 INFO:teuthology.orchestra.run.smithi093.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.4 MB/s | 40 kB 00:00 2020-11-20T12:11:39.003 INFO:teuthology.orchestra.run.smithi093.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 10 MB/s | 355 kB 00:00 2020-11-20T12:11:39.021 INFO:teuthology.orchestra.run.smithi093.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 4.6 MB/s | 81 kB 00:00 2020-11-20T12:11:39.037 INFO:teuthology.orchestra.run.smithi093.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 682 kB/s | 11 kB 00:00 2020-11-20T12:11:39.053 INFO:teuthology.orchestra.run.smithi093.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 1.1 MB/s | 18 kB 00:00 2020-11-20T12:11:39.137 INFO:teuthology.orchestra.run.smithi093.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 14 MB/s | 1.2 MB 00:00 2020-11-20T12:11:39.154 INFO:teuthology.orchestra.run.smithi093.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.8 MB/s | 49 kB 00:00 2020-11-20T12:11:39.171 INFO:teuthology.orchestra.run.smithi093.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 3.4 MB/s | 59 kB 00:00 2020-11-20T12:11:39.204 INFO:teuthology.orchestra.run.smithi093.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 8.4 MB/s | 283 kB 00:00 2020-11-20T12:11:39.221 INFO:teuthology.orchestra.run.smithi093.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 953 kB/s | 16 kB 00:00 2020-11-20T12:11:39.237 INFO:teuthology.orchestra.run.smithi093.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.8 MB/s | 48 kB 00:00 2020-11-20T12:11:39.254 INFO:teuthology.orchestra.run.smithi093.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 2.0 MB/s | 34 kB 00:00 2020-11-20T12:11:39.272 INFO:teuthology.orchestra.run.smithi093.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 11 MB/s | 196 kB 00:00 2020-11-20T12:11:39.289 INFO:teuthology.orchestra.run.smithi093.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 4.3 MB/s | 73 kB 00:00 2020-11-20T12:11:39.305 INFO:teuthology.orchestra.run.smithi093.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 1.1 MB/s | 19 kB 00:00 2020-11-20T12:11:39.322 INFO:teuthology.orchestra.run.smithi093.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.4 MB/s | 24 kB 00:00 2020-11-20T12:11:39.339 INFO:teuthology.orchestra.run.smithi093.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.7 MB/s | 29 kB 00:00 2020-11-20T12:11:39.356 INFO:teuthology.orchestra.run.smithi093.stdout:(62/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.6 MB/s | 27 kB 00:00 2020-11-20T12:11:39.374 INFO:teuthology.orchestra.run.smithi093.stdout:(63/133): python3-waitress-1.2.1-2.el8.1.noarch 13 MB/s | 241 kB 00:00 2020-11-20T12:11:39.394 INFO:teuthology.orchestra.run.smithi093.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 14 MB/s | 251 kB 00:00 2020-11-20T12:11:39.409 INFO:teuthology.orchestra.run.smithi093.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.6 MB/s | 61 kB 00:00 2020-11-20T12:11:39.426 INFO:teuthology.orchestra.run.smithi093.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 4.9 MB/s | 85 kB 00:00 2020-11-20T12:11:39.443 INFO:teuthology.orchestra.run.smithi093.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.4 MB/s | 23 kB 00:00 2020-11-20T12:11:39.459 INFO:teuthology.orchestra.run.smithi093.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 4.0 MB/s | 69 kB 00:00 2020-11-20T12:11:39.506 INFO:teuthology.orchestra.run.smithi093.stdout:(69/133): automake-1.16.1-6.el8.noarch.rpm 15 MB/s | 713 kB 00:00 2020-11-20T12:11:39.528 INFO:teuthology.orchestra.run.smithi093.stdout:(70/133): python3-webencodings-0.5.1-6.el8.noar 1.2 MB/s | 27 kB 00:00 2020-11-20T12:11:39.562 INFO:teuthology.orchestra.run.smithi093.stdout:(71/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 44 MB/s | 1.5 MB 00:00 2020-11-20T12:11:39.585 INFO:teuthology.orchestra.run.smithi093.stdout:(72/133): jq-1.5-12.el8.x86_64.rpm 6.9 MB/s | 161 kB 00:00 2020-11-20T12:11:39.607 INFO:teuthology.orchestra.run.smithi093.stdout:(73/133): python3-pyOpenSSL-18.0.0-1.el8.noarch 4.7 MB/s | 103 kB 00:00 2020-11-20T12:11:39.633 INFO:teuthology.orchestra.run.smithi093.stdout:(74/133): python3-werkzeug-0.12.2-4.el8.noarch. 17 MB/s | 457 kB 00:00 2020-11-20T12:11:39.646 INFO:teuthology.orchestra.run.smithi066.stdout:(8/133): ceph-radosgw-16.0.0-7397.gb86e691b.el8 4.1 MB/s | 12 MB 00:02 2020-11-20T12:11:39.658 INFO:teuthology.orchestra.run.smithi093.stdout:(75/133): python3-mako-1.0.6-13.el8.noarch.rpm 6.2 MB/s | 157 kB 00:00 2020-11-20T12:11:39.679 INFO:teuthology.orchestra.run.smithi093.stdout:(76/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.3 MB/s | 27 kB 00:00 2020-11-20T12:11:39.700 INFO:teuthology.orchestra.run.smithi093.stdout:(77/133): python3-jsonpointer-1.10-11.el8.noarc 965 kB/s | 20 kB 00:00 2020-11-20T12:11:39.705 INFO:teuthology.orchestra.run.smithi066.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 428 kB/s | 25 kB 00:00 2020-11-20T12:11:39.724 INFO:teuthology.orchestra.run.smithi093.stdout:(78/133): python3-html5lib-0.999999999-6.el8.no 8.8 MB/s | 214 kB 00:00 2020-11-20T12:11:39.746 INFO:teuthology.orchestra.run.smithi093.stdout:(79/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 5.6 MB/s | 126 kB 00:00 2020-11-20T12:11:39.769 INFO:teuthology.orchestra.run.smithi093.stdout:(80/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.3 MB/s | 54 kB 00:00 2020-11-20T12:11:39.794 INFO:teuthology.orchestra.run.smithi093.stdout:(81/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.4 MB/s | 110 kB 00:00 2020-11-20T12:11:39.829 INFO:teuthology.orchestra.run.smithi093.stdout:(82/133): ceph-mgr-diskprediction-local-16.0.0- 4.4 MB/s | 8.6 MB 00:01 2020-11-20T12:11:39.831 INFO:teuthology.orchestra.run.smithi093.stdout:(83/133): python3-prettytable-0.7.2-14.el8.noar 1.2 MB/s | 44 kB 00:00 2020-11-20T12:11:39.864 INFO:teuthology.orchestra.run.smithi093.stdout:(84/133): flex-2.6.1-9.el8.x86_64.rpm 9.4 MB/s | 320 kB 00:00 2020-11-20T12:11:39.868 INFO:teuthology.orchestra.run.smithi093.stdout:(85/133): python3-markupsafe-0.23-19.el8.x86_64 1.0 MB/s | 39 kB 00:00 2020-11-20T12:11:39.896 INFO:teuthology.orchestra.run.smithi093.stdout:(86/133): librdkafka-0.11.4-1.el8.x86_64.rpm 12 MB/s | 353 kB 00:00 2020-11-20T12:11:39.911 INFO:teuthology.orchestra.run.smithi093.stdout:(87/133): bison-3.0.4-10.el8.x86_64.rpm 15 MB/s | 688 kB 00:00 2020-11-20T12:11:39.927 INFO:teuthology.orchestra.run.smithi093.stdout:(88/133): libtool-2.4.6-25.el8.x86_64.rpm 21 MB/s | 709 kB 00:00 2020-11-20T12:11:39.938 INFO:teuthology.orchestra.run.smithi093.stdout:(89/133): python3-jinja2-2.10.1-2.el8_0.noarch. 19 MB/s | 538 kB 00:00 2020-11-20T12:11:39.970 INFO:teuthology.orchestra.run.smithi093.stdout:(90/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 8.5 MB/s | 225 kB 00:00 2020-11-20T12:11:40.037 INFO:teuthology.orchestra.run.smithi093.stdout:(91/133): python3-babel-2.5.1-5.el8.noarch.rpm 70 MB/s | 4.8 MB 00:00 2020-11-20T12:11:40.143 INFO:teuthology.orchestra.run.smithi093.stdout:(92/133): python3-scipy-1.0.0-20.module+el8.1.0 67 MB/s | 15 MB 00:00 2020-11-20T12:11:40.162 INFO:teuthology.orchestra.run.smithi093.stdout:(93/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 2.0 MB/s | 259 kB 00:00 2020-11-20T12:11:40.202 INFO:teuthology.orchestra.run.smithi093.stdout:(94/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 68 MB/s | 3.7 MB 00:00 2020-11-20T12:11:40.234 INFO:teuthology.orchestra.run.smithi093.stdout:(95/133): openblas-threads-0.3.3-5.el8.x86_64.r 61 MB/s | 4.4 MB 00:00 2020-11-20T12:11:40.260 INFO:teuthology.orchestra.run.smithi093.stdout:(96/133): socat-1.7.3.3-2.el8.x86_64.rpm 12 MB/s | 302 kB 00:00 2020-11-20T12:11:40.272 INFO:teuthology.orchestra.run.smithi093.stdout:(97/133): openblas-0.3.3-5.el8.x86_64.rpm 62 MB/s | 4.3 MB 00:00 2020-11-20T12:11:40.298 INFO:teuthology.orchestra.run.smithi093.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 4.8 MB/s | 187 kB 00:00 2020-11-20T12:11:40.306 INFO:teuthology.orchestra.run.smithi093.stdout:(99/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.9 MB/s | 238 kB 00:00 2020-11-20T12:11:40.323 INFO:teuthology.orchestra.run.smithi093.stdout:(100/133): libverto-devel-0.3.0-5.el8.x86_64.rp 717 kB/s | 18 kB 00:00 2020-11-20T12:11:40.337 INFO:teuthology.orchestra.run.smithi093.stdout:(101/133): python3-asn1crypto-0.24.0-3.el8.noar 5.8 MB/s | 181 kB 00:00 2020-11-20T12:11:40.344 INFO:teuthology.orchestra.run.smithi093.stdout:(102/133): python3-requests-oauthlib-1.0.0-1.el 1.9 MB/s | 43 kB 00:00 2020-11-20T12:11:40.364 INFO:teuthology.orchestra.run.smithi093.stdout:(103/133): fuse-2.9.7-12.el8.x86_64.rpm 3.1 MB/s | 83 kB 00:00 2020-11-20T12:11:40.371 INFO:teuthology.orchestra.run.smithi093.stdout:(104/133): python3-pycparser-2.14-14.el8.noarch 4.1 MB/s | 109 kB 00:00 2020-11-20T12:11:40.385 INFO:teuthology.orchestra.run.smithi093.stdout:(105/133): keyutils-libs-devel-1.5.10-6.el8.x86 2.2 MB/s | 48 kB 00:00 2020-11-20T12:11:40.395 INFO:teuthology.orchestra.run.smithi093.stdout:(106/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2020-11-20T12:11:40.414 INFO:teuthology.orchestra.run.smithi093.stdout:(107/133): python3-oauthlib-2.1.0-1.el8.noarch. 5.9 MB/s | 155 kB 00:00 2020-11-20T12:11:40.421 INFO:teuthology.orchestra.run.smithi093.stdout:(108/133): fuse-common-3.2.1-12.el8.x86_64.rpm 846 kB/s | 21 kB 00:00 2020-11-20T12:11:40.439 INFO:teuthology.orchestra.run.smithi093.stdout:(109/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.3 MB/s | 86 kB 00:00 2020-11-20T12:11:40.446 INFO:teuthology.orchestra.run.smithi093.stdout:(110/133): libaio-devel-0.3.112-1.el8.x86_64.rp 747 kB/s | 19 kB 00:00 2020-11-20T12:11:40.467 INFO:teuthology.orchestra.run.smithi093.stdout:(111/133): libselinux-devel-2.9-3.el8.x86_64.rp 7.3 MB/s | 199 kB 00:00 2020-11-20T12:11:40.476 INFO:teuthology.orchestra.run.smithi093.stdout:(112/133): python3-cryptography-2.3-3.el8.x86_6 17 MB/s | 511 kB 00:00 2020-11-20T12:11:40.488 INFO:teuthology.orchestra.run.smithi093.stdout:(113/133): zlib-devel-1.2.11-16.el8_2.x86_64.rp 2.6 MB/s | 57 kB 00:00 2020-11-20T12:11:40.507 INFO:teuthology.orchestra.run.smithi093.stdout:(114/133): libuuid-devel-2.32.1-24.el8.x86_64.r 3.5 MB/s | 96 kB 00:00 2020-11-20T12:11:40.515 INFO:teuthology.orchestra.run.smithi093.stdout:(115/133): libxslt-1.1.32-5.el8.x86_64.rpm 8.9 MB/s | 250 kB 00:00 2020-11-20T12:11:40.533 INFO:teuthology.orchestra.run.smithi093.stdout:(116/133): libcom_err-devel-1.45.6-1.el8.x86_64 1.4 MB/s | 38 kB 00:00 2020-11-20T12:11:40.544 INFO:teuthology.orchestra.run.smithi093.stdout:(117/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.0 MB/s | 169 kB 00:00 2020-11-20T12:11:40.565 INFO:teuthology.orchestra.run.smithi093.stdout:(118/133): pcre2-devel-10.32-2.el8.x86_64.rpm 19 MB/s | 605 kB 00:00 2020-11-20T12:11:40.582 INFO:teuthology.orchestra.run.smithi093.stdout:(119/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 18 MB/s | 639 kB 00:00 2020-11-20T12:11:40.590 INFO:teuthology.orchestra.run.smithi093.stdout:(120/133): elfutils-libelf-devel-0.180-1.el8.x8 2.3 MB/s | 58 kB 00:00 2020-11-20T12:11:40.612 INFO:teuthology.orchestra.run.smithi093.stdout:(121/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 7.2 MB/s | 220 kB 00:00 2020-11-20T12:11:40.626 INFO:teuthology.orchestra.run.smithi093.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.1 MB/s | 229 kB 00:00 2020-11-20T12:11:40.634 INFO:teuthology.orchestra.run.smithi132.stdout:(8/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x86 4.1 MB/s | 18 MB 00:04 2020-11-20T12:11:40.643 INFO:teuthology.orchestra.run.smithi093.stdout:(123/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 18 MB/s | 558 kB 00:00 2020-11-20T12:11:40.650 INFO:teuthology.orchestra.run.smithi093.stdout:(124/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 2.8 MB/s | 69 kB 00:00 2020-11-20T12:11:40.670 INFO:teuthology.orchestra.run.smithi093.stdout:(125/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.9 MB/s | 47 kB 00:00 2020-11-20T12:11:40.684 INFO:teuthology.orchestra.run.smithi132.stdout:(9/133): ceph-selinux-16.0.0-7397.gb86e691b.el8 494 kB/s | 25 kB 00:00 2020-11-20T12:11:40.700 INFO:teuthology.orchestra.run.smithi093.stdout:(126/133): openssl-devel-1.1.1g-11.el8.x86_64.r 47 MB/s | 2.3 MB 00:00 2020-11-20T12:11:41.520 INFO:teuthology.orchestra.run.smithi093.stdout:(127/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 2.9 MB/s | 2.4 MB 00:00 2020-11-20T12:11:41.556 INFO:teuthology.orchestra.run.smithi093.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 51 MB/s | 1.7 MB 00:00 2020-11-20T12:11:41.578 INFO:teuthology.orchestra.run.smithi093.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 13 MB/s | 320 kB 00:00 2020-11-20T12:11:41.601 INFO:teuthology.orchestra.run.smithi093.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 6.1 MB/s | 141 kB 00:00 2020-11-20T12:11:41.641 INFO:teuthology.orchestra.run.smithi093.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 61 MB/s | 2.4 MB 00:00 2020-11-20T12:11:41.827 INFO:teuthology.orchestra.run.smithi093.stdout:(132/133): librados2-16.0.0-7397.gb86e691b.el8. 3.2 MB/s | 3.7 MB 00:01 2020-11-20T12:11:42.816 INFO:teuthology.orchestra.run.smithi066.stdout:(10/133): ceph-common-16.0.0-7397.gb86e691b.el8 2.3 MB/s | 23 MB 00:09 2020-11-20T12:11:42.868 INFO:teuthology.orchestra.run.smithi066.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 454 kB/s | 24 kB 00:00 2020-11-20T12:11:43.039 INFO:teuthology.orchestra.run.smithi066.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 3.2 MB/s | 562 kB 00:00 2020-11-20T12:11:43.094 INFO:teuthology.orchestra.run.smithi066.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 2.3 MB/s | 131 kB 00:00 2020-11-20T12:11:43.265 INFO:teuthology.orchestra.run.smithi066.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 2.8 MB/s | 486 kB 00:00 2020-11-20T12:11:44.145 INFO:teuthology.orchestra.run.smithi066.stdout:(15/133): ceph-osd-16.0.0-7397.gb86e691b.el8.x8 2.3 MB/s | 18 MB 00:07 2020-11-20T12:11:44.207 INFO:teuthology.orchestra.run.smithi066.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 642 kB/s | 40 kB 00:00 2020-11-20T12:11:44.268 INFO:teuthology.orchestra.run.smithi066.stdout:(17/133): python3-ceph-common-16.0.0-7397.gb86e 1.2 MB/s | 73 kB 00:00 2020-11-20T12:11:44.292 INFO:teuthology.orchestra.run.smithi132.stdout:(10/133): ceph-common-16.0.0-7397.gb86e691b.el8 1.9 MB/s | 23 MB 00:12 2020-11-20T12:11:44.308 INFO:teuthology.orchestra.run.smithi066.stdout:(18/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 3.6 MB/s | 3.7 MB 00:01 2020-11-20T12:11:44.346 INFO:teuthology.orchestra.run.smithi132.stdout:(11/133): libcephfs-devel-16.0.0-7397.gb86e691b 437 kB/s | 24 kB 00:00 2020-11-20T12:11:44.363 INFO:teuthology.orchestra.run.smithi066.stdout:(19/133): python3-cephfs-16.0.0-7397.gb86e691b. 2.1 MB/s | 204 kB 00:00 2020-11-20T12:11:44.410 INFO:teuthology.orchestra.run.smithi066.stdout:(20/133): python3-rados-16.0.0-7397.gb86e691b.e 3.7 MB/s | 375 kB 00:00 2020-11-20T12:11:44.448 INFO:teuthology.orchestra.run.smithi132.stdout:(12/133): libcephfs2-16.0.0-7397.gb86e691b.el8. 5.4 MB/s | 562 kB 00:00 2020-11-20T12:11:44.455 INFO:teuthology.orchestra.run.smithi066.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 2.3 MB/s | 113 kB 00:00 2020-11-20T12:11:44.463 INFO:teuthology.orchestra.run.smithi066.stdout:(22/133): python3-rbd-16.0.0-7397.gb86e691b.el8 3.4 MB/s | 353 kB 00:00 2020-11-20T12:11:44.504 INFO:teuthology.orchestra.run.smithi132.stdout:(13/133): librados-devel-16.0.0-7397.gb86e691b. 2.4 MB/s | 131 kB 00:00 2020-11-20T12:11:44.506 INFO:teuthology.orchestra.run.smithi066.stdout:(23/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.7 MB/s | 88 kB 00:00 2020-11-20T12:11:44.561 INFO:teuthology.orchestra.run.smithi066.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 3.0 MB/s | 171 kB 00:00 2020-11-20T12:11:44.612 INFO:teuthology.orchestra.run.smithi132.stdout:(14/133): libradosstriper1-16.0.0-7397.gb86e691 4.4 MB/s | 486 kB 00:00 2020-11-20T12:11:44.617 INFO:teuthology.orchestra.run.smithi066.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 448 kB/s | 24 kB 00:00 2020-11-20T12:11:44.620 INFO:teuthology.orchestra.run.smithi093.stdout:(133/133): ceph-test-16.0.0-7397.gb86e691b.el8. 5.4 MB/s | 48 MB 00:08 2020-11-20T12:11:44.624 INFO:teuthology.orchestra.run.smithi093.stdout:-------------------------------------------------------------------------------- 2020-11-20T12:11:44.625 INFO:teuthology.orchestra.run.smithi093.stdout:Total 16 MB/s | 199 MB 00:12 2020-11-20T12:11:44.671 INFO:teuthology.orchestra.run.smithi066.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.2 MB/s | 66 kB 00:00 2020-11-20T12:11:44.697 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction check 2020-11-20T12:11:44.818 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction check succeeded. 2020-11-20T12:11:44.818 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction test 2020-11-20T12:11:45.357 INFO:teuthology.orchestra.run.smithi066.stdout:(27/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 3.6 MB/s | 3.2 MB 00:00 2020-11-20T12:11:45.358 INFO:teuthology.orchestra.run.smithi132.stdout:(15/133): librgw2-16.0.0-7397.gb86e691b.el8.x86 5.0 MB/s | 3.7 MB 00:00 2020-11-20T12:11:45.415 INFO:teuthology.orchestra.run.smithi132.stdout:(16/133): python3-ceph-argparse-16.0.0-7397.gb8 702 kB/s | 40 kB 00:00 2020-11-20T12:11:45.426 INFO:teuthology.orchestra.run.smithi066.stdout:(28/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 4.2 MB/s | 3.2 MB 00:00 2020-11-20T12:11:45.474 INFO:teuthology.orchestra.run.smithi132.stdout:(17/133): ceph-radosgw-16.0.0-7397.gb86e691b.el 1.7 MB/s | 12 MB 00:07 2020-11-20T12:11:45.481 INFO:teuthology.orchestra.run.smithi066.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 3.5 MB/s | 198 kB 00:00 2020-11-20T12:11:45.537 INFO:teuthology.orchestra.run.smithi066.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 492 kB/s | 27 kB 00:00 2020-11-20T12:11:45.547 INFO:teuthology.orchestra.run.smithi132.stdout:(18/133): python3-ceph-common-16.0.0-7397.gb86e 553 kB/s | 73 kB 00:00 2020-11-20T12:11:45.584 INFO:teuthology.orchestra.run.smithi066.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 189 kB/s | 8.8 kB 00:00 2020-11-20T12:11:45.601 INFO:teuthology.orchestra.run.smithi132.stdout:(19/133): python3-cephfs-16.0.0-7397.gb86e691b. 1.6 MB/s | 204 kB 00:00 2020-11-20T12:11:45.633 INFO:teuthology.orchestra.run.smithi066.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.1 MB/s | 57 kB 00:00 2020-11-20T12:11:45.657 INFO:teuthology.orchestra.run.smithi132.stdout:(20/133): python3-rados-16.0.0-7397.gb86e691b.e 3.3 MB/s | 375 kB 00:00 2020-11-20T12:11:45.708 INFO:teuthology.orchestra.run.smithi132.stdout:(21/133): python3-rgw-16.0.0-7397.gb86e691b.el8 2.2 MB/s | 113 kB 00:00 2020-11-20T12:11:45.715 INFO:teuthology.orchestra.run.smithi066.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.4 MB/s | 116 kB 00:00 2020-11-20T12:11:45.749 INFO:teuthology.orchestra.run.smithi066.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 9.1 MB/s | 315 kB 00:00 2020-11-20T12:11:45.754 INFO:teuthology.orchestra.run.smithi132.stdout:(22/133): python3-rbd-16.0.0-7397.gb86e691b.el8 2.3 MB/s | 353 kB 00:00 2020-11-20T12:11:45.759 INFO:teuthology.orchestra.run.smithi132.stdout:(23/133): rbd-fuse-16.0.0-7397.gb86e691b.el8.x8 1.7 MB/s | 88 kB 00:00 2020-11-20T12:11:45.767 INFO:teuthology.orchestra.run.smithi066.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 10 MB/s | 181 kB 00:00 2020-11-20T12:11:45.783 INFO:teuthology.orchestra.run.smithi066.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 3.5 MB/s | 59 kB 00:00 2020-11-20T12:11:45.800 INFO:teuthology.orchestra.run.smithi066.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 4.4 MB/s | 75 kB 00:00 2020-11-20T12:11:45.812 INFO:teuthology.orchestra.run.smithi132.stdout:(24/133): rbd-nbd-16.0.0-7397.gb86e691b.el8.x86 3.2 MB/s | 171 kB 00:00 2020-11-20T12:11:45.817 INFO:teuthology.orchestra.run.smithi066.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-11-20T12:11:45.837 INFO:teuthology.orchestra.run.smithi066.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.5 MB/s | 44 kB 00:00 2020-11-20T12:11:45.852 INFO:teuthology.orchestra.run.smithi066.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 10 MB/s | 185 kB 00:00 2020-11-20T12:11:45.853 INFO:teuthology.orchestra.run.smithi132.stdout:(25/133): ceph-grafana-dashboards-16.0.0-7397.g 578 kB/s | 24 kB 00:00 2020-11-20T12:11:45.868 INFO:teuthology.orchestra.run.smithi066.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.9 MB/s | 33 kB 00:00 2020-11-20T12:11:45.885 INFO:teuthology.orchestra.run.smithi066.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 978 kB/s | 16 kB 00:00 2020-11-20T12:11:45.889 INFO:teuthology.orchestra.run.smithi132.stdout:(26/133): ceph-mgr-cephadm-16.0.0-7397.gb86e691 1.8 MB/s | 66 kB 00:00 2020-11-20T12:11:45.903 INFO:teuthology.orchestra.run.smithi066.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 7.9 MB/s | 145 kB 00:00 2020-11-20T12:11:45.937 INFO:teuthology.orchestra.run.smithi066.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 11 MB/s | 384 kB 00:00 2020-11-20T12:11:45.954 INFO:teuthology.orchestra.run.smithi066.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.4 MB/s | 40 kB 00:00 2020-11-20T12:11:45.987 INFO:teuthology.orchestra.run.smithi066.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 10 MB/s | 355 kB 00:00 2020-11-20T12:11:46.004 INFO:teuthology.orchestra.run.smithi066.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 4.7 MB/s | 81 kB 00:00 2020-11-20T12:11:46.020 INFO:teuthology.orchestra.run.smithi066.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 684 kB/s | 11 kB 00:00 2020-11-20T12:11:46.037 INFO:teuthology.orchestra.run.smithi066.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 1.1 MB/s | 18 kB 00:00 2020-11-20T12:11:46.120 INFO:teuthology.orchestra.run.smithi066.stdout:(50/133): python3-kubernetes-11.0.0-2.el8.noarc 14 MB/s | 1.2 MB 00:00 2020-11-20T12:11:46.138 INFO:teuthology.orchestra.run.smithi066.stdout:(51/133): python3-logutils-0.3.5-11.el8.noarch. 2.8 MB/s | 49 kB 00:00 2020-11-20T12:11:46.155 INFO:teuthology.orchestra.run.smithi066.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 3.2 MB/s | 59 kB 00:00 2020-11-20T12:11:46.188 INFO:teuthology.orchestra.run.smithi066.stdout:(53/133): python3-pecan-1.3.2-9.el8.noarch.rpm 8.4 MB/s | 283 kB 00:00 2020-11-20T12:11:46.205 INFO:teuthology.orchestra.run.smithi066.stdout:(54/133): python3-portend-2.6-1.el8.noarch.rpm 954 kB/s | 16 kB 00:00 2020-11-20T12:11:46.222 INFO:teuthology.orchestra.run.smithi066.stdout:(55/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.8 MB/s | 48 kB 00:00 2020-11-20T12:11:46.238 INFO:teuthology.orchestra.run.smithi066.stdout:(56/133): python3-repoze-lru-0.7-6.el8.noarch.r 2.0 MB/s | 34 kB 00:00 2020-11-20T12:11:46.256 INFO:teuthology.orchestra.run.smithi066.stdout:(57/133): python3-routes-2.4.1-12.el8.noarch.rp 11 MB/s | 196 kB 00:00 2020-11-20T12:11:46.273 INFO:teuthology.orchestra.run.smithi066.stdout:(58/133): python3-rsa-3.4.2-15.el8.noarch.rpm 4.2 MB/s | 73 kB 00:00 2020-11-20T12:11:46.290 INFO:teuthology.orchestra.run.smithi066.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 1.1 MB/s | 19 kB 00:00 2020-11-20T12:11:46.306 INFO:teuthology.orchestra.run.smithi066.stdout:(60/133): python3-singledispatch-3.4.0.3-18.el8 1.4 MB/s | 24 kB 00:00 2020-11-20T12:11:46.323 INFO:teuthology.orchestra.run.smithi066.stdout:(61/133): python3-tempora-1.14.1-5.el8.noarch.r 1.7 MB/s | 29 kB 00:00 2020-11-20T12:11:46.340 INFO:teuthology.orchestra.run.smithi066.stdout:(62/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.6 MB/s | 27 kB 00:00 2020-11-20T12:11:46.360 INFO:teuthology.orchestra.run.smithi066.stdout:(63/133): python3-waitress-1.2.1-2.el8.1.noarch 13 MB/s | 241 kB 00:00 2020-11-20T12:11:46.377 INFO:teuthology.orchestra.run.smithi066.stdout:(64/133): python3-webob-1.8.5-1.el8.1.noarch.rp 13 MB/s | 251 kB 00:00 2020-11-20T12:11:46.394 INFO:teuthology.orchestra.run.smithi066.stdout:(65/133): python3-websocket-client-0.56.0-5.el8 3.6 MB/s | 61 kB 00:00 2020-11-20T12:11:46.397 INFO:teuthology.orchestra.run.smithi093.stdout:Transaction test succeeded. 2020-11-20T12:11:46.401 INFO:teuthology.orchestra.run.smithi093.stdout:Running transaction 2020-11-20T12:11:46.410 INFO:teuthology.orchestra.run.smithi066.stdout:(66/133): python3-webtest-2.0.33-1.el8.noarch.r 4.9 MB/s | 85 kB 00:00 2020-11-20T12:11:46.427 INFO:teuthology.orchestra.run.smithi066.stdout:(67/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.4 MB/s | 23 kB 00:00 2020-11-20T12:11:46.447 INFO:teuthology.orchestra.run.smithi066.stdout:(68/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.5 MB/s | 69 kB 00:00 2020-11-20T12:11:46.451 INFO:teuthology.orchestra.run.smithi132.stdout:(27/133): ceph-mgr-dashboard-16.0.0-7397.gb86e6 5.6 MB/s | 3.2 MB 00:00 2020-11-20T12:11:46.490 INFO:teuthology.orchestra.run.smithi066.stdout:(69/133): automake-1.16.1-6.el8.noarch.rpm 17 MB/s | 713 kB 00:00 2020-11-20T12:11:46.801 INFO:teuthology.orchestra.run.smithi066.stdout:(70/133): python3-webencodings-0.5.1-6.el8.noar 1.0 MB/s | 27 kB 00:00 2020-11-20T12:11:46.801 INFO:teuthology.orchestra.run.smithi066.stdout:(71/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 44 MB/s | 1.5 MB 00:00 2020-11-20T12:11:46.802 INFO:teuthology.orchestra.run.smithi066.stdout:(72/133): jq-1.5-12.el8.x86_64.rpm 6.0 MB/s | 161 kB 00:00 2020-11-20T12:11:46.802 INFO:teuthology.orchestra.run.smithi066.stdout:(73/133): python3-pyOpenSSL-18.0.0-1.el8.noarch 3.8 MB/s | 103 kB 00:00 2020-11-20T12:11:46.802 INFO:teuthology.orchestra.run.smithi066.stdout:(74/133): python3-werkzeug-0.12.2-4.el8.noarch. 16 MB/s | 457 kB 00:00 2020-11-20T12:11:46.802 INFO:teuthology.orchestra.run.smithi066.stdout:(75/133): python3-mako-1.0.6-13.el8.noarch.rpm 5.9 MB/s | 157 kB 00:00 2020-11-20T12:11:46.803 INFO:teuthology.orchestra.run.smithi066.stdout:(76/133): python3-jsonpatch-1.21-2.el8.noarch.r 1.0 MB/s | 27 kB 00:00 2020-11-20T12:11:46.803 INFO:teuthology.orchestra.run.smithi066.stdout:(77/133): python3-jsonpointer-1.10-11.el8.noarc 784 kB/s | 20 kB 00:00 2020-11-20T12:11:46.803 INFO:teuthology.orchestra.run.smithi066.stdout:(78/133): python3-html5lib-0.999999999-6.el8.no 7.7 MB/s | 214 kB 00:00 2020-11-20T12:11:46.803 INFO:teuthology.orchestra.run.smithi066.stdout:(79/133): python3-pyasn1-0.3.7-6.el8.noarch.rpm 4.8 MB/s | 126 kB 00:00 2020-11-20T12:11:46.803 INFO:teuthology.orchestra.run.smithi066.stdout:(80/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.0 MB/s | 54 kB 00:00 2020-11-20T12:11:46.814 INFO:teuthology.orchestra.run.smithi066.stdout:(81/133): python3-pyasn1-modules-0.3.7-6.el8.no 4.1 MB/s | 110 kB 00:00 2020-11-20T12:11:46.840 INFO:teuthology.orchestra.run.smithi066.stdout:(82/133): python3-prettytable-0.7.2-14.el8.noar 1.7 MB/s | 44 kB 00:00 2020-11-20T12:11:46.867 INFO:teuthology.orchestra.run.smithi066.stdout:(83/133): python3-markupsafe-0.23-19.el8.x86_64 1.4 MB/s | 39 kB 00:00 2020-11-20T12:11:46.896 INFO:teuthology.orchestra.run.smithi066.stdout:(84/133): flex-2.6.1-9.el8.x86_64.rpm 11 MB/s | 320 kB 00:00 2020-11-20T12:11:46.923 INFO:teuthology.orchestra.run.smithi066.stdout:(85/133): librdkafka-0.11.4-1.el8.x86_64.rpm 13 MB/s | 353 kB 00:00 2020-11-20T12:11:46.953 INFO:teuthology.orchestra.run.smithi066.stdout:(86/133): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2020-11-20T12:11:46.980 INFO:teuthology.orchestra.run.smithi066.stdout:(87/133): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2020-11-20T12:11:46.981 INFO:teuthology.orchestra.run.smithi132.stdout:(28/133): rbd-mirror-16.0.0-7397.gb86e691b.el8. 2.6 MB/s | 3.2 MB 00:01 2020-11-20T12:11:47.031 INFO:teuthology.orchestra.run.smithi066.stdout:(88/133): ceph-mgr-diskprediction-local-16.0.0- 5.1 MB/s | 8.6 MB 00:01 2020-11-20T12:11:47.079 INFO:teuthology.orchestra.run.smithi066.stdout:(89/133): python3-jinja2-2.10.1-2.el8_0.noarch. 5.4 MB/s | 538 kB 00:00 2020-11-20T12:11:47.091 INFO:teuthology.orchestra.run.smithi132.stdout:(29/133): ceph-mgr-modules-core-16.0.0-7397.gb8 1.8 MB/s | 198 kB 00:00 2020-11-20T12:11:47.119 INFO:teuthology.orchestra.run.smithi066.stdout:(90/133): python3-numpy-f2py-1.14.3-9.el8.x86_6 6.7 MB/s | 225 kB 00:00 2020-11-20T12:11:47.140 INFO:teuthology.orchestra.run.smithi132.stdout:(30/133): ceph-mgr-rook-16.0.0-7397.gb86e691b.e 539 kB/s | 27 kB 00:00 2020-11-20T12:11:47.186 INFO:teuthology.orchestra.run.smithi066.stdout:(91/133): python3-babel-2.5.1-5.el8.noarch.rpm 72 MB/s | 4.8 MB 00:00 2020-11-20T12:11:47.190 INFO:teuthology.orchestra.run.smithi132.stdout:(31/133): ceph-prometheus-alerts-16.0.0-7397.gb 176 kB/s | 8.8 kB 00:00 2020-11-20T12:11:47.217 INFO:teuthology.orchestra.run.smithi066.stdout:(92/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 8.5 MB/s | 259 kB 00:00 2020-11-20T12:11:47.241 INFO:teuthology.orchestra.run.smithi132.stdout:(32/133): cephadm-16.0.0-7397.gb86e691b.el8.noa 1.1 MB/s | 57 kB 00:00 2020-11-20T12:11:47.341 INFO:teuthology.orchestra.run.smithi132.stdout:(33/133): fmt-6.2.1-1.el8.x86_64.rpm 1.2 MB/s | 116 kB 00:00 2020-11-20T12:11:47.352 INFO:teuthology.orchestra.run.smithi066.stdout:(93/133): python3-scipy-1.0.0-20.module+el8.1.0 45 MB/s | 15 MB 00:00 2020-11-20T12:11:47.378 INFO:teuthology.orchestra.run.smithi132.stdout:(34/133): gperftools-libs-2.7-6.el8.x86_64.rpm 7.7 MB/s | 315 kB 00:00 2020-11-20T12:11:47.396 INFO:teuthology.orchestra.run.smithi066.stdout:(94/133): python3-numpy-1.14.3-9.el8.x86_64.rpm 21 MB/s | 3.7 MB 00:00 2020-11-20T12:11:47.400 INFO:teuthology.orchestra.run.smithi132.stdout:(35/133): leveldb-1.22-1.el8.x86_64.rpm 8.4 MB/s | 181 kB 00:00 2020-11-20T12:11:47.420 INFO:teuthology.orchestra.run.smithi132.stdout:(36/133): liboath-2.6.2-3.el8.x86_64.rpm 2.9 MB/s | 59 kB 00:00 2020-11-20T12:11:47.437 INFO:teuthology.orchestra.run.smithi066.stdout:(95/133): openblas-threads-0.3.3-5.el8.x86_64.r 51 MB/s | 4.4 MB 00:00 2020-11-20T12:11:47.440 INFO:teuthology.orchestra.run.smithi132.stdout:(37/133): libunwind-1.3.1-3.el8.x86_64.rpm 3.7 MB/s | 75 kB 00:00 2020-11-20T12:11:47.459 INFO:teuthology.orchestra.run.smithi132.stdout:(38/133): python3-apipkg-1.5-6.el8.noarch.rpm 1.1 MB/s | 21 kB 00:00 2020-11-20T12:11:47.466 INFO:teuthology.orchestra.run.smithi066.stdout:(96/133): socat-1.7.3.3-2.el8.x86_64.rpm 11 MB/s | 302 kB 00:00 2020-11-20T12:11:47.478 INFO:teuthology.orchestra.run.smithi066.stdout:(97/133): openblas-0.3.3-5.el8.x86_64.rpm 51 MB/s | 4.3 MB 00:00 2020-11-20T12:11:47.479 INFO:teuthology.orchestra.run.smithi132.stdout:(39/133): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 2.1 MB/s | 44 kB 00:00 2020-11-20T12:11:47.500 INFO:teuthology.orchestra.run.smithi132.stdout:(40/133): python3-beautifulsoup4-4.6.3-2.el8.1. 8.7 MB/s | 185 kB 00:00 2020-11-20T12:11:47.511 INFO:teuthology.orchestra.run.smithi066.stdout:(98/133): oniguruma-6.8.2-2.el8.x86_64.rpm 4.1 MB/s | 187 kB 00:00 2020-11-20T12:11:47.520 INFO:teuthology.orchestra.run.smithi132.stdout:(41/133): python3-cachetools-3.1.1-4.el8.noarch 1.6 MB/s | 33 kB 00:00 2020-11-20T12:11:47.522 INFO:teuthology.orchestra.run.smithi066.stdout:(99/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 5.2 MB/s | 238 kB 00:00 2020-11-20T12:11:47.538 INFO:teuthology.orchestra.run.smithi066.stdout:(100/133): libverto-devel-0.3.0-5.el8.x86_64.rp 662 kB/s | 18 kB 00:00 2020-11-20T12:11:47.540 INFO:teuthology.orchestra.run.smithi132.stdout:(42/133): python3-certifi-2018.10.15-7.el8.noar 834 kB/s | 16 kB 00:00 2020-11-20T12:11:47.556 INFO:teuthology.orchestra.run.smithi066.stdout:(101/133): python3-asn1crypto-0.24.0-3.el8.noar 5.4 MB/s | 181 kB 00:00 2020-11-20T12:11:47.561 INFO:teuthology.orchestra.run.smithi132.stdout:(43/133): python3-cheroot-8.2.1-1.el8.noarch.rp 6.9 MB/s | 145 kB 00:00 2020-11-20T12:11:47.573 INFO:teuthology.orchestra.run.smithi066.stdout:(102/133): python3-requests-oauthlib-1.0.0-1.el 1.2 MB/s | 43 kB 00:00 2020-11-20T12:11:47.590 INFO:teuthology.orchestra.run.smithi066.stdout:(103/133): fuse-2.9.7-12.el8.x86_64.rpm 2.4 MB/s | 83 kB 00:00 2020-11-20T12:11:47.601 INFO:teuthology.orchestra.run.smithi132.stdout:(44/133): python3-cherrypy-18.4.0-1.el8.noarch. 9.4 MB/s | 384 kB 00:00 2020-11-20T12:11:47.608 INFO:teuthology.orchestra.run.smithi066.stdout:(104/133): python3-pycparser-2.14-14.el8.noarch 3.1 MB/s | 109 kB 00:00 2020-11-20T12:11:47.621 INFO:teuthology.orchestra.run.smithi132.stdout:(45/133): python3-cssselect-0.9.2-10.el8.noarch 2.0 MB/s | 40 kB 00:00 2020-11-20T12:11:47.623 INFO:teuthology.orchestra.run.smithi066.stdout:(105/133): keyutils-libs-devel-1.5.10-6.el8.x86 1.4 MB/s | 48 kB 00:00 2020-11-20T12:11:47.641 INFO:teuthology.orchestra.run.smithi066.stdout:(106/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.2 MB/s | 43 kB 00:00 2020-11-20T12:11:47.657 INFO:teuthology.orchestra.run.smithi066.stdout:(107/133): python3-oauthlib-2.1.0-1.el8.noarch. 4.3 MB/s | 155 kB 00:00 2020-11-20T12:11:47.661 INFO:teuthology.orchestra.run.smithi132.stdout:(46/133): python3-execnet-1.7.1-1.el8.noarch.rp 8.7 MB/s | 355 kB 00:00 2020-11-20T12:11:47.675 INFO:teuthology.orchestra.run.smithi066.stdout:(108/133): fuse-common-3.2.1-12.el8.x86_64.rpm 628 kB/s | 21 kB 00:00 2020-11-20T12:11:47.682 INFO:teuthology.orchestra.run.smithi132.stdout:(47/133): python3-google-auth-1.1.1-10.el8.noar 3.9 MB/s | 81 kB 00:00 2020-11-20T12:11:47.692 INFO:teuthology.orchestra.run.smithi066.stdout:(109/133): libsepol-devel-2.9-1.el8.x86_64.rpm 2.5 MB/s | 86 kB 00:00 2020-11-20T12:11:47.701 INFO:teuthology.orchestra.run.smithi132.stdout:(48/133): python3-jaraco-6.2-6.el8.noarch.rpm 566 kB/s | 11 kB 00:00 2020-11-20T12:11:47.707 INFO:teuthology.orchestra.run.smithi066.stdout:(110/133): libaio-devel-0.3.112-1.el8.x86_64.rp 579 kB/s | 19 kB 00:00 2020-11-20T12:11:47.721 INFO:teuthology.orchestra.run.smithi132.stdout:(49/133): python3-jaraco-functools-2.0-4.el8.no 892 kB/s | 18 kB 00:00 2020-11-20T12:11:47.738 INFO:teuthology.orchestra.run.smithi066.stdout:(111/133): libselinux-devel-2.9-3.el8.x86_64.rp 4.5 MB/s | 199 kB 00:00 2020-11-20T12:11:47.748 INFO:teuthology.orchestra.run.smithi066.stdout:(112/133): python3-cryptography-2.3-3.el8.x86_6 12 MB/s | 511 kB 00:00 2020-11-20T12:11:47.771 INFO:teuthology.orchestra.run.smithi066.stdout:(113/133): zlib-devel-1.2.11-16.el8_2.x86_64.rp 1.8 MB/s | 57 kB 00:00 2020-11-20T12:11:47.783 INFO:teuthology.orchestra.run.smithi066.stdout:(114/133): libuuid-devel-2.32.1-24.el8.x86_64.r 3.4 MB/s | 96 kB 00:00 2020-11-20T12:11:47.794 INFO:teuthology.orchestra.run.smithi132.stdout:(50/133): ceph-mgr-diskprediction-local-16.0.0- 6.4 MB/s | 8.6 MB 00:01 2020-11-20T12:11:47.801 INFO:teuthology.orchestra.run.smithi066.stdout:(115/133): libxslt-1.1.32-5.el8.x86_64.rpm 7.0 MB/s | 250 kB 00:00 2020-11-20T12:11:47.817 INFO:teuthology.orchestra.run.smithi066.stdout:(116/133): libcom_err-devel-1.45.6-1.el8.x86_64 1.1 MB/s | 38 kB 00:00 2020-11-20T12:11:47.821 INFO:teuthology.orchestra.run.smithi132.stdout:(51/133): python3-kubernetes-11.0.0-2.el8.noarc 12 MB/s | 1.2 MB 00:00 2020-11-20T12:11:47.835 INFO:teuthology.orchestra.run.smithi066.stdout:(117/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 6.1 MB/s | 169 kB 00:00 2020-11-20T12:11:47.842 INFO:teuthology.orchestra.run.smithi132.stdout:(52/133): python3-more-itertools-7.2.0-3.el8.no 2.9 MB/s | 59 kB 00:00 2020-11-20T12:11:47.861 INFO:teuthology.orchestra.run.smithi066.stdout:(118/133): pcre2-devel-10.32-2.el8.x86_64.rpm 14 MB/s | 605 kB 00:00 2020-11-20T12:11:47.864 INFO:teuthology.orchestra.run.smithi132.stdout:(53/133): python3-logutils-0.3.5-11.el8.noarch. 627 kB/s | 49 kB 00:00 2020-11-20T12:11:47.881 INFO:teuthology.orchestra.run.smithi132.stdout:(54/133): python3-pecan-1.3.2-9.el8.noarch.rpm 7.0 MB/s | 283 kB 00:00 2020-11-20T12:11:47.882 INFO:teuthology.orchestra.run.smithi066.stdout:(119/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 13 MB/s | 639 kB 00:00 2020-11-20T12:11:47.884 INFO:teuthology.orchestra.run.smithi132.stdout:(55/133): python3-portend-2.6-1.el8.noarch.rpm 800 kB/s | 16 kB 00:00 2020-11-20T12:11:47.891 INFO:teuthology.orchestra.run.smithi066.stdout:(120/133): elfutils-libelf-devel-0.180-1.el8.x8 1.9 MB/s | 58 kB 00:00 2020-11-20T12:11:47.901 INFO:teuthology.orchestra.run.smithi132.stdout:(56/133): python3-remoto-1.1.4-4.el8.noarch.rpm 2.3 MB/s | 48 kB 00:00 2020-11-20T12:11:47.903 INFO:teuthology.orchestra.run.smithi132.stdout:(57/133): python3-repoze-lru-0.7-6.el8.noarch.r 1.7 MB/s | 34 kB 00:00 2020-11-20T12:11:47.908 INFO:teuthology.orchestra.run.smithi066.stdout:(121/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 8.1 MB/s | 220 kB 00:00 2020-11-20T12:11:47.922 INFO:teuthology.orchestra.run.smithi132.stdout:(58/133): python3-routes-2.4.1-12.el8.noarch.rp 9.1 MB/s | 196 kB 00:00 2020-11-20T12:11:47.927 INFO:teuthology.orchestra.run.smithi066.stdout:(122/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 6.3 MB/s | 229 kB 00:00 2020-11-20T12:11:47.944 INFO:teuthology.orchestra.run.smithi132.stdout:(59/133): python3-simplegeneric-0.8.1-17.el8.no 956 kB/s | 19 kB 00:00 2020-11-20T12:11:47.945 INFO:teuthology.orchestra.run.smithi132.stdout:(60/133): python3-rsa-3.4.2-15.el8.noarch.rpm 1.8 MB/s | 73 kB 00:00 2020-11-20T12:11:47.952 INFO:teuthology.orchestra.run.smithi066.stdout:(123/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 12 MB/s | 558 kB 00:00 2020-11-20T12:11:47.962 INFO:teuthology.orchestra.run.smithi132.stdout:(61/133): python3-singledispatch-3.4.0.3-18.el8 1.2 MB/s | 24 kB 00:00 2020-11-20T12:11:47.963 INFO:teuthology.orchestra.run.smithi132.stdout:(62/133): python3-tempora-1.14.1-5.el8.noarch.r 1.5 MB/s | 29 kB 00:00 2020-11-20T12:11:47.963 INFO:teuthology.orchestra.run.smithi066.stdout:(124/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rp 1.9 MB/s | 69 kB 00:00 2020-11-20T12:11:47.987 INFO:teuthology.orchestra.run.smithi132.stdout:(63/133): python3-trustme-0.6.0-4.el8.noarch.rp 1.4 MB/s | 27 kB 00:00 2020-11-20T12:11:48.002 INFO:teuthology.orchestra.run.smithi132.stdout:(64/133): python3-waitress-1.2.1-2.el8.1.noarch 5.9 MB/s | 241 kB 00:00 2020-11-20T12:11:48.021 INFO:teuthology.orchestra.run.smithi132.stdout:(65/133): python3-webob-1.8.5-1.el8.1.noarch.rp 6.2 MB/s | 251 kB 00:00 2020-11-20T12:11:48.023 INFO:teuthology.orchestra.run.smithi132.stdout:(66/133): python3-websocket-client-0.56.0-5.el8 3.0 MB/s | 61 kB 00:00 2020-11-20T12:11:48.046 INFO:teuthology.orchestra.run.smithi132.stdout:(67/133): python3-webtest-2.0.33-1.el8.noarch.r 4.1 MB/s | 85 kB 00:00 2020-11-20T12:11:48.046 INFO:teuthology.orchestra.run.smithi132.stdout:(68/133): python3-zc-lockfile-2.0-2.el8.noarch. 1.1 MB/s | 23 kB 00:00 2020-11-20T12:11:48.063 INFO:teuthology.orchestra.run.smithi132.stdout:(69/133): xmlstarlet-1.6.1-11.el8.x86_64.rpm 3.4 MB/s | 69 kB 00:00 2020-11-20T12:11:48.077 INFO:teuthology.orchestra.run.smithi132.stdout:(70/133): python3-cffi-1.11.5-5.el8.x86_64.rpm 7.0 MB/s | 238 kB 00:00 2020-11-20T12:11:48.099 INFO:teuthology.orchestra.run.smithi132.stdout:(71/133): libverto-devel-0.3.0-5.el8.x86_64.rpm 543 kB/s | 18 kB 00:00 2020-11-20T12:11:48.107 INFO:teuthology.orchestra.run.smithi132.stdout:(72/133): python3-asn1crypto-0.24.0-3.el8.noarc 5.8 MB/s | 181 kB 00:00 2020-11-20T12:11:48.126 INFO:teuthology.orchestra.run.smithi132.stdout:(73/133): python3-requests-oauthlib-1.0.0-1.el8 1.6 MB/s | 43 kB 00:00 2020-11-20T12:11:48.133 INFO:teuthology.orchestra.run.smithi132.stdout:(74/133): fuse-2.9.7-12.el8.x86_64.rpm 3.3 MB/s | 83 kB 00:00 2020-11-20T12:11:48.149 INFO:teuthology.orchestra.run.smithi132.stdout:(75/133): python3-pycparser-2.14-14.el8.noarch. 4.4 MB/s | 109 kB 00:00 2020-11-20T12:11:48.156 INFO:teuthology.orchestra.run.smithi132.stdout:(76/133): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.9 MB/s | 48 kB 00:00 2020-11-20T12:11:48.174 INFO:teuthology.orchestra.run.smithi132.stdout:(77/133): python3-jwt-1.6.1-2.el8.noarch.rpm 1.7 MB/s | 43 kB 00:00 2020-11-20T12:11:48.182 INFO:teuthology.orchestra.run.smithi132.stdout:(78/133): python3-oauthlib-2.1.0-1.el8.noarch.r 6.0 MB/s | 155 kB 00:00 2020-11-20T12:11:48.195 INFO:teuthology.orchestra.run.smithi132.stdout:(79/133): fuse-common-3.2.1-12.el8.x86_64.rpm 1.0 MB/s | 21 kB 00:00 2020-11-20T12:11:48.207 INFO:teuthology.orchestra.run.smithi132.stdout:(80/133): libsepol-devel-2.9-1.el8.x86_64.rpm 3.4 MB/s | 86 kB 00:00 2020-11-20T12:11:48.223 INFO:teuthology.orchestra.run.smithi132.stdout:(81/133): libaio-devel-0.3.112-1.el8.x86_64.rpm 783 kB/s | 19 kB 00:00 2020-11-20T12:11:48.231 INFO:teuthology.orchestra.run.smithi132.stdout:(82/133): libselinux-devel-2.9-3.el8.x86_64.rpm 8.0 MB/s | 199 kB 00:00 2020-11-20T12:11:48.254 INFO:teuthology.orchestra.run.smithi132.stdout:(83/133): python3-cryptography-2.3-3.el8.x86_64 18 MB/s | 511 kB 00:00 2020-11-20T12:11:48.257 INFO:teuthology.orchestra.run.smithi132.stdout:(84/133): zlib-devel-1.2.11-16.el8_2.x86_64.rpm 2.1 MB/s | 57 kB 00:00 2020-11-20T12:11:48.307 INFO:teuthology.orchestra.run.smithi066.stdout:(125/133): ceph-test-16.0.0-7397.gb86e691b.el8. 5.5 MB/s | 48 MB 00:08 2020-11-20T12:11:48.315 INFO:teuthology.orchestra.run.smithi066.stdout:(126/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 129 kB/s | 47 kB 00:00 2020-11-20T12:11:48.376 INFO:teuthology.orchestra.run.smithi066.stdout:(127/133): openssl-devel-1.1.1g-11.el8.x86_64.r 5.6 MB/s | 2.3 MB 00:00 2020-11-20T12:11:48.416 INFO:teuthology.orchestra.run.smithi066.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 43 MB/s | 1.7 MB 00:00 2020-11-20T12:11:48.445 INFO:teuthology.orchestra.run.smithi066.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 11 MB/s | 320 kB 00:00 2020-11-20T12:11:48.471 INFO:teuthology.orchestra.run.smithi066.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 5.2 MB/s | 141 kB 00:00 2020-11-20T12:11:48.513 INFO:teuthology.orchestra.run.smithi066.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 58 MB/s | 2.4 MB 00:00 2020-11-20T12:11:48.617 INFO:teuthology.orchestra.run.smithi132.stdout:(85/133): ceph-test-16.0.0-7397.gb86e691b.el8.x 6.0 MB/s | 48 MB 00:07 2020-11-20T12:11:48.646 INFO:teuthology.orchestra.run.smithi066.stdout:(132/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 7.3 MB/s | 2.4 MB 00:00 2020-11-20T12:11:48.686 INFO:teuthology.orchestra.run.smithi132.stdout:(86/133): libuuid-devel-2.32.1-24.el8.x86_64.rp 221 kB/s | 96 kB 00:00 2020-11-20T12:11:48.694 INFO:teuthology.orchestra.run.smithi132.stdout:(87/133): libxslt-1.1.32-5.el8.x86_64.rpm 574 kB/s | 250 kB 00:00 2020-11-20T12:11:48.725 INFO:teuthology.orchestra.run.smithi132.stdout:(88/133): pcre2-devel-10.32-2.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2020-11-20T12:11:48.726 INFO:teuthology.orchestra.run.smithi132.stdout:(89/133): libquadmath-8.3.1-5.1.el8.x86_64.rpm 4.6 MB/s | 169 kB 00:00 2020-11-20T12:11:48.732 INFO:teuthology.orchestra.run.smithi132.stdout:(90/133): libcom_err-devel-1.45.6-1.el8.x86_64. 333 kB/s | 38 kB 00:00 2020-11-20T12:11:48.756 INFO:teuthology.orchestra.run.smithi132.stdout:(91/133): elfutils-libelf-devel-0.180-1.el8.x86 1.9 MB/s | 58 kB 00:00 2020-11-20T12:11:48.758 INFO:teuthology.orchestra.run.smithi132.stdout:(92/133): libgfortran-8.3.1-5.1.el8.x86_64.rpm 19 MB/s | 639 kB 00:00 2020-11-20T12:11:48.769 INFO:teuthology.orchestra.run.smithi132.stdout:(93/133): pcre2-utf32-10.32-2.el8.x86_64.rpm 5.8 MB/s | 220 kB 00:00 2020-11-20T12:11:48.785 INFO:teuthology.orchestra.run.smithi132.stdout:(94/133): pcre2-utf16-10.32-2.el8.x86_64.rpm 7.9 MB/s | 229 kB 00:00 2020-11-20T12:11:48.797 INFO:teuthology.orchestra.run.smithi132.stdout:(95/133): krb5-devel-1.18.2-5.el8.x86_64.rpm 14 MB/s | 558 kB 00:00 2020-11-20T12:11:48.798 INFO:teuthology.orchestra.run.smithi132.stdout:(96/133): xfsprogs-devel-5.0.0-4.el8.x86_64.rpm 2.8 MB/s | 69 kB 00:00 2020-11-20T12:11:48.814 INFO:teuthology.orchestra.run.smithi066.stdout:(133/133): librados2-16.0.0-7397.gb86e691b.el8. 7.4 MB/s | 3.7 MB 00:00 2020-11-20T12:11:48.817 INFO:teuthology.orchestra.run.smithi132.stdout:(97/133): librabbitmq-0.9.0-2.el8.x86_64.rpm 1.5 MB/s | 47 kB 00:00 2020-11-20T12:11:48.818 INFO:teuthology.orchestra.run.smithi066.stdout:-------------------------------------------------------------------------------- 2020-11-20T12:11:48.818 INFO:teuthology.orchestra.run.smithi066.stdout:Total 13 MB/s | 199 MB 00:15 2020-11-20T12:11:48.837 INFO:teuthology.orchestra.run.smithi132.stdout:(98/133): automake-1.16.1-6.el8.noarch.rpm 18 MB/s | 713 kB 00:00 2020-11-20T12:11:48.844 INFO:teuthology.orchestra.run.smithi132.stdout:(99/133): python3-webencodings-0.5.1-6.el8.noar 992 kB/s | 27 kB 00:00 2020-11-20T12:11:48.861 INFO:teuthology.orchestra.run.smithi132.stdout:(100/133): openssl-devel-1.1.1g-11.el8.x86_64.r 36 MB/s | 2.3 MB 00:00 2020-11-20T12:11:48.873 INFO:teuthology.orchestra.run.smithi132.stdout:(101/133): jq-1.5-12.el8.x86_64.rpm 5.4 MB/s | 161 kB 00:00 2020-11-20T12:11:48.888 INFO:teuthology.orchestra.run.smithi132.stdout:(102/133): python3-lxml-4.2.3-1.el8.x86_64.rpm 30 MB/s | 1.5 MB 00:00 2020-11-20T12:11:48.888 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction check 2020-11-20T12:11:48.893 INFO:teuthology.orchestra.run.smithi132.stdout:(103/133): python3-pyOpenSSL-18.0.0-1.el8.noarc 3.6 MB/s | 103 kB 00:00 2020-11-20T12:11:48.915 INFO:teuthology.orchestra.run.smithi132.stdout:(104/133): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2020-11-20T12:11:48.916 INFO:teuthology.orchestra.run.smithi132.stdout:(105/133): python3-mako-1.0.6-13.el8.noarch.rpm 6.6 MB/s | 157 kB 00:00 2020-11-20T12:11:48.921 INFO:teuthology.orchestra.run.smithi132.stdout:(106/133): python3-jsonpatch-1.21-2.el8.noarch. 970 kB/s | 27 kB 00:00 2020-11-20T12:11:48.946 INFO:teuthology.orchestra.run.smithi132.stdout:(107/133): python3-jsonpointer-1.10-11.el8.noar 628 kB/s | 20 kB 00:00 2020-11-20T12:11:48.947 INFO:teuthology.orchestra.run.smithi132.stdout:(108/133): python3-html5lib-0.999999999-6.el8.n 6.5 MB/s | 214 kB 00:00 2020-11-20T12:11:48.958 INFO:teuthology.orchestra.run.smithi132.stdout:(109/133): python3-pyasn1-0.3.7-6.el8.noarch.rp 3.3 MB/s | 126 kB 00:00 2020-11-20T12:11:48.972 INFO:teuthology.orchestra.run.smithi132.stdout:(110/133): python3-pytz-2017.2-9.el8.noarch.rpm 2.0 MB/s | 54 kB 00:00 2020-11-20T12:11:48.983 INFO:teuthology.orchestra.run.smithi132.stdout:(111/133): python3-pyasn1-modules-0.3.7-6.el8.n 3.1 MB/s | 110 kB 00:00 2020-11-20T12:11:48.984 INFO:teuthology.orchestra.run.smithi132.stdout:(112/133): python3-prettytable-0.7.2-14.el8.noa 1.6 MB/s | 44 kB 00:00 2020-11-20T12:11:49.003 INFO:teuthology.orchestra.run.smithi132.stdout:(113/133): python3-markupsafe-0.23-19.el8.x86_6 1.2 MB/s | 39 kB 00:00 2020-11-20T12:11:49.014 INFO:teuthology.orchestra.run.smithi132.stdout:(114/133): flex-2.6.1-9.el8.x86_64.rpm 9.9 MB/s | 320 kB 00:00 2020-11-20T12:11:49.017 INFO:teuthology.orchestra.run.smithi132.stdout:(115/133): librdkafka-0.11.4-1.el8.x86_64.rpm 11 MB/s | 353 kB 00:00 2020-11-20T12:11:49.028 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction check succeeded. 2020-11-20T12:11:49.028 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction test 2020-11-20T12:11:49.044 INFO:teuthology.orchestra.run.smithi132.stdout:(116/133): bison-3.0.4-10.el8.x86_64.rpm 17 MB/s | 688 kB 00:00 2020-11-20T12:11:49.048 INFO:teuthology.orchestra.run.smithi132.stdout:(117/133): libtool-2.4.6-25.el8.x86_64.rpm 21 MB/s | 709 kB 00:00 2020-11-20T12:11:49.064 INFO:teuthology.orchestra.run.smithi132.stdout:(118/133): python3-jinja2-2.10.1-2.el8_0.noarch 14 MB/s | 538 kB 00:00 2020-11-20T12:11:49.077 INFO:teuthology.orchestra.run.smithi132.stdout:(119/133): python3-numpy-f2py-1.14.3-9.el8.x86_ 9.0 MB/s | 225 kB 00:00 2020-11-20T12:11:49.102 INFO:teuthology.orchestra.run.smithi132.stdout:(120/133): lttng-ust-2.8.1-11.el8.x86_64.rpm 10 MB/s | 259 kB 00:00 2020-11-20T12:11:49.139 INFO:teuthology.orchestra.run.smithi132.stdout:(121/133): python3-babel-2.5.1-5.el8.noarch.rpm 67 MB/s | 4.8 MB 00:00 2020-11-20T12:11:49.176 INFO:teuthology.orchestra.run.smithi132.stdout:(122/133): python3-numpy-1.14.3-9.el8.x86_64.rp 50 MB/s | 3.7 MB 00:00 2020-11-20T12:11:49.215 INFO:teuthology.orchestra.run.smithi132.stdout:(123/133): openblas-threads-0.3.3-5.el8.x86_64. 58 MB/s | 4.4 MB 00:00 2020-11-20T12:11:49.339 INFO:teuthology.orchestra.run.smithi132.stdout:(124/133): python3-scipy-1.0.0-20.module+el8.1. 49 MB/s | 15 MB 00:00 2020-11-20T12:11:49.343 INFO:teuthology.orchestra.run.smithi132.stdout:(125/133): socat-1.7.3.3-2.el8.x86_64.rpm 2.3 MB/s | 302 kB 00:00 2020-11-20T12:11:49.365 INFO:teuthology.orchestra.run.smithi132.stdout:(126/133): openblas-0.3.3-5.el8.x86_64.rpm 23 MB/s | 4.3 MB 00:00 2020-11-20T12:11:49.366 INFO:teuthology.orchestra.run.smithi132.stdout:(127/133): oniguruma-6.8.2-2.el8.x86_64.rpm 6.8 MB/s | 187 kB 00:00 2020-11-20T12:11:49.399 INFO:teuthology.orchestra.run.smithi132.stdout:(128/133): NetworkManager-libnm-1.26.0-9.el8_3. 55 MB/s | 1.7 MB 00:00 2020-11-20T12:11:49.421 INFO:teuthology.orchestra.run.smithi132.stdout:(129/133): NetworkManager-tui-1.26.0-9.el8_3.x8 14 MB/s | 320 kB 00:00 2020-11-20T12:11:49.442 INFO:teuthology.orchestra.run.smithi132.stdout:(130/133): NetworkManager-team-1.26.0-9.el8_3.x 6.4 MB/s | 141 kB 00:00 2020-11-20T12:11:49.478 INFO:teuthology.orchestra.run.smithi132.stdout:(131/133): NetworkManager-1.26.0-9.el8_3.x86_64 69 MB/s | 2.4 MB 00:00 2020-11-20T12:11:49.616 INFO:teuthology.orchestra.run.smithi132.stdout:(132/133): librados2-16.0.0-7397.gb86e691b.el8. 14 MB/s | 3.7 MB 00:00 2020-11-20T12:11:49.787 INFO:teuthology.orchestra.run.smithi132.stdout:(133/133): librbd1-16.0.0-7397.gb86e691b.el8.x8 5.7 MB/s | 2.4 MB 00:00 2020-11-20T12:11:49.790 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2020-11-20T12:11:49.790 INFO:teuthology.orchestra.run.smithi132.stdout:Total 11 MB/s | 199 MB 00:17 2020-11-20T12:11:49.848 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2020-11-20T12:11:49.977 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2020-11-20T12:11:49.977 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2020-11-20T12:11:50.652 INFO:teuthology.orchestra.run.smithi066.stdout:Transaction test succeeded. 2020-11-20T12:11:50.656 INFO:teuthology.orchestra.run.smithi066.stdout:Running transaction 2020-11-20T12:11:51.354 INFO:teuthology.orchestra.run.smithi093.stdout: Preparing : 1/1 2020-11-20T12:11:51.406 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T12:11:51.578 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T12:11:51.608 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2020-11-20T12:11:51.649 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2020-11-20T12:11:51.764 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T12:11:51.915 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T12:11:52.141 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 4/139 2020-11-20T12:11:52.332 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T12:11:52.678 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T12:11:52.893 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:11:53.161 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:11:53.368 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:11:53.462 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:11:53.635 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:11:53.719 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:11:53.919 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T12:11:54.118 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T12:11:54.496 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T12:11:54.676 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:11:54.784 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:11:54.955 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T12:11:55.162 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T12:11:55.301 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T12:11:55.695 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T12:11:55.867 INFO:teuthology.orchestra.run.smithi066.stdout: Preparing : 1/1 2020-11-20T12:11:55.935 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T12:11:55.959 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T12:11:56.011 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T12:11:56.089 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T12:11:56.301 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:11:56.377 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T12:11:56.513 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T12:11:56.551 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:11:56.683 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2020-11-20T12:11:56.719 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 4/139 2020-11-20T12:11:56.732 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: fmt-6.2.1-1.el8.x86_64 1/1 2020-11-20T12:11:56.881 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T12:11:56.907 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:11:56.919 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/139 2020-11-20T12:11:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/139 2020-11-20T12:11:57.093 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T12:11:57.232 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T12:11:57.292 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : leveldb-1.22-1.el8.x86_64 3/139 2020-11-20T12:11:57.325 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/139 2020-11-20T12:11:57.384 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T12:11:57.452 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T12:11:57.539 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:11:57.852 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/139 2020-11-20T12:11:57.853 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:11:57.894 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T12:11:58.029 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T12:11:58.056 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:11:58.242 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T12:11:58.242 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:11:58.315 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:11:58.346 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 5/139 2020-11-20T12:11:58.408 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:11:58.560 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T12:11:58.569 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:11:58.609 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T12:11:58.681 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:11:58.701 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T12:11:58.885 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:11:58.987 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:11:59.218 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:11:59.262 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T12:11:59.344 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T12:11:59.397 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T12:11:59.442 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 9/139 2020-11-20T12:11:59.717 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 10/139 2020-11-20T12:11:59.719 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/139 2020-11-20T12:11:59.839 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:11:59.913 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.9.0-2.el8.x86_64 10/139 2020-11-20T12:11:59.932 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 22/139 2020-11-20T12:11:59.938 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:12:00.074 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:12:00.097 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 23/139 2020-11-20T12:12:00.177 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T12:12:00.195 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:12:00.274 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/139 2020-11-20T12:12:00.372 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 12/139 2020-11-20T12:12:00.402 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T12:12:00.538 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2020-11-20T12:12:00.539 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T12:12:00.587 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/139 2020-11-20T12:12:00.760 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T12:12:00.793 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/139 2020-11-20T12:12:00.950 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T12:12:00.991 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T12:12:01.145 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 14/139 2020-11-20T12:12:01.180 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T12:12:01.214 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T12:12:01.297 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T12:12:01.304 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T12:12:01.385 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T12:12:01.450 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 15/139 2020-11-20T12:12:01.622 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:12:01.741 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:12:01.876 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:12:02.027 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:12:02.190 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T12:12:02.244 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:12:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.26.0-9.el8_3.x86_64 16/139 2020-11-20T12:12:02.389 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T12:12:02.516 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 17/139 2020-11-20T12:12:02.521 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/139 2020-11-20T12:12:02.549 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 17/139 2020-11-20T12:12:02.647 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T12:12:02.789 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/139 2020-11-20T12:12:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 18/139 2020-11-20T12:12:03.048 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/139 2020-11-20T12:12:04.345 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 18/139 2020-11-20T12:12:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T12:12:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 19/139 2020-11-20T12:12:04.346 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T12:12:04.346 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/139 2020-11-20T12:12:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T12:12:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libquadmath-8.3.1-5.1.el8.x86_64 20/139 2020-11-20T12:12:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T12:12:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libgfortran-8.3.1-5.1.el8.x86_64 21/139 2020-11-20T12:12:04.347 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T12:12:04.348 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 34/139 2020-11-20T12:12:04.348 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T12:12:04.594 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openblas-threads-0.3.3-5.el8.x86_64 22/139 2020-11-20T12:12:04.717 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T12:12:04.790 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 20/139 2020-11-20T12:12:05.099 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/139 2020-11-20T12:12:05.291 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 22/139 2020-11-20T12:12:05.431 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: openblas-0.3.3-5.el8.x86_64 23/139 2020-11-20T12:12:05.453 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 23/139 2020-11-20T12:12:05.514 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T12:12:05.658 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/139 2020-11-20T12:12:05.711 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 24/139 2020-11-20T12:12:05.842 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 36/139 2020-11-20T12:12:05.910 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 25/139 2020-11-20T12:12:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libxslt-1.1.32-5.el8.x86_64 25/139 2020-11-20T12:12:06.039 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T12:12:06.152 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-16.el8_2.x86_64 26/139 2020-11-20T12:12:06.211 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T12:12:06.215 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 26/139 2020-11-20T12:12:06.391 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T12:12:06.392 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T12:12:06.460 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 27/139 2020-11-20T12:12:06.580 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T12:12:06.589 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T12:12:06.635 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 28/139 2020-11-20T12:12:06.714 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T12:12:06.745 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T12:12:06.770 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 29/139 2020-11-20T12:12:06.919 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/139 2020-11-20T12:12:06.921 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T12:12:07.163 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 31/139 2020-11-20T12:12:07.243 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 43/139 2020-11-20T12:12:07.383 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T12:12:07.429 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 44/139 2020-11-20T12:12:07.549 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 45/139 2020-11-20T12:12:07.722 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 46/139 2020-11-20T12:12:07.735 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 30/139 2020-11-20T12:12:07.974 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 47/139 2020-11-20T12:12:08.052 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 31/139 2020-11-20T12:12:08.152 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 48/139 2020-11-20T12:12:08.153 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 49/139 2020-11-20T12:12:08.153 INFO:teuthology.orchestra.run.smithi093.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T12:12:08.153 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:12:08.290 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 32/139 2020-11-20T12:12:08.550 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 33/139 2020-11-20T12:12:08.554 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/139 2020-11-20T12:12:08.714 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 51/139 2020-11-20T12:12:08.784 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xmlstarlet-1.6.1-11.el8.x86_64 34/139 2020-11-20T12:12:08.963 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T12:12:08.964 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/139 2020-11-20T12:12:09.193 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/139 2020-11-20T12:12:09.360 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 32/139 2020-11-20T12:12:09.494 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/139 2020-11-20T12:12:09.865 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 55/139 2020-11-20T12:12:10.128 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 56/139 2020-11-20T12:12:10.302 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 57/139 2020-11-20T12:12:10.402 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 33/139 2020-11-20T12:12:10.574 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/139 2020-11-20T12:12:10.722 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 34/139 2020-11-20T12:12:10.755 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/139 2020-11-20T12:12:10.932 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/139 2020-11-20T12:12:10.955 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 35/139 2020-11-20T12:12:11.085 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/139 2020-11-20T12:12:11.100 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 35/139 2020-11-20T12:12:11.312 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/139 2020-11-20T12:12:11.390 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 36/139 2020-11-20T12:12:11.477 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 36/139 2020-11-20T12:12:11.539 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 63/139 2020-11-20T12:12:11.570 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T12:12:11.733 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T12:12:11.757 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T12:12:11.797 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-3.4.2-15.el8.noarch 37/139 2020-11-20T12:12:11.830 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T12:12:11.939 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T12:12:11.970 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 38/139 2020-11-20T12:12:12.085 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T12:12:12.087 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : jq-1.5-12.el8.x86_64 65/139 2020-11-20T12:12:12.216 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 39/139 2020-11-20T12:12:12.258 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/139 2020-11-20T12:12:12.292 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T12:12:12.404 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 40/139 2020-11-20T12:12:12.465 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/139 2020-11-20T12:12:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 42/139 2020-11-20T12:12:12.611 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 41/139 2020-11-20T12:12:12.624 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 68/139 2020-11-20T12:12:12.733 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T12:12:12.819 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 42/139 2020-11-20T12:12:12.826 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 43/139 2020-11-20T12:12:12.871 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 69/139 2020-11-20T12:12:13.009 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 44/139 2020-11-20T12:12:13.011 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.5-12.el8.x86_64 43/139 2020-11-20T12:12:13.088 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 70/139 2020-11-20T12:12:13.137 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 45/139 2020-11-20T12:12:13.191 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 44/139 2020-11-20T12:12:13.298 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 46/139 2020-11-20T12:12:13.331 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 45/139 2020-11-20T12:12:13.434 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 71/139 2020-11-20T12:12:13.515 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 46/139 2020-11-20T12:12:13.550 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 47/139 2020-11-20T12:12:13.666 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : automake-1.16.1-6.el8.noarch 72/139 2020-11-20T12:12:13.690 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 48/139 2020-11-20T12:12:13.690 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 49/139 2020-11-20T12:12:13.690 INFO:teuthology.orchestra.run.smithi066.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T12:12:13.691 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:12:13.695 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 47/139 2020-11-20T12:12:13.829 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T12:12:13.948 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 48/139 2020-11-20T12:12:14.085 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T12:12:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 49/139 2020-11-20T12:12:14.247 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : fuse-2.9.7-12.el8.x86_64 50/139 2020-11-20T12:12:14.306 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T12:12:14.429 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 51/139 2020-11-20T12:12:14.461 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.1-6.el8.noarch 50/139 2020-11-20T12:12:14.478 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T12:12:14.635 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T12:12:14.693 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 51/139 2020-11-20T12:12:14.710 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 52/139 2020-11-20T12:12:14.870 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T12:12:15.303 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 52/139 2020-11-20T12:12:15.305 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 53/139 2020-11-20T12:12:15.306 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 53/139 2020-11-20T12:12:15.306 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 54/139 2020-11-20T12:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T12:12:15.307 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T12:12:15.323 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 54/139 2020-11-20T12:12:15.494 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T12:12:15.514 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.32.1-24.el8.x86_64 55/139 2020-11-20T12:12:15.594 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 55/139 2020-11-20T12:12:15.707 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T12:12:15.797 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 56/139 2020-11-20T12:12:15.826 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 56/139 2020-11-20T12:12:15.896 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T12:12:16.008 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libselinux-devel-2.9-3.el8.x86_64 57/139 2020-11-20T12:12:16.008 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 58/139 2020-11-20T12:12:16.008 INFO:teuthology.orchestra.run.smithi132.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-11-20T12:12:16.009 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:12:16.009 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 57/139 2020-11-20T12:12:16.080 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T12:12:16.293 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 58/139 2020-11-20T12:12:16.345 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T12:12:16.395 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.7-12.el8.x86_64 59/139 2020-11-20T12:12:16.565 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/139 2020-11-20T12:12:16.577 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T12:12:16.646 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 59/139 2020-11-20T12:12:16.830 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 60/139 2020-11-20T12:12:16.843 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 61/139 2020-11-20T12:12:16.938 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T12:12:16.990 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 61/139 2020-11-20T12:12:17.050 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 62/139 2020-11-20T12:12:17.207 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 62/139 2020-11-20T12:12:17.224 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T12:12:17.306 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 63/139 2020-11-20T12:12:17.468 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T12:12:17.469 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 63/139 2020-11-20T12:12:17.638 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T12:12:17.651 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asn1crypto-0.24.0-3.el8.noarch 64/139 2020-11-20T12:12:17.727 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 64/139 2020-11-20T12:12:17.757 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T12:12:17.912 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : jq-1.5-12.el8.x86_64 65/139 2020-11-20T12:12:17.918 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-2.3-3.el8.x86_64 65/139 2020-11-20T12:12:17.955 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T12:12:18.122 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 66/139 2020-11-20T12:12:18.169 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 66/139 2020-11-20T12:12:18.171 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T12:12:18.313 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 67/139 2020-11-20T12:12:18.379 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T12:12:18.425 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-18.0.0-1.el8.noarch 67/139 2020-11-20T12:12:18.498 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 68/139 2020-11-20T12:12:18.688 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 68/139 2020-11-20T12:12:18.736 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 69/139 2020-11-20T12:12:18.903 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 69/139 2020-11-20T12:12:18.958 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 70/139 2020-11-20T12:12:19.059 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 70/139 2020-11-20T12:12:19.224 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 71/139 2020-11-20T12:12:19.268 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 71/139 2020-11-20T12:12:19.466 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : krb5-devel-1.18.2-5.el8.x86_64 72/139 2020-11-20T12:12:19.470 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : automake-1.16.1-6.el8.noarch 72/139 2020-11-20T12:12:19.512 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T12:12:19.670 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T12:12:19.676 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 73/139 2020-11-20T12:12:19.755 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T12:12:19.944 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T12:12:19.961 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 74/139 2020-11-20T12:12:20.004 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T12:12:20.139 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T12:12:20.161 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 75/139 2020-11-20T12:12:20.253 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T12:12:20.311 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T12:12:20.359 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 76/139 2020-11-20T12:12:20.442 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T12:12:20.469 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T12:12:20.524 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 77/139 2020-11-20T12:12:20.659 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T12:12:20.687 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T12:12:20.733 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 78/139 2020-11-20T12:12:20.848 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T12:12:20.906 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T12:12:20.970 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 79/139 2020-11-20T12:12:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T12:12:21.124 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 80/139 2020-11-20T12:12:21.238 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T12:12:21.290 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 81/139 2020-11-20T12:12:21.439 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T12:12:21.509 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 82/139 2020-11-20T12:12:21.671 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T12:12:21.676 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 83/139 2020-11-20T12:12:21.902 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T12:12:21.947 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 84/139 2020-11-20T12:12:22.141 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T12:12:22.169 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-2.6-1.el8.noarch 85/139 2020-11-20T12:12:22.366 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T12:12:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 86/139 2020-11-20T12:12:22.714 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T12:12:22.753 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 87/139 2020-11-20T12:12:23.002 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T12:12:23.026 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 88/139 2020-11-20T12:12:23.239 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T12:12:23.240 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 89/139 2020-11-20T12:12:23.520 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T12:12:23.581 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 90/139 2020-11-20T12:12:23.766 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T12:12:23.812 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 91/139 2020-11-20T12:12:23.963 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T12:12:23.986 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 92/139 2020-11-20T12:12:24.170 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T12:12:24.222 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 93/139 2020-11-20T12:12:24.886 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:25.114 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:25.268 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T12:12:25.399 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 94/139 2020-11-20T12:12:25.496 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T12:12:25.593 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-kubernetes-11.0.0-2.el8.noarch 95/139 2020-11-20T12:12:25.710 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T12:12:25.819 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:25.873 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 96/139 2020-11-20T12:12:25.935 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T12:12:26.101 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 97/139 2020-11-20T12:12:26.207 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T12:12:26.235 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T12:12:26.311 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T12:12:26.355 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 98/139 2020-11-20T12:12:26.392 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T12:12:26.463 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T12:12:26.525 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 99/139 2020-11-20T12:12:26.539 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T12:12:26.719 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 100/139 2020-11-20T12:12:30.513 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:30.730 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:31.016 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:31.235 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:31.435 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:31.728 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T12:12:31.815 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T12:12:31.971 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T12:12:32.000 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 101/139 2020-11-20T12:12:32.235 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T12:12:32.346 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 102/139 2020-11-20T12:12:32.485 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T12:12:43.425 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T12:12:43.426 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /sys 2020-11-20T12:12:43.426 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /proc 2020-11-20T12:12:43.426 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2020-11-20T12:12:43.426 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /run 2020-11-20T12:12:43.427 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /mnt 2020-11-20T12:12:43.427 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /var/tmp 2020-11-20T12:12:43.427 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /home 2020-11-20T12:12:43.427 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /tmp 2020-11-20T12:12:43.428 INFO:teuthology.orchestra.run.smithi093.stdout:skipping the directory /dev 2020-11-20T12:12:43.428 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:12:43.761 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T12:12:44.194 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T12:12:44.340 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T12:12:45.846 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T12:12:46.098 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T12:12:46.123 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T12:12:48.101 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T12:12:48.333 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T12:12:48.467 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T12:12:48.969 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T12:12:48.969 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2020-11-20T12:12:48.969 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2020-11-20T12:12:48.970 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /dev 2020-11-20T12:12:48.970 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /run 2020-11-20T12:12:48.970 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2020-11-20T12:12:48.970 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2020-11-20T12:12:48.970 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2020-11-20T12:12:48.971 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2020-11-20T12:12:48.971 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /dev 2020-11-20T12:12:48.971 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:12:49.066 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T12:12:49.202 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T12:12:49.361 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T12:12:49.794 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T12:12:49.985 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T12:12:50.096 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T12:12:51.190 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 103/139 2020-11-20T12:12:51.190 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /sys 2020-11-20T12:12:51.191 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /proc 2020-11-20T12:12:51.191 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /dev 2020-11-20T12:12:51.191 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /run 2020-11-20T12:12:51.191 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /mnt 2020-11-20T12:12:51.191 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /var/tmp 2020-11-20T12:12:51.192 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /home 2020-11-20T12:12:51.192 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /tmp 2020-11-20T12:12:51.192 INFO:teuthology.orchestra.run.smithi066.stdout:skipping the directory /dev 2020-11-20T12:12:51.192 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:12:51.192 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T12:12:51.193 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 104/139 2020-11-20T12:12:51.193 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T12:12:51.224 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T12:12:51.429 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T12:12:51.496 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T12:12:51.601 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T12:12:51.687 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T12:12:51.742 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T12:12:51.767 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T12:12:52.031 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T12:12:52.172 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T12:12:52.202 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T12:12:52.359 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T12:12:52.375 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T12:12:52.842 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 105/139 2020-11-20T12:12:53.073 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T12:12:53.101 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 106/139 2020-11-20T12:12:53.536 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T12:12:53.683 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T12:12:53.726 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T12:12:53.937 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T12:12:54.075 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T12:12:54.094 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T12:12:54.254 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T12:12:54.410 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T12:12:54.893 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T12:12:55.259 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T12:12:55.295 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T12:12:55.445 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 107/139 2020-11-20T12:12:55.566 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T12:12:55.615 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 108/139 2020-11-20T12:12:55.778 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 109/139 2020-11-20T12:12:55.957 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T12:12:56.604 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T12:12:56.792 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T12:12:56.877 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T12:12:56.933 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 110/139 2020-11-20T12:12:57.266 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T12:12:57.449 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T12:12:57.479 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T12:12:57.567 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T12:12:57.642 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T12:12:57.658 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T12:12:58.686 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 111/139 2020-11-20T12:12:58.827 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T12:12:58.857 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T12:12:58.950 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 112/139 2020-11-20T12:12:59.051 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T12:12:59.266 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T12:12:59.316 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 113/139 2020-11-20T12:12:59.423 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T12:12:59.456 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T12:12:59.488 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 114/139 2020-11-20T12:12:59.576 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T12:12:59.579 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T12:12:59.673 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T12:12:59.690 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 115/139 2020-11-20T12:12:59.783 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T12:13:00.490 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T12:13:00.870 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 121/139 2020-11-20T12:13:00.926 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 116/139 2020-11-20T12:13:01.064 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 122/139 2020-11-20T12:13:01.107 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T12:13:01.277 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 123/139 2020-11-20T12:13:01.413 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T12:13:01.483 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 117/139 2020-11-20T12:13:01.583 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T12:13:01.657 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T12:13:01.787 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T12:13:01.943 INFO:teuthology.orchestra.run.smithi093.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T12:13:02.150 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T12:13:02.369 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T12:13:02.617 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T12:13:02.645 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T12:13:02.898 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2020-11-20T12:13:03.075 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T12:13:03.136 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T12:13:03.349 INFO:teuthology.orchestra.run.smithi093.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T12:13:03.371 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T12:13:03.493 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T12:13:03.493 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T12:13:03.718 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T12:13:03.835 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T12:13:03.849 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:03.849 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:03.937 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T12:13:04.337 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:04.337 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T12:13:04.519 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T12:13:04.520 INFO:teuthology.orchestra.run.smithi093.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T12:13:04.870 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T12:13:05.178 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 120/139 2020-11-20T12:13:05.378 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 121/139 2020-11-20T12:13:05.394 INFO:teuthology.orchestra.run.smithi093.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T12:13:05.394 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T12:13:05.394 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T12:13:05.394 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T12:13:05.395 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T12:13:05.395 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T12:13:05.395 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:13:05.395 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:13:05.395 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:13:05.396 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T12:13:05.396 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T12:13:05.396 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:13:05.396 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T12:13:05.396 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T12:13:05.397 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T12:13:05.397 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T12:13:05.397 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T12:13:05.397 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T12:13:05.398 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T12:13:05.398 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T12:13:05.398 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T12:13:05.398 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T12:13:05.398 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T12:13:05.399 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T12:13:05.399 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T12:13:05.407 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T12:13:05.408 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T12:13:05.408 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T12:13:05.408 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T12:13:05.408 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T12:13:05.408 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T12:13:05.409 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T12:13:05.409 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T12:13:05.409 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T12:13:05.409 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T12:13:05.410 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T12:13:05.410 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T12:13:05.410 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T12:13:05.410 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T12:13:05.410 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T12:13:05.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T12:13:05.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T12:13:05.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T12:13:05.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T12:13:05.411 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T12:13:05.412 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T12:13:05.412 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T12:13:05.412 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T12:13:05.412 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T12:13:05.412 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T12:13:05.413 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T12:13:05.413 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T12:13:05.413 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T12:13:05.413 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T12:13:05.413 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T12:13:05.414 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T12:13:05.414 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T12:13:05.414 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T12:13:05.414 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T12:13:05.415 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T12:13:05.415 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T12:13:05.415 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T12:13:05.415 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T12:13:05.415 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T12:13:05.416 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T12:13:05.416 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T12:13:05.416 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T12:13:05.416 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T12:13:05.416 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T12:13:05.417 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T12:13:05.417 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T12:13:05.417 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/139 2020-11-20T12:13:05.417 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/139 2020-11-20T12:13:05.417 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/139 2020-11-20T12:13:05.418 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : jq-1.5-12.el8.x86_64 74/139 2020-11-20T12:13:05.418 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 75/139 2020-11-20T12:13:05.418 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/139 2020-11-20T12:13:05.418 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 77/139 2020-11-20T12:13:05.418 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/139 2020-11-20T12:13:05.419 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 79/139 2020-11-20T12:13:05.419 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 80/139 2020-11-20T12:13:05.419 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 81/139 2020-11-20T12:13:05.419 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 82/139 2020-11-20T12:13:05.419 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 83/139 2020-11-20T12:13:05.420 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/139 2020-11-20T12:13:05.420 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/139 2020-11-20T12:13:05.420 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/139 2020-11-20T12:13:05.420 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/139 2020-11-20T12:13:05.420 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/139 2020-11-20T12:13:05.421 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/139 2020-11-20T12:13:05.421 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 90/139 2020-11-20T12:13:05.421 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 91/139 2020-11-20T12:13:05.421 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/139 2020-11-20T12:13:05.422 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/139 2020-11-20T12:13:05.422 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/139 2020-11-20T12:13:05.422 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/139 2020-11-20T12:13:05.422 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 96/139 2020-11-20T12:13:05.422 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 97/139 2020-11-20T12:13:05.423 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/139 2020-11-20T12:13:05.423 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/139 2020-11-20T12:13:05.423 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 100/139 2020-11-20T12:13:05.423 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 101/139 2020-11-20T12:13:05.423 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 102/139 2020-11-20T12:13:05.424 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/139 2020-11-20T12:13:05.424 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 104/139 2020-11-20T12:13:05.424 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 105/139 2020-11-20T12:13:05.424 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 106/139 2020-11-20T12:13:05.424 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 107/139 2020-11-20T12:13:05.425 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/139 2020-11-20T12:13:05.425 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 109/139 2020-11-20T12:13:05.425 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 110/139 2020-11-20T12:13:05.425 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/139 2020-11-20T12:13:05.425 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 112/139 2020-11-20T12:13:05.426 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 113/139 2020-11-20T12:13:05.426 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 114/139 2020-11-20T12:13:05.426 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 115/139 2020-11-20T12:13:05.426 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 116/139 2020-11-20T12:13:05.426 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 117/139 2020-11-20T12:13:05.427 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 118/139 2020-11-20T12:13:05.427 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 119/139 2020-11-20T12:13:05.427 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 120/139 2020-11-20T12:13:05.427 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 121/139 2020-11-20T12:13:05.428 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 122/139 2020-11-20T12:13:05.428 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 123/139 2020-11-20T12:13:05.428 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 124/139 2020-11-20T12:13:05.428 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 125/139 2020-11-20T12:13:05.428 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 126/139 2020-11-20T12:13:05.429 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 127/139 2020-11-20T12:13:05.429 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T12:13:05.429 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T12:13:05.429 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T12:13:05.429 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T12:13:05.430 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T12:13:05.430 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T12:13:05.430 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T12:13:05.430 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T12:13:05.430 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T12:13:05.431 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:05.431 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T12:13:05.588 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 122/139 2020-11-20T12:13:05.744 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T12:13:05.759 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 123/139 2020-11-20T12:13:05.923 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T12:13:06.101 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T12:13:06.294 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T12:13:06.322 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 118/139 2020-11-20T12:13:06.677 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 119/139 2020-11-20T12:13:06.760 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T12:13:06.847 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T12:13:07.000 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T12:13:07.236 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T12:13:07.399 INFO:teuthology.orchestra.run.smithi093.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T12:13:07.400 INFO:teuthology.orchestra.run.smithi093.stdout:Installed products updated. 2020-11-20T12:13:07.425 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T12:13:07.546 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T12:13:07.625 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 120/139 2020-11-20T12:13:07.708 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T12:13:07.767 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 131/139 2020-11-20T12:13:07.929 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : openssl-devel-1:1.1.1g-11.el8.x86_64 121/139 2020-11-20T12:13:07.966 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T12:13:07.981 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 132/139 2020-11-20T12:13:08.083 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 122/139 2020-11-20T12:13:08.178 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 133/139 2020-11-20T12:13:08.278 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : xfsprogs-devel-5.0.0-4.el8.x86_64 123/139 2020-11-20T12:13:08.292 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T12:13:08.293 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T12:13:08.428 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 124/139 2020-11-20T12:13:08.526 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T12:13:08.621 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : elfutils-libelf-devel-0.180-1.el8.x86_64 125/139 2020-11-20T12:13:08.643 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T12:13:08.658 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:08.659 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:08.767 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 126/139 2020-11-20T12:13:08.965 INFO:teuthology.orchestra.run.smithi066.stdout: Upgrading : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 127/139 2020-11-20T12:13:09.095 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:09.096 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T12:13:09.182 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T12:13:09.343 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T12:13:09.344 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T12:13:09.368 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 129/139 2020-11-20T12:13:09.564 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T12:13:09.595 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 130/139 2020-11-20T12:13:09.865 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 131/139 2020-11-20T12:13:10.089 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T12:13:10.150 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:10.151 INFO:teuthology.orchestra.run.smithi093.stdout:Upgraded: 2020-11-20T12:13:10.151 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:10.151 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:10.151 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:10.151 INFO:teuthology.orchestra.run.smithi093.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:10.152 INFO:teuthology.orchestra.run.smithi093.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.152 INFO:teuthology.orchestra.run.smithi093.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.152 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:10.152 INFO:teuthology.orchestra.run.smithi093.stdout:Installed: 2020-11-20T12:13:10.152 INFO:teuthology.orchestra.run.smithi093.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T12:13:10.153 INFO:teuthology.orchestra.run.smithi093.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T12:13:10.153 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.153 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.153 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.154 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.154 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.154 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.155 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.155 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.155 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.155 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.155 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.156 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.156 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.156 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.156 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.157 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.157 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.157 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.157 INFO:teuthology.orchestra.run.smithi093.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.157 INFO:teuthology.orchestra.run.smithi093.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:10.158 INFO:teuthology.orchestra.run.smithi093.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T12:13:10.158 INFO:teuthology.orchestra.run.smithi093.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T12:13:10.158 INFO:teuthology.orchestra.run.smithi093.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T12:13:10.158 INFO:teuthology.orchestra.run.smithi093.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T12:13:10.158 INFO:teuthology.orchestra.run.smithi093.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T12:13:10.158 INFO:teuthology.orchestra.run.smithi093.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T12:13:10.159 INFO:teuthology.orchestra.run.smithi093.stdout: jq-1.5-12.el8.x86_64 2020-11-20T12:13:10.159 INFO:teuthology.orchestra.run.smithi093.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T12:13:10.159 INFO:teuthology.orchestra.run.smithi093.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T12:13:10.159 INFO:teuthology.orchestra.run.smithi093.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T12:13:10.159 INFO:teuthology.orchestra.run.smithi093.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T12:13:10.160 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.160 INFO:teuthology.orchestra.run.smithi093.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.160 INFO:teuthology.orchestra.run.smithi093.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T12:13:10.160 INFO:teuthology.orchestra.run.smithi093.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T12:13:10.160 INFO:teuthology.orchestra.run.smithi093.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T12:13:10.161 INFO:teuthology.orchestra.run.smithi093.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T12:13:10.161 INFO:teuthology.orchestra.run.smithi093.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T12:13:10.161 INFO:teuthology.orchestra.run.smithi093.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.161 INFO:teuthology.orchestra.run.smithi093.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.162 INFO:teuthology.orchestra.run.smithi093.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T12:13:10.162 INFO:teuthology.orchestra.run.smithi093.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.162 INFO:teuthology.orchestra.run.smithi093.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T12:13:10.162 INFO:teuthology.orchestra.run.smithi093.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T12:13:10.162 INFO:teuthology.orchestra.run.smithi093.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T12:13:10.163 INFO:teuthology.orchestra.run.smithi093.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T12:13:10.163 INFO:teuthology.orchestra.run.smithi093.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T12:13:10.163 INFO:teuthology.orchestra.run.smithi093.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T12:13:10.163 INFO:teuthology.orchestra.run.smithi093.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T12:13:10.163 INFO:teuthology.orchestra.run.smithi093.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T12:13:10.164 INFO:teuthology.orchestra.run.smithi093.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T12:13:10.164 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T12:13:10.164 INFO:teuthology.orchestra.run.smithi093.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T12:13:10.164 INFO:teuthology.orchestra.run.smithi093.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T12:13:10.164 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T12:13:10.165 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T12:13:10.165 INFO:teuthology.orchestra.run.smithi093.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T12:13:10.166 INFO:teuthology.orchestra.run.smithi093.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T12:13:10.166 INFO:teuthology.orchestra.run.smithi093.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T12:13:10.166 INFO:teuthology.orchestra.run.smithi093.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T12:13:10.166 INFO:teuthology.orchestra.run.smithi093.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T12:13:10.166 INFO:teuthology.orchestra.run.smithi093.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T12:13:10.167 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T12:13:10.167 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.167 INFO:teuthology.orchestra.run.smithi093.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.167 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.167 INFO:teuthology.orchestra.run.smithi093.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T12:13:10.168 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T12:13:10.168 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T12:13:10.168 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T12:13:10.168 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T12:13:10.168 INFO:teuthology.orchestra.run.smithi093.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T12:13:10.169 INFO:teuthology.orchestra.run.smithi093.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T12:13:10.169 INFO:teuthology.orchestra.run.smithi093.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T12:13:10.169 INFO:teuthology.orchestra.run.smithi093.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T12:13:10.169 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T12:13:10.169 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T12:13:10.170 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T12:13:10.170 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T12:13:10.170 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T12:13:10.170 INFO:teuthology.orchestra.run.smithi093.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T12:13:10.170 INFO:teuthology.orchestra.run.smithi093.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T12:13:10.171 INFO:teuthology.orchestra.run.smithi093.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T12:13:10.171 INFO:teuthology.orchestra.run.smithi093.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T12:13:10.171 INFO:teuthology.orchestra.run.smithi093.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T12:13:10.171 INFO:teuthology.orchestra.run.smithi093.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T12:13:10.171 INFO:teuthology.orchestra.run.smithi093.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T12:13:10.172 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:10.172 INFO:teuthology.orchestra.run.smithi093.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:10.172 INFO:teuthology.orchestra.run.smithi093.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T12:13:10.172 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T12:13:10.172 INFO:teuthology.orchestra.run.smithi093.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T12:13:10.173 INFO:teuthology.orchestra.run.smithi093.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T12:13:10.173 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T12:13:10.173 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T12:13:10.173 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T12:13:10.173 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T12:13:10.174 INFO:teuthology.orchestra.run.smithi093.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T12:13:10.174 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.174 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.174 INFO:teuthology.orchestra.run.smithi093.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T12:13:10.174 INFO:teuthology.orchestra.run.smithi093.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T12:13:10.175 INFO:teuthology.orchestra.run.smithi093.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T12:13:10.175 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.176 INFO:teuthology.orchestra.run.smithi093.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T12:13:10.176 INFO:teuthology.orchestra.run.smithi093.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T12:13:10.176 INFO:teuthology.orchestra.run.smithi093.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T12:13:10.176 INFO:teuthology.orchestra.run.smithi093.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T12:13:10.177 INFO:teuthology.orchestra.run.smithi093.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T12:13:10.177 INFO:teuthology.orchestra.run.smithi093.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T12:13:10.177 INFO:teuthology.orchestra.run.smithi093.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T12:13:10.177 INFO:teuthology.orchestra.run.smithi093.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T12:13:10.178 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T12:13:10.178 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T12:13:10.178 INFO:teuthology.orchestra.run.smithi093.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T12:13:10.178 INFO:teuthology.orchestra.run.smithi093.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T12:13:10.178 INFO:teuthology.orchestra.run.smithi093.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T12:13:10.178 INFO:teuthology.orchestra.run.smithi093.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T12:13:10.179 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.179 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.179 INFO:teuthology.orchestra.run.smithi093.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:10.179 INFO:teuthology.orchestra.run.smithi093.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T12:13:10.179 INFO:teuthology.orchestra.run.smithi093.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T12:13:10.180 INFO:teuthology.orchestra.run.smithi093.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T12:13:10.180 INFO:teuthology.orchestra.run.smithi093.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T12:13:10.180 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:10.190 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T12:13:10.190 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T12:13:10.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T12:13:10.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T12:13:10.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T12:13:10.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T12:13:10.191 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:13:10.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:13:10.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:13:10.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T12:13:10.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T12:13:10.192 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:13:10.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T12:13:10.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T12:13:10.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T12:13:10.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T12:13:10.193 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T12:13:10.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T12:13:10.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T12:13:10.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T12:13:10.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T12:13:10.194 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T12:13:10.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T12:13:10.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T12:13:10.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T12:13:10.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T12:13:10.195 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T12:13:10.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T12:13:10.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T12:13:10.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T12:13:10.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T12:13:10.196 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T12:13:10.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T12:13:10.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T12:13:10.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T12:13:10.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T12:13:10.197 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T12:13:10.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T12:13:10.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T12:13:10.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T12:13:10.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T12:13:10.198 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T12:13:10.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T12:13:10.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T12:13:10.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T12:13:10.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T12:13:10.199 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T12:13:10.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T12:13:10.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T12:13:10.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T12:13:10.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T12:13:10.200 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T12:13:10.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T12:13:10.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T12:13:10.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T12:13:10.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T12:13:10.201 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T12:13:10.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T12:13:10.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T12:13:10.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T12:13:10.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T12:13:10.202 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T12:13:10.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T12:13:10.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T12:13:10.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T12:13:10.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T12:13:10.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T12:13:10.203 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T12:13:10.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T12:13:10.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T12:13:10.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T12:13:10.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 71/139 2020-11-20T12:13:10.204 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 72/139 2020-11-20T12:13:10.205 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 73/139 2020-11-20T12:13:10.205 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 74/139 2020-11-20T12:13:10.205 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 75/139 2020-11-20T12:13:10.205 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 76/139 2020-11-20T12:13:10.205 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 77/139 2020-11-20T12:13:10.206 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 78/139 2020-11-20T12:13:10.206 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 79/139 2020-11-20T12:13:10.206 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 80/139 2020-11-20T12:13:10.206 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 81/139 2020-11-20T12:13:10.206 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 82/139 2020-11-20T12:13:10.207 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 83/139 2020-11-20T12:13:10.207 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 84/139 2020-11-20T12:13:10.207 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 85/139 2020-11-20T12:13:10.207 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 86/139 2020-11-20T12:13:10.207 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 87/139 2020-11-20T12:13:10.208 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 88/139 2020-11-20T12:13:10.208 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 89/139 2020-11-20T12:13:10.208 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 90/139 2020-11-20T12:13:10.208 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 91/139 2020-11-20T12:13:10.208 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 92/139 2020-11-20T12:13:10.209 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 93/139 2020-11-20T12:13:10.209 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 94/139 2020-11-20T12:13:10.209 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 95/139 2020-11-20T12:13:10.209 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 96/139 2020-11-20T12:13:10.209 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 97/139 2020-11-20T12:13:10.209 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 98/139 2020-11-20T12:13:10.210 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.1-6.el8.noarch 99/139 2020-11-20T12:13:10.210 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 100/139 2020-11-20T12:13:10.210 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 101/139 2020-11-20T12:13:10.210 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.5-12.el8.x86_64 102/139 2020-11-20T12:13:10.210 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 103/139 2020-11-20T12:13:10.211 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 104/139 2020-11-20T12:13:10.211 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 105/139 2020-11-20T12:13:10.211 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 106/139 2020-11-20T12:13:10.211 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 107/139 2020-11-20T12:13:10.212 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 108/139 2020-11-20T12:13:10.212 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 109/139 2020-11-20T12:13:10.212 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 110/139 2020-11-20T12:13:10.212 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 111/139 2020-11-20T12:13:10.212 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 112/139 2020-11-20T12:13:10.213 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 113/139 2020-11-20T12:13:10.213 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.1-9.el8.x86_64 114/139 2020-11-20T12:13:10.213 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 115/139 2020-11-20T12:13:10.213 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.0.4-10.el8.x86_64 116/139 2020-11-20T12:13:10.213 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 117/139 2020-11-20T12:13:10.214 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 118/139 2020-11-20T12:13:10.214 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 119/139 2020-11-20T12:13:10.214 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 120/139 2020-11-20T12:13:10.214 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 121/139 2020-11-20T12:13:10.214 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 122/139 2020-11-20T12:13:10.215 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 123/139 2020-11-20T12:13:10.215 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 124/139 2020-11-20T12:13:10.215 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 125/139 2020-11-20T12:13:10.215 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 126/139 2020-11-20T12:13:10.215 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 127/139 2020-11-20T12:13:10.215 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T12:13:10.216 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T12:13:10.216 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T12:13:10.216 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T12:13:10.216 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T12:13:10.216 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T12:13:10.217 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T12:13:10.217 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T12:13:10.217 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T12:13:10.217 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:10.217 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T12:13:10.218 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 132/139 2020-11-20T12:13:10.218 INFO:teuthology.orchestra.run.smithi093.stdout:Complete! 2020-11-20T12:13:10.322 INFO:teuthology.orchestra.run.smithi066.stdout: Installing : flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T12:13:10.345 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 133/139 2020-11-20T12:13:10.394 DEBUG:teuthology.parallel:result is None 2020-11-20T12:13:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-tui-1:1.26.0-8.el8.x86_64 134/139 2020-11-20T12:13:10.490 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T12:13:10.732 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 135/139 2020-11-20T12:13:10.874 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-team-1:1.26.0-8.el8.x86_64 136/139 2020-11-20T12:13:10.891 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:10.892 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:11.376 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:11.376 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T12:13:11.592 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: NetworkManager-libnm-1:1.26.0-8.el8.x86_64 138/139 2020-11-20T12:13:11.592 INFO:teuthology.orchestra.run.smithi066.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T12:13:12.245 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T12:13:12.245 INFO:teuthology.orchestra.run.smithi132.stdout:Installed products updated. 2020-11-20T12:13:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 139/139 2020-11-20T12:13:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 1/139 2020-11-20T12:13:12.455 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2/139 2020-11-20T12:13:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 3/139 2020-11-20T12:13:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 4/139 2020-11-20T12:13:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-immutable-object-cache-2:16.0.0-7397.gb86e6 5/139 2020-11-20T12:13:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 6/139 2020-11-20T12:13:12.456 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 7/139 2020-11-20T12:13:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 8/139 2020-11-20T12:13:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 9/139 2020-11-20T12:13:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 10/139 2020-11-20T12:13:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 11/139 2020-11-20T12:13:12.457 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 12/139 2020-11-20T12:13:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_ 13/139 2020-11-20T12:13:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 14/139 2020-11-20T12:13:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_6 15/139 2020-11-20T12:13:12.458 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86 16/139 2020-11-20T12:13:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 17/139 2020-11-20T12:13:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el 18/139 2020-11-20T12:13:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-ceph-common-2:16.0.0-7397.gb86e691b.el8. 19/139 2020-11-20T12:13:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_6 20/139 2020-11-20T12:13:12.459 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 21/139 2020-11-20T12:13:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 22/139 2020-11-20T12:13:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 23/139 2020-11-20T12:13:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 24/139 2020-11-20T12:13:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 25/139 2020-11-20T12:13:12.460 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 26/139 2020-11-20T12:13:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b. 27/139 2020-11-20T12:13:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noa 28/139 2020-11-20T12:13:12.461 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.n 29/139 2020-11-20T12:13:12.469 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86 30/139 2020-11-20T12:13:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el 31/139 2020-11-20T12:13:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 32/139 2020-11-20T12:13:12.470 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.e 33/139 2020-11-20T12:13:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 34/139 2020-11-20T12:13:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 35/139 2020-11-20T12:13:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 36/139 2020-11-20T12:13:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : leveldb-1.22-1.el8.x86_64 37/139 2020-11-20T12:13:12.471 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/139 2020-11-20T12:13:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/139 2020-11-20T12:13:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 40/139 2020-11-20T12:13:12.472 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/139 2020-11-20T12:13:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/139 2020-11-20T12:13:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/139 2020-11-20T12:13:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/139 2020-11-20T12:13:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 45/139 2020-11-20T12:13:12.473 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/139 2020-11-20T12:13:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 47/139 2020-11-20T12:13:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 48/139 2020-11-20T12:13:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/139 2020-11-20T12:13:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/139 2020-11-20T12:13:12.474 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/139 2020-11-20T12:13:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-kubernetes-11.0.0-2.el8.noarch 52/139 2020-11-20T12:13:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/139 2020-11-20T12:13:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/139 2020-11-20T12:13:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 55/139 2020-11-20T12:13:12.475 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-portend-2.6-1.el8.noarch 56/139 2020-11-20T12:13:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 57/139 2020-11-20T12:13:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/139 2020-11-20T12:13:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/139 2020-11-20T12:13:12.476 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-rsa-3.4.2-15.el8.noarch 60/139 2020-11-20T12:13:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/139 2020-11-20T12:13:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/139 2020-11-20T12:13:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/139 2020-11-20T12:13:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/139 2020-11-20T12:13:12.477 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 65/139 2020-11-20T12:13:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/139 2020-11-20T12:13:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/139 2020-11-20T12:13:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/139 2020-11-20T12:13:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/139 2020-11-20T12:13:12.478 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xmlstarlet-1.6.1-11.el8.x86_64 70/139 2020-11-20T12:13:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : automake-1.16.1-6.el8.noarch 71/139 2020-11-20T12:13:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 72/139 2020-11-20T12:13:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 73/139 2020-11-20T12:13:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : jq-1.5-12.el8.x86_64 74/139 2020-11-20T12:13:12.479 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyOpenSSL-18.0.0-1.el8.noarch 75/139 2020-11-20T12:13:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 76/139 2020-11-20T12:13:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 77/139 2020-11-20T12:13:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 78/139 2020-11-20T12:13:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 79/139 2020-11-20T12:13:12.480 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 80/139 2020-11-20T12:13:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 81/139 2020-11-20T12:13:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 82/139 2020-11-20T12:13:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 83/139 2020-11-20T12:13:12.481 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/139 2020-11-20T12:13:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 85/139 2020-11-20T12:13:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : flex-2.6.1-9.el8.x86_64 86/139 2020-11-20T12:13:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 87/139 2020-11-20T12:13:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : bison-3.0.4-10.el8.x86_64 88/139 2020-11-20T12:13:12.482 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 89/139 2020-11-20T12:13:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 90/139 2020-11-20T12:13:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 91/139 2020-11-20T12:13:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 92/139 2020-11-20T12:13:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 93/139 2020-11-20T12:13:12.483 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 94/139 2020-11-20T12:13:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 95/139 2020-11-20T12:13:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-threads-0.3.3-5.el8.x86_64 96/139 2020-11-20T12:13:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openblas-0.3.3-5.el8.x86_64 97/139 2020-11-20T12:13:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 98/139 2020-11-20T12:13:12.484 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 99/139 2020-11-20T12:13:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 100/139 2020-11-20T12:13:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 101/139 2020-11-20T12:13:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-asn1crypto-0.24.0-3.el8.noarch 102/139 2020-11-20T12:13:12.485 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/139 2020-11-20T12:13:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 104/139 2020-11-20T12:13:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 105/139 2020-11-20T12:13:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 106/139 2020-11-20T12:13:12.486 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 107/139 2020-11-20T12:13:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 108/139 2020-11-20T12:13:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 109/139 2020-11-20T12:13:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 110/139 2020-11-20T12:13:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 111/139 2020-11-20T12:13:12.487 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libselinux-devel-2.9-3.el8.x86_64 112/139 2020-11-20T12:13:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : python3-cryptography-2.3-3.el8.x86_64 113/139 2020-11-20T12:13:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : zlib-devel-1.2.11-16.el8_2.x86_64 114/139 2020-11-20T12:13:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libuuid-devel-2.32.1-24.el8.x86_64 115/139 2020-11-20T12:13:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libxslt-1.1.32-5.el8.x86_64 116/139 2020-11-20T12:13:12.488 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 117/139 2020-11-20T12:13:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libquadmath-8.3.1-5.1.el8.x86_64 118/139 2020-11-20T12:13:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 119/139 2020-11-20T12:13:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : libgfortran-8.3.1-5.1.el8.x86_64 120/139 2020-11-20T12:13:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : elfutils-libelf-devel-0.180-1.el8.x86_64 121/139 2020-11-20T12:13:12.489 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 122/139 2020-11-20T12:13:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 123/139 2020-11-20T12:13:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : krb5-devel-1.18.2-5.el8.x86_64 124/139 2020-11-20T12:13:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : xfsprogs-devel-5.0.0-4.el8.x86_64 125/139 2020-11-20T12:13:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librabbitmq-0.9.0-2.el8.x86_64 126/139 2020-11-20T12:13:12.490 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : openssl-devel-1:1.1.1g-11.el8.x86_64 127/139 2020-11-20T12:13:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 128/139 2020-11-20T12:13:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 129/139 2020-11-20T12:13:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 130/139 2020-11-20T12:13:12.491 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 131/139 2020-11-20T12:13:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 132/139 2020-11-20T12:13:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-libnm-1:1.26.0-8.el8.x86_64 133/139 2020-11-20T12:13:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 134/139 2020-11-20T12:13:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-tui-1:1.26.0-8.el8.x86_64 135/139 2020-11-20T12:13:12.492 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.26.0-9.el8_3.x86_64 136/139 2020-11-20T12:13:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-team-1:1.26.0-8.el8.x86_64 137/139 2020-11-20T12:13:12.493 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.26.0-9.el8_3.x86_64 138/139 2020-11-20T12:13:14.526 INFO:teuthology.orchestra.run.smithi066.stdout: Verifying : NetworkManager-1:1.26.0-8.el8.x86_64 139/139 2020-11-20T12:13:14.526 INFO:teuthology.orchestra.run.smithi066.stdout:Installed products updated. 2020-11-20T12:13:14.730 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:14.731 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2020-11-20T12:13:14.732 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:14.732 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:14.733 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:14.734 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:14.734 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.735 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.735 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:14.736 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2020-11-20T12:13:14.736 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T12:13:14.737 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T12:13:14.737 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.737 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.738 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.738 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.739 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.739 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.740 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.741 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.742 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.743 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.743 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.743 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi132.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T12:13:14.744 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.5-12.el8.x86_64 2020-11-20T12:13:14.745 INFO:teuthology.orchestra.run.smithi132.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi132.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi132.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T12:13:14.746 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi132.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T12:13:14.747 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.748 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi132.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T12:13:14.749 INFO:teuthology.orchestra.run.smithi132.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi132.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T12:13:14.750 INFO:teuthology.orchestra.run.smithi132.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T12:13:14.751 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi132.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi132.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T12:13:14.752 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi132.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T12:13:14.753 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T12:13:14.754 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T12:13:14.755 INFO:teuthology.orchestra.run.smithi132.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi132.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T12:13:14.756 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T12:13:14.757 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi132.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T12:13:14.758 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T12:13:14.759 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T12:13:14.760 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T12:13:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T12:13:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.761 INFO:teuthology.orchestra.run.smithi132.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T12:13:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T12:13:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T12:13:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T12:13:14.762 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T12:13:14.763 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T12:13:14.763 INFO:teuthology.orchestra.run.smithi132.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T12:13:14.763 INFO:teuthology.orchestra.run.smithi132.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T12:13:14.763 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T12:13:14.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T12:13:14.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T12:13:14.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T12:13:14.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T12:13:14.764 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T12:13:14.765 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T12:13:14.765 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T12:13:14.765 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T12:13:14.765 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.765 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.766 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:14.766 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T12:13:14.766 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T12:13:14.766 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T12:13:14.767 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T12:13:14.767 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:14.767 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2020-11-20T12:13:14.929 DEBUG:teuthology.parallel:result is None 2020-11-20T12:13:17.085 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:17.085 INFO:teuthology.orchestra.run.smithi066.stdout:Upgraded: 2020-11-20T12:13:17.086 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:17.086 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-libnm-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:17.086 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-team-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:17.086 INFO:teuthology.orchestra.run.smithi066.stdout: NetworkManager-tui-1:1.26.0-9.el8_3.x86_64 2020-11-20T12:13:17.086 INFO:teuthology.orchestra.run.smithi066.stdout: librados2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.087 INFO:teuthology.orchestra.run.smithi066.stdout: librbd1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.087 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:17.087 INFO:teuthology.orchestra.run.smithi066.stdout:Installed: 2020-11-20T12:13:17.088 INFO:teuthology.orchestra.run.smithi066.stdout: automake-1.16.1-6.el8.noarch 2020-11-20T12:13:17.088 INFO:teuthology.orchestra.run.smithi066.stdout: bison-3.0.4-10.el8.x86_64 2020-11-20T12:13:17.088 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.088 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-base-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.089 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.089 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.089 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-grafana-dashboards-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.089 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-immutable-object-cache-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.090 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mds-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.090 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.090 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.091 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-dashboard-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.091 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-diskprediction-local-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.091 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-modules-core-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.091 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mgr-rook-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.092 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-mon-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.092 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-osd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.092 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-prometheus-alerts-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.092 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-radosgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.092 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-selinux-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.093 INFO:teuthology.orchestra.run.smithi066.stdout: ceph-test-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.093 INFO:teuthology.orchestra.run.smithi066.stdout: cephadm-2:16.0.0-7397.gb86e691b.el8.noarch 2020-11-20T12:13:17.093 INFO:teuthology.orchestra.run.smithi066.stdout: elfutils-libelf-devel-0.180-1.el8.x86_64 2020-11-20T12:13:17.094 INFO:teuthology.orchestra.run.smithi066.stdout: flex-2.6.1-9.el8.x86_64 2020-11-20T12:13:17.094 INFO:teuthology.orchestra.run.smithi066.stdout: fmt-6.2.1-1.el8.x86_64 2020-11-20T12:13:17.094 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-2.9.7-12.el8.x86_64 2020-11-20T12:13:17.095 INFO:teuthology.orchestra.run.smithi066.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-11-20T12:13:17.095 INFO:teuthology.orchestra.run.smithi066.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-11-20T12:13:17.096 INFO:teuthology.orchestra.run.smithi066.stdout: jq-1.5-12.el8.x86_64 2020-11-20T12:13:17.096 INFO:teuthology.orchestra.run.smithi066.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-11-20T12:13:17.096 INFO:teuthology.orchestra.run.smithi066.stdout: krb5-devel-1.18.2-5.el8.x86_64 2020-11-20T12:13:17.097 INFO:teuthology.orchestra.run.smithi066.stdout: leveldb-1.22-1.el8.x86_64 2020-11-20T12:13:17.097 INFO:teuthology.orchestra.run.smithi066.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-11-20T12:13:17.098 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.098 INFO:teuthology.orchestra.run.smithi066.stdout: libcephfs2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.098 INFO:teuthology.orchestra.run.smithi066.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2020-11-20T12:13:17.099 INFO:teuthology.orchestra.run.smithi066.stdout: libgfortran-8.3.1-5.1.el8.x86_64 2020-11-20T12:13:17.099 INFO:teuthology.orchestra.run.smithi066.stdout: liboath-2.6.2-3.el8.x86_64 2020-11-20T12:13:17.099 INFO:teuthology.orchestra.run.smithi066.stdout: libquadmath-8.3.1-5.1.el8.x86_64 2020-11-20T12:13:17.100 INFO:teuthology.orchestra.run.smithi066.stdout: librabbitmq-0.9.0-2.el8.x86_64 2020-11-20T12:13:17.100 INFO:teuthology.orchestra.run.smithi066.stdout: librados-devel-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.100 INFO:teuthology.orchestra.run.smithi066.stdout: libradosstriper1-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.101 INFO:teuthology.orchestra.run.smithi066.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-11-20T12:13:17.101 INFO:teuthology.orchestra.run.smithi066.stdout: librgw2-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.102 INFO:teuthology.orchestra.run.smithi066.stdout: libselinux-devel-2.9-3.el8.x86_64 2020-11-20T12:13:17.102 INFO:teuthology.orchestra.run.smithi066.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-11-20T12:13:17.102 INFO:teuthology.orchestra.run.smithi066.stdout: libtool-2.4.6-25.el8.x86_64 2020-11-20T12:13:17.102 INFO:teuthology.orchestra.run.smithi066.stdout: libunwind-1.3.1-3.el8.x86_64 2020-11-20T12:13:17.103 INFO:teuthology.orchestra.run.smithi066.stdout: libuuid-devel-2.32.1-24.el8.x86_64 2020-11-20T12:13:17.103 INFO:teuthology.orchestra.run.smithi066.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-11-20T12:13:17.103 INFO:teuthology.orchestra.run.smithi066.stdout: libxslt-1.1.32-5.el8.x86_64 2020-11-20T12:13:17.103 INFO:teuthology.orchestra.run.smithi066.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-11-20T12:13:17.103 INFO:teuthology.orchestra.run.smithi066.stdout: oniguruma-6.8.2-2.el8.x86_64 2020-11-20T12:13:17.104 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-0.3.3-5.el8.x86_64 2020-11-20T12:13:17.104 INFO:teuthology.orchestra.run.smithi066.stdout: openblas-threads-0.3.3-5.el8.x86_64 2020-11-20T12:13:17.104 INFO:teuthology.orchestra.run.smithi066.stdout: openssl-devel-1:1.1.1g-11.el8.x86_64 2020-11-20T12:13:17.104 INFO:teuthology.orchestra.run.smithi066.stdout: pcre2-devel-10.32-2.el8.x86_64 2020-11-20T12:13:17.105 INFO:teuthology.orchestra.run.smithi066.stdout: pcre2-utf16-10.32-2.el8.x86_64 2020-11-20T12:13:17.105 INFO:teuthology.orchestra.run.smithi066.stdout: pcre2-utf32-10.32-2.el8.x86_64 2020-11-20T12:13:17.105 INFO:teuthology.orchestra.run.smithi066.stdout: python3-apipkg-1.5-6.el8.noarch 2020-11-20T12:13:17.105 INFO:teuthology.orchestra.run.smithi066.stdout: python3-asn1crypto-0.24.0-3.el8.noarch 2020-11-20T12:13:17.106 INFO:teuthology.orchestra.run.smithi066.stdout: python3-babel-2.5.1-5.el8.noarch 2020-11-20T12:13:17.106 INFO:teuthology.orchestra.run.smithi066.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-11-20T12:13:17.106 INFO:teuthology.orchestra.run.smithi066.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-11-20T12:13:17.107 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-11-20T12:13:17.107 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-argparse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.108 INFO:teuthology.orchestra.run.smithi066.stdout: python3-ceph-common-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.108 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cephfs-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.108 INFO:teuthology.orchestra.run.smithi066.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-11-20T12:13:17.109 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cffi-1.11.5-5.el8.x86_64 2020-11-20T12:13:17.109 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-11-20T12:13:17.110 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-11-20T12:13:17.110 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cryptography-2.3-3.el8.x86_64 2020-11-20T12:13:17.110 INFO:teuthology.orchestra.run.smithi066.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-11-20T12:13:17.110 INFO:teuthology.orchestra.run.smithi066.stdout: python3-execnet-1.7.1-1.el8.noarch 2020-11-20T12:13:17.112 INFO:teuthology.orchestra.run.smithi066.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-11-20T12:13:17.113 INFO:teuthology.orchestra.run.smithi066.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-11-20T12:13:17.113 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-6.2-6.el8.noarch 2020-11-20T12:13:17.113 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-11-20T12:13:17.113 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2020-11-20T12:13:17.113 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpatch-1.21-2.el8.noarch 2020-11-20T12:13:17.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jsonpointer-1.10-11.el8.noarch 2020-11-20T12:13:17.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-11-20T12:13:17.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-kubernetes-11.0.0-2.el8.noarch 2020-11-20T12:13:17.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-11-20T12:13:17.114 INFO:teuthology.orchestra.run.smithi066.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-11-20T12:13:17.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-mako-1.0.6-13.el8.noarch 2020-11-20T12:13:17.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-11-20T12:13:17.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-11-20T12:13:17.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:17.115 INFO:teuthology.orchestra.run.smithi066.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-11-20T12:13:17.116 INFO:teuthology.orchestra.run.smithi066.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-11-20T12:13:17.116 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-11-20T12:13:17.116 INFO:teuthology.orchestra.run.smithi066.stdout: python3-portend-2.6-1.el8.noarch 2020-11-20T12:13:17.116 INFO:teuthology.orchestra.run.smithi066.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-11-20T12:13:17.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyOpenSSL-18.0.0-1.el8.noarch 2020-11-20T12:13:17.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-11-20T12:13:17.117 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-11-20T12:13:17.118 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pycparser-2.14-14.el8.noarch 2020-11-20T12:13:17.118 INFO:teuthology.orchestra.run.smithi066.stdout: python3-pytz-2017.2-9.el8.noarch 2020-11-20T12:13:17.119 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rados-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.119 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.119 INFO:teuthology.orchestra.run.smithi066.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-11-20T12:13:17.120 INFO:teuthology.orchestra.run.smithi066.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-11-20T12:13:17.120 INFO:teuthology.orchestra.run.smithi066.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-11-20T12:13:17.121 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rgw-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.121 INFO:teuthology.orchestra.run.smithi066.stdout: python3-routes-2.4.1-12.el8.noarch 2020-11-20T12:13:17.121 INFO:teuthology.orchestra.run.smithi066.stdout: python3-rsa-3.4.2-15.el8.noarch 2020-11-20T12:13:17.122 INFO:teuthology.orchestra.run.smithi066.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2020-11-20T12:13:17.122 INFO:teuthology.orchestra.run.smithi066.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-11-20T12:13:17.122 INFO:teuthology.orchestra.run.smithi066.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-11-20T12:13:17.123 INFO:teuthology.orchestra.run.smithi066.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-11-20T12:13:17.123 INFO:teuthology.orchestra.run.smithi066.stdout: python3-trustme-0.6.0-4.el8.noarch 2020-11-20T12:13:17.124 INFO:teuthology.orchestra.run.smithi066.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-11-20T12:13:17.124 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-11-20T12:13:17.124 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-11-20T12:13:17.125 INFO:teuthology.orchestra.run.smithi066.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-11-20T12:13:17.125 INFO:teuthology.orchestra.run.smithi066.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-11-20T12:13:17.126 INFO:teuthology.orchestra.run.smithi066.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-11-20T12:13:17.126 INFO:teuthology.orchestra.run.smithi066.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-11-20T12:13:17.126 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-fuse-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.127 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-mirror-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.127 INFO:teuthology.orchestra.run.smithi066.stdout: rbd-nbd-2:16.0.0-7397.gb86e691b.el8.x86_64 2020-11-20T12:13:17.127 INFO:teuthology.orchestra.run.smithi066.stdout: socat-1.7.3.3-2.el8.x86_64 2020-11-20T12:13:17.128 INFO:teuthology.orchestra.run.smithi066.stdout: xfsprogs-devel-5.0.0-4.el8.x86_64 2020-11-20T12:13:17.128 INFO:teuthology.orchestra.run.smithi066.stdout: xmlstarlet-1.6.1-11.el8.x86_64 2020-11-20T12:13:17.129 INFO:teuthology.orchestra.run.smithi066.stdout: zlib-devel-1.2.11-16.el8_2.x86_64 2020-11-20T12:13:17.129 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:17.130 INFO:teuthology.orchestra.run.smithi066.stdout:Complete! 2020-11-20T12:13:17.273 DEBUG:teuthology.parallel:result is None 2020-11-20T12:13:17.274 INFO:teuthology.orchestra.run.smithi093:> sudo lsb_release -is 2020-11-20T12:13:17.324 INFO:teuthology.orchestra.run.smithi093.stdout:RedHatEnterprise 2020-11-20T12:13:17.326 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:13:17.327 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:13:17.491 INFO:teuthology.orchestra.run.smithi093:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T12:13:17.512 INFO:teuthology.orchestra.run.smithi093.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.513 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.513 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T12:13:17.514 INFO:teuthology.orchestra.run.smithi066:> sudo lsb_release -is 2020-11-20T12:13:17.560 INFO:teuthology.orchestra.run.smithi066.stdout:RedHatEnterprise 2020-11-20T12:13:17.563 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:13:17.564 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:13:17.737 INFO:teuthology.orchestra.run.smithi066:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T12:13:17.760 INFO:teuthology.orchestra.run.smithi066.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.760 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:17.761 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T12:13:17.761 INFO:teuthology.orchestra.run.smithi132:> sudo lsb_release -is 2020-11-20T12:13:17.817 INFO:teuthology.orchestra.run.smithi132.stdout:RedHatEnterprise 2020-11-20T12:13:17.818 DEBUG:teuthology.misc:System to be installed: RedHatEnterprise 2020-11-20T12:13:17.819 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:13:17.991 INFO:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-11-20T12:13:18.020 INFO:teuthology.orchestra.run.smithi132.stdout:16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:18.021 INFO:teuthology.packaging:The installed version of ceph is 16.0.0-7397.gb86e691b.el8 2020-11-20T12:13:18.022 INFO:teuthology.task.install:The correct ceph version 16.0.0-7397.gb86e691b is installed. 2020-11-20T12:13:18.023 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-11-20T12:13:18.024 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:18.025 INFO:teuthology.orchestra.run.smithi093:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:18.048 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:18.058 INFO:teuthology.orchestra.run.smithi093.stderr:24+1 records in 2020-11-20T12:13:18.059 INFO:teuthology.orchestra.run.smithi093.stderr:24+1 records out 2020-11-20T12:13:18.059 INFO:teuthology.orchestra.run.smithi093.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.8524e-05 s, 161 MB/s 2020-11-20T12:13:18.060 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:13:18.060 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:18.078 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:18.089 INFO:teuthology.orchestra.run.smithi066.stderr:24+1 records in 2020-11-20T12:13:18.089 INFO:teuthology.orchestra.run.smithi066.stderr:24+1 records out 2020-11-20T12:13:18.089 INFO:teuthology.orchestra.run.smithi066.stderr:12667 bytes (13 kB, 12 KiB) copied, 8.3107e-05 s, 152 MB/s 2020-11-20T12:13:18.090 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:13:18.091 INFO:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:18.109 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2020-11-20T12:13:18.120 INFO:teuthology.orchestra.run.smithi132.stderr:24+1 records in 2020-11-20T12:13:18.121 INFO:teuthology.orchestra.run.smithi132.stderr:24+1 records out 2020-11-20T12:13:18.121 INFO:teuthology.orchestra.run.smithi132.stderr:12667 bytes (13 kB, 12 KiB) copied, 7.7595e-05 s, 163 MB/s 2020-11-20T12:13:18.122 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-11-20T12:13:18.122 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:18.123 INFO:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.140 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.151 INFO:teuthology.orchestra.run.smithi093.stderr:5+1 records in 2020-11-20T12:13:18.152 INFO:teuthology.orchestra.run.smithi093.stderr:5+1 records out 2020-11-20T12:13:18.152 INFO:teuthology.orchestra.run.smithi093.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.0376e-05 s, 75.7 MB/s 2020-11-20T12:13:18.153 INFO:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T12:13:18.221 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:13:18.221 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.235 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.246 INFO:teuthology.orchestra.run.smithi066.stderr:5+1 records in 2020-11-20T12:13:18.246 INFO:teuthology.orchestra.run.smithi066.stderr:5+1 records out 2020-11-20T12:13:18.247 INFO:teuthology.orchestra.run.smithi066.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.3744e-05 s, 69.9 MB/s 2020-11-20T12:13:18.248 INFO:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T12:13:18.314 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:13:18.314 INFO:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.330 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd of=/usr/bin/daemon-helper 2020-11-20T12:13:18.342 INFO:teuthology.orchestra.run.smithi132.stderr:5+1 records in 2020-11-20T12:13:18.342 INFO:teuthology.orchestra.run.smithi132.stderr:5+1 records out 2020-11-20T12:13:18.343 INFO:teuthology.orchestra.run.smithi132.stderr:3058 bytes (3.1 kB, 3.0 KiB) copied, 4.4458e-05 s, 68.8 MB/s 2020-11-20T12:13:18.345 INFO:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-11-20T12:13:18.412 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-11-20T12:13:18.413 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:18.413 INFO:teuthology.orchestra.run.smithi093:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.430 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:13:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:13:18.442 INFO:teuthology.orchestra.run.smithi093.stderr:299 bytes copied, 3.5766e-05 s, 8.4 MB/s 2020-11-20T12:13:18.443 INFO:teuthology.orchestra.run.smithi093:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T12:13:18.511 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:13:18.511 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.525 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.535 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:13:18.536 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:13:18.536 INFO:teuthology.orchestra.run.smithi066.stderr:299 bytes copied, 3.143e-05 s, 9.5 MB/s 2020-11-20T12:13:18.537 INFO:teuthology.orchestra.run.smithi066:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T12:13:18.603 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:13:18.604 INFO:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.620 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd of=/usr/bin/adjust-ulimits 2020-11-20T12:13:18.631 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:13:18.632 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:13:18.632 INFO:teuthology.orchestra.run.smithi132.stderr:299 bytes copied, 3.6816e-05 s, 8.1 MB/s 2020-11-20T12:13:18.633 INFO:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-11-20T12:13:18.701 INFO:teuthology.run_tasks:Running task ceph... 2020-11-20T12:13:18.766 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-11-20T12:13:18.767 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 777 /var/log/ceph 2020-11-20T12:13:18.769 INFO:teuthology.orchestra.run.smithi093:> sudo chmod 777 /var/log/ceph 2020-11-20T12:13:18.772 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2020-11-20T12:13:18.801 INFO:tasks.ceph:Disabling ceph logrotate... 2020-11-20T12:13:18.802 INFO:teuthology.orchestra.run.smithi066:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T12:13:18.836 INFO:teuthology.orchestra.run.smithi093:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T12:13:18.840 INFO:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2020-11-20T12:13:18.868 INFO:tasks.ceph:Creating extra log directories... 2020-11-20T12:13:18.868 INFO:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T12:13:18.900 INFO:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T12:13:19.052 INFO:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-11-20T12:13:19.331 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-11-20T12:13:19.332 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-11-20T12:13:19.333 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-11-20T12:13:19.333 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:19.334 INFO:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.356 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.359 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:13:19.359 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:13:19.360 INFO:teuthology.orchestra.run.smithi093.stderr:408 bytes copied, 0.00252261 s, 162 kB/s 2020-11-20T12:13:19.360 INFO:teuthology.orchestra.run.smithi093:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:19.482 INFO:teuthology.orchestra.run.smithi093:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:19.514 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:13:19.514 INFO:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.540 INFO:teuthology.orchestra.run.smithi066.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.544 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:13:19.545 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:13:19.545 INFO:teuthology.orchestra.run.smithi066.stderr:408 bytes copied, 0.00374663 s, 109 kB/s 2020-11-20T12:13:19.546 INFO:teuthology.orchestra.run.smithi066:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:19.671 INFO:teuthology.orchestra.run.smithi066:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:19.705 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:13:19.706 INFO:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.730 INFO:teuthology.orchestra.run.smithi132.stderr:+ dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-11-20T12:13:19.733 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:13:19.733 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:13:19.733 INFO:teuthology.orchestra.run.smithi132.stderr:408 bytes copied, 0.00221004 s, 185 kB/s 2020-11-20T12:13:19.734 INFO:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:19.862 INFO:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:19.909 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-11-20T12:13:19.910 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2020-11-20T12:13:19.910 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi/5640305', 'branch': 'wip-pdonnell-testing-20201120.053228', 'description': 'fs/workload/{begin clusters/1a2s-mds-1c-client-3node conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore-ec/bluestore-ec-root omap_limit/10 overrides/{frag_enable osd-asserts session_timeout whitelist_health whitelist_wrongly_marked_down} tasks/workunit/kernel_untar_build}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '5640305', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2020-11-20_08:39:42-fs-wip-pdonnell-testing-20201120.053228-distro-basic-smithi', 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.3', 'overrides': {'admin_socket': {'branch': 'wip-pdonnell-testing-20201120.053228'}, 'ceph': {'cephfs': {'session_timeout': 300}, 'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-pdonnell-testing-20201120.053228', 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 95, 'repo': 'git://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.x', 'mds.a', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'], ['mon.b', 'mgr.y', 'mds.b', 'osd.1', 'osd.4', 'osd.7', 'osd.10'], ['mon.c', 'mgr.z', 'mds.c', 'osd.2', 'osd.5', 'osd.8', 'osd.11']], 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'sleep_before_teardown': 0, 'suite': 'fs', 'suite_branch': 'wip-pdonnell-testing-20201120.053228', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20201120.053228/qa', 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb', 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (3, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'sha1': 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'}}, {'ceph': None}, {'kclient': None}, {'check-counter': {'counters': {'mds': ['mds.dir_split']}}}, {'workunit': {'clients': {'all': ['kernel_untar_build.sh']}}}], 'teuthology_branch': 'master', 'timestamp': '2020-11-20_08:39:42', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.21151', 'targets': {'smithi093.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDwemX6/TcjI085GGC4d1QmTSRpFcOkMKlFq03Cy1FeXmM869WwdFFeUpai/BGY3zOnczsR/NUCDSN5DUQyV9ZEMiFllrK/LnEm4Vxh/o1X17OWi+0bFDuOY6XtOWmiC7y/MFxHtoS+3Th7onq+XK37L65zlOA9QQM9xr26+Mk5EeAZ9Eyofw6uVQB1ZbsYgT3ykWtXnjTiQEh6hLwI7ockOvGSuwOVN0uVze778LUi3jkfl+JEuUfLeGUTludcxX0cHtP13/KwAnS9CziRF0EoFYQdU6M8LKIMtrET2ruIDPpwJyUxYxgZUzDKpBTfPJf2OlUXrETGnUpzacAa/xPkgg9AOSfjs9OgAeJZLsynHmXVEb3LaWkiDhX8Ou/CS9Q4jbY5PS5MqSMOxJsGAHIekmQBURZUYz4DBgjzryKQoSx43wKwLSSU9ia56KAaGidkqaDkOYpiYRPLTS9hhB+8/9WZmiESXL88Bz+BChp3wWaa8O+tSIssE80qTdTk4JM=', 'smithi066.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDETzklulgZf9iOkqm6Cph+dC9vlmFslG8Uc2Oiu3lnnH3GsMPIqvSZ4DRUi8gd5io4g8y6W4O1GrtnInoYZ1seH6nm4CjRBhmTfnInQDw3ohGYdj+u0bbZcl4eqW/wdX2NjYr61WgjP6WHw0ZAQAjzqbVMQOm6MbvHTBYhtpFmLbsdqVIDFezhQNtit+BiMh2wWRnHOrRMGI8qIbxEF5DTUqKt1F2B/hhyVMfoeW29Ab2X5MU4Unl8kiB41wizcGRkDDZ8cmgzCJpbfH4IqwrFQYVJaBJkRhGxo3s4KpYZeMyqxNl8F1xW7VOeKsQIfDL5YZwRtwgwvQEk7DPEl6pK0qJp8ZbYcx8wjGQJMG0F0wFGsLGHijc+vyuoOZzhONjJBmZplRepBI5vpdS/Ur3VQLAmnqeN2gkSS4IGaMjo/zZ2JOLcHjJGqTBY4vVkYYsqCDOEpdAywHQm051dy7JYXXq4N13C2N3jF20axusArrgH4W+LolvwpGjuAD5IN6M=', 'smithi132.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDAl//kXSjtIaY94UKPY9NDOVuAv62Wnr4qs1PmsK6Ko0UY39HeFPLMhGh3tuRzPI8AFJb03YiUqMUdqfk9CmwjthjLTkqNv/I8t3DT+CzImQh917aclUW9dCDTsJsy7qBEPJnIqPBG/5HpKRUKsE0QIb8y/JaFd1v/223EYFKxmBQAfn9OUL/WdNDVBzBDYM4v6BWmvpORKyYF6sYQP949fxFwSpRZ8dqAaK1Qv7vmg6atkZDiSA91rbh1xYWPVObdNhqsDVTFlgfB6jB0NPbZisfTlqEx1tPaDUBb/pa74QDlTIO/OkNZM3jm0YCDnZxPQ0pirBz5F1rCqRH7BIGIIky3i79YpDe7mkSTI2SnG/243XcLVkHh9XMrGkNdZlTtkSu6rsu/v1S3hDPWclZHpWNOucu0Yxs94u677U2Iy6PKIfG6C+ih0WH1c8SODIDTE2D2nY/FBQtIbiVDlEL9jsr5AOC3QQGgvZqWdTeaVgXvO9M4jYs2qfr7UxYWU0U='}} 2020-11-20T12:13:19.912 INFO:teuthology.orchestra.run.smithi066:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T12:13:19.920 INFO:teuthology.orchestra.run.smithi093:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T12:13:19.929 INFO:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-11-20T12:13:19.960 INFO:teuthology.orchestra.run.smithi066:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T12:13:19.989 INFO:teuthology.orchestra.run.smithi093:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T12:13:19.998 INFO:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2020-11-20T12:13:20.035 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:20.036 INFO:teuthology.orchestra.run.smithi093:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.087 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.090 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/vg_nvme/lv_1 2020-11-20T12:13:20.091 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/vg_nvme/lv_2 2020-11-20T12:13:20.091 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/vg_nvme/lv_3 2020-11-20T12:13:20.091 INFO:teuthology.orchestra.run.smithi093.stdout:/dev/vg_nvme/lv_4 2020-11-20T12:13:20.092 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:13:20.092 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:13:20.093 INFO:teuthology.orchestra.run.smithi093.stderr:72 bytes copied, 3.4629e-05 s, 2.1 MB/s 2020-11-20T12:13:20.093 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T12:13:20.094 INFO:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T12:13:20.158 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T12:13:20.159 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.160 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 60435 Links: 1 2020-11-20T12:13:20.160 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.161 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.162 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2020-11-20 12:13:04.993875990 +0000 2020-11-20T12:13:20.162 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2020-11-20 12:10:52.820702047 +0000 2020-11-20T12:13:20.163 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2020-11-20 12:10:52.820702047 +0000 2020-11-20T12:13:20.163 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2020-11-20T12:13:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2020-11-20T12:13:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2020-11-20T12:13:20.168 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000253253 s, 2.0 MB/s 2020-11-20T12:13:20.171 INFO:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T12:13:20.239 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T12:13:20.239 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.240 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 57550 Links: 1 2020-11-20T12:13:20.240 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.240 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.240 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2020-11-20 12:13:04.993875990 +0000 2020-11-20T12:13:20.240 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2020-11-20 12:10:53.157694230 +0000 2020-11-20T12:13:20.241 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2020-11-20 12:10:53.157694230 +0000 2020-11-20T12:13:20.241 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2020-11-20T12:13:20.250 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2020-11-20T12:13:20.250 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2020-11-20T12:13:20.251 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000222745 s, 2.3 MB/s 2020-11-20T12:13:20.253 INFO:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T12:13:20.323 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T12:13:20.323 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.324 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 54266 Links: 1 2020-11-20T12:13:20.324 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.324 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.324 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2020-11-20 12:13:04.993875990 +0000 2020-11-20T12:13:20.324 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2020-11-20 12:10:53.491686480 +0000 2020-11-20T12:13:20.325 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2020-11-20 12:10:53.491686480 +0000 2020-11-20T12:13:20.325 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2020-11-20T12:13:20.333 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2020-11-20T12:13:20.334 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2020-11-20T12:13:20.336 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.00021816 s, 2.3 MB/s 2020-11-20T12:13:20.339 INFO:teuthology.orchestra.run.smithi093:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T12:13:20.408 INFO:teuthology.orchestra.run.smithi093.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T12:13:20.408 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.408 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 6h/6d Inode: 57590 Links: 1 2020-11-20T12:13:20.409 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.409 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.409 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 2020-11-20 12:13:04.993875990 +0000 2020-11-20T12:13:20.409 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2020-11-20 12:10:53.812679032 +0000 2020-11-20T12:13:20.410 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2020-11-20 12:10:53.812679032 +0000 2020-11-20T12:13:20.410 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2020-11-20T12:13:20.417 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records in 2020-11-20T12:13:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:1+0 records out 2020-11-20T12:13:20.418 INFO:teuthology.orchestra.run.smithi093.stderr:512 bytes copied, 0.000211884 s, 2.4 MB/s 2020-11-20T12:13:20.420 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:20.421 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:13:20.422 INFO:teuthology.orchestra.run.smithi066:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.445 INFO:teuthology.orchestra.run.smithi066.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.447 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_1 2020-11-20T12:13:20.447 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_2 2020-11-20T12:13:20.447 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_3 2020-11-20T12:13:20.448 INFO:teuthology.orchestra.run.smithi066.stdout:/dev/vg_nvme/lv_4 2020-11-20T12:13:20.448 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:13:20.448 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:13:20.448 INFO:teuthology.orchestra.run.smithi066.stderr:72 bytes copied, 4.3081e-05 s, 1.7 MB/s 2020-11-20T12:13:20.449 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T12:13:20.449 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T12:13:20.511 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T12:13:20.512 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.512 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 56796 Links: 1 2020-11-20T12:13:20.513 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.513 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.513 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-11-20 12:13:12.076760011 +0000 2020-11-20T12:13:20.514 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-11-20 12:11:02.655378728 +0000 2020-11-20T12:13:20.514 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-11-20 12:11:02.655378728 +0000 2020-11-20T12:13:20.515 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-11-20T12:13:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-11-20T12:13:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-11-20T12:13:20.525 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000244745 s, 2.1 MB/s 2020-11-20T12:13:20.526 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T12:13:20.596 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T12:13:20.597 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.597 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 60450 Links: 1 2020-11-20T12:13:20.597 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.597 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.598 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-11-20 12:13:12.076760011 +0000 2020-11-20T12:13:20.598 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-11-20 12:11:03.010376474 +0000 2020-11-20T12:13:20.598 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-11-20 12:11:03.010376474 +0000 2020-11-20T12:13:20.598 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-11-20T12:13:20.605 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-11-20T12:13:20.605 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-11-20T12:13:20.606 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.00023567 s, 2.2 MB/s 2020-11-20T12:13:20.609 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T12:13:20.672 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T12:13:20.672 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.672 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 59586 Links: 1 2020-11-20T12:13:20.672 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.673 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.673 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-11-20 12:13:12.076760011 +0000 2020-11-20T12:13:20.673 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-11-20 12:11:03.373374169 +0000 2020-11-20T12:13:20.673 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-11-20 12:11:03.373374169 +0000 2020-11-20T12:13:20.674 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-11-20T12:13:20.683 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-11-20T12:13:20.684 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-11-20T12:13:20.684 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000225277 s, 2.3 MB/s 2020-11-20T12:13:20.686 INFO:teuthology.orchestra.run.smithi066:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T12:13:20.746 INFO:teuthology.orchestra.run.smithi066.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T12:13:20.747 INFO:teuthology.orchestra.run.smithi066.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.747 INFO:teuthology.orchestra.run.smithi066.stdout:Device: 6h/6d Inode: 60510 Links: 1 2020-11-20T12:13:20.747 INFO:teuthology.orchestra.run.smithi066.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.748 INFO:teuthology.orchestra.run.smithi066.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.748 INFO:teuthology.orchestra.run.smithi066.stdout:Access: 2020-11-20 12:13:12.076760011 +0000 2020-11-20T12:13:20.748 INFO:teuthology.orchestra.run.smithi066.stdout:Modify: 2020-11-20 12:11:03.728371915 +0000 2020-11-20T12:13:20.748 INFO:teuthology.orchestra.run.smithi066.stdout:Change: 2020-11-20 12:11:03.728371915 +0000 2020-11-20T12:13:20.748 INFO:teuthology.orchestra.run.smithi066.stdout: Birth: - 2020-11-20T12:13:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records in 2020-11-20T12:13:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:1+0 records out 2020-11-20T12:13:20.758 INFO:teuthology.orchestra.run.smithi066.stderr:512 bytes copied, 0.000213961 s, 2.4 MB/s 2020-11-20T12:13:20.761 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:20.761 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:13:20.762 INFO:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.784 INFO:teuthology.orchestra.run.smithi132.stderr:+ dd if=/scratch_devs of=/dev/stdout 2020-11-20T12:13:20.784 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:13:20.785 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:13:20.785 INFO:teuthology.orchestra.run.smithi132.stderr:72 bytes copied, 4.0334e-05 s, 1.8 MB/s 2020-11-20T12:13:20.785 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/vg_nvme/lv_1 2020-11-20T12:13:20.786 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/vg_nvme/lv_2 2020-11-20T12:13:20.786 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/vg_nvme/lv_3 2020-11-20T12:13:20.787 INFO:teuthology.orchestra.run.smithi132.stdout:/dev/vg_nvme/lv_4 2020-11-20T12:13:20.787 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2020-11-20T12:13:20.788 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-11-20T12:13:20.847 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2020-11-20T12:13:20.847 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.848 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 54218 Links: 1 2020-11-20T12:13:20.848 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.849 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.849 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-11-20 12:13:09.808270346 +0000 2020-11-20T12:13:20.850 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-11-20 12:10:59.603326133 +0000 2020-11-20T12:13:20.850 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-11-20 12:10:59.603326133 +0000 2020-11-20T12:13:20.851 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-11-20T12:13:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-11-20T12:13:20.857 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-11-20T12:13:20.858 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000272063 s, 1.9 MB/s 2020-11-20T12:13:20.860 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-11-20T12:13:20.920 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2020-11-20T12:13:20.921 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.921 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 60449 Links: 1 2020-11-20T12:13:20.921 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.921 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.922 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-11-20 12:13:09.808270346 +0000 2020-11-20T12:13:20.922 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-11-20 12:10:59.949317500 +0000 2020-11-20T12:13:20.922 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-11-20 12:10:59.949317500 +0000 2020-11-20T12:13:20.922 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-11-20T12:13:20.933 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-11-20T12:13:20.934 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-11-20T12:13:20.934 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000254724 s, 2.0 MB/s 2020-11-20T12:13:20.936 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-11-20T12:13:20.995 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-11-20T12:13:20.997 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:20.997 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 56059 Links: 1 2020-11-20T12:13:20.998 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:20.999 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:20.999 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-11-20 12:13:09.808270346 +0000 2020-11-20T12:13:21.000 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-11-20 12:11:00.267309567 +0000 2020-11-20T12:13:21.000 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-11-20 12:11:00.267309567 +0000 2020-11-20T12:13:21.001 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-11-20T12:13:21.006 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-11-20T12:13:21.007 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-11-20T12:13:21.008 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000222411 s, 2.3 MB/s 2020-11-20T12:13:21.014 INFO:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-11-20T12:13:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2020-11-20T12:13:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-11-20T12:13:21.073 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 6h/6d Inode: 56105 Links: 1 2020-11-20T12:13:21.073 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:13:21.074 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2020-11-20T12:13:21.074 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2020-11-20 12:13:09.808270346 +0000 2020-11-20T12:13:21.074 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2020-11-20 12:11:00.589301534 +0000 2020-11-20T12:13:21.074 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2020-11-20 12:11:00.589301534 +0000 2020-11-20T12:13:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: - 2020-11-20T12:13:21.082 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2020-11-20T12:13:21.083 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2020-11-20T12:13:21.083 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000220725 s, 2.3 MB/s 2020-11-20T12:13:21.085 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:21.086 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T12:13:21.086 INFO:tasks.ceph:Generating config... 2020-11-20T12:13:21.087 INFO:tasks.ceph:[client] client mount timeout = 600 2020-11-20T12:13:21.088 INFO:tasks.ceph:[client] debug client = 20 2020-11-20T12:13:21.088 INFO:tasks.ceph:[client] debug ms = 1 2020-11-20T12:13:21.088 INFO:tasks.ceph:[client] rados mon op timeout = 15m 2020-11-20T12:13:21.088 INFO:tasks.ceph:[client] rados osd op timeout = 15m 2020-11-20T12:13:21.089 INFO:tasks.ceph:[global] ms die on skipped message = False 2020-11-20T12:13:21.089 INFO:tasks.ceph:[mds] debug mds = 20 2020-11-20T12:13:21.089 INFO:tasks.ceph:[mds] debug ms = 1 2020-11-20T12:13:21.090 INFO:tasks.ceph:[mds] mds bal frag = True 2020-11-20T12:13:21.090 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-11-20T12:13:21.090 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-11-20T12:13:21.090 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-11-20T12:13:21.091 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-11-20T12:13:21.091 INFO:tasks.ceph:[mds] mds debug frag = True 2020-11-20T12:13:21.091 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-11-20T12:13:21.092 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-11-20T12:13:21.092 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-11-20T12:13:21.092 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-11-20T12:13:21.092 INFO:tasks.ceph:[mds] rados mon op timeout = 15m 2020-11-20T12:13:21.093 INFO:tasks.ceph:[mds] rados osd op timeout = 15m 2020-11-20T12:13:21.093 INFO:tasks.ceph:[mgr] debug mgr = 20 2020-11-20T12:13:21.093 INFO:tasks.ceph:[mgr] debug ms = 1 2020-11-20T12:13:21.094 INFO:tasks.ceph:[mon] debug mon = 20 2020-11-20T12:13:21.094 INFO:tasks.ceph:[mon] debug ms = 1 2020-11-20T12:13:21.094 INFO:tasks.ceph:[mon] debug paxos = 20 2020-11-20T12:13:21.094 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-11-20T12:13:21.095 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-11-20T12:13:21.095 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-11-20T12:13:21.095 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-11-20T12:13:21.096 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-11-20T12:13:21.096 INFO:tasks.ceph:[osd] debug filestore = 20 2020-11-20T12:13:21.096 INFO:tasks.ceph:[osd] debug journal = 20 2020-11-20T12:13:21.097 INFO:tasks.ceph:[osd] debug ms = 20 2020-11-20T12:13:21.097 INFO:tasks.ceph:[osd] debug osd = 25 2020-11-20T12:13:21.097 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-11-20T12:13:21.098 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-11-20T12:13:21.098 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-11-20T12:13:21.098 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-11-20T12:13:21.098 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-11-20T12:13:21.099 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-11-20T12:13:21.099 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-11-20T12:13:21.099 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2020-11-20T12:13:21.100 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10 2020-11-20T12:13:21.100 INFO:tasks.ceph:Setting up mon.a... 2020-11-20T12:13:21.100 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-11-20T12:13:21.155 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.keyring 2020-11-20T12:13:21.157 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-11-20T12:13:21.199 INFO:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:21.264 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.93'), ('mon.b', '172.21.15.66'), ('mon.c', '172.21.15.132')] 2020-11-20T12:13:21.265 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.93,172.21.15.66,172.21.15.132', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug filestore': 20, 'debug journal': 20, 'debug ms': 20, 'debug osd': 25, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': '15m', 'rados osd op timeout': '15m'}} 2020-11-20T12:13:21.266 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:21.266 INFO:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T12:13:21.317 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T12:13:21.318 INFO:teuthology.orchestra.run.smithi093.stderr:6+1 records in 2020-11-20T12:13:21.319 INFO:teuthology.orchestra.run.smithi093.stderr:6+1 records out 2020-11-20T12:13:21.319 INFO:teuthology.orchestra.run.smithi093.stderr:3500 bytes (3.5 kB, 3.4 KiB) copied, 3.8492e-05 s, 90.9 MB/s 2020-11-20T12:13:21.319 INFO:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.93 --add b 172.21.15.66 --add c 172.21.15.132 --print /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:21.399 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:21.399 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: generated fsid c8cfafc9-773d-4a52-b4ca-518048ab7244 2020-11-20T12:13:21.399 INFO:teuthology.orchestra.run.smithi093.stdout:epoch 0 2020-11-20T12:13:21.400 INFO:teuthology.orchestra.run.smithi093.stdout:fsid c8cfafc9-773d-4a52-b4ca-518048ab7244 2020-11-20T12:13:21.400 INFO:teuthology.orchestra.run.smithi093.stdout:last_changed 2020-11-20T12:13:21.396604+0000 2020-11-20T12:13:21.400 INFO:teuthology.orchestra.run.smithi093.stdout:created 2020-11-20T12:13:21.396604+0000 2020-11-20T12:13:21.400 INFO:teuthology.orchestra.run.smithi093.stdout:min_mon_release 0 (unknown) 2020-11-20T12:13:21.401 INFO:teuthology.orchestra.run.smithi093.stdout:election_strategy: 1 2020-11-20T12:13:21.401 INFO:teuthology.orchestra.run.smithi093.stdout:0: [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] mon.a 2020-11-20T12:13:21.401 INFO:teuthology.orchestra.run.smithi093.stdout:1: [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] mon.b 2020-11-20T12:13:21.402 INFO:teuthology.orchestra.run.smithi093.stdout:2: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.c 2020-11-20T12:13:21.402 INFO:teuthology.orchestra.run.smithi093.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-11-20T12:13:21.403 INFO:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2020-11-20T12:13:21.457 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c8cfafc9-773d-4a52-b4ca-518048ab7244... 2020-11-20T12:13:21.458 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T12:13:21.462 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T12:13:21.499 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-11-20T12:13:21.512 INFO:teuthology.orchestra.run.smithi066.stdout:[global] 2020-11-20T12:13:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: chdir = "" 2020-11-20T12:13:21.512 INFO:teuthology.orchestra.run.smithi066.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T12:13:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: auth supported = cephx 2020-11-20T12:13:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: filestore xattr use omap = true 2020-11-20T12:13:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.513 INFO:teuthology.orchestra.run.smithi066.stdout: mon clock drift allowed = 1.000 2020-11-20T12:13:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: osd crush chooseleaf type = 0 2020-11-20T12:13:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: auth debug = true 2020-11-20T12:13:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.514 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on old message = true 2020-11-20T12:13:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on bug = true 2020-11-20T12:13:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T12:13:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: mon pg warn max object skew = 0 2020-11-20T12:13:21.515 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T12:13:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T12:13:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default size = 2 2020-11-20T12:13:21.516 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow primary affinity = true 2020-11-20T12:13:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd allow pg remap = true 2020-11-20T12:13:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on legacy crush tunables = false 2020-11-20T12:13:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on crush straw calc version zero = false 2020-11-20T12:13:21.517 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on no sortbitwise = false 2020-11-20T12:13:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on osd down out interval zero = false 2020-11-20T12:13:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: mon warn on too few osds = false 2020-11-20T12:13:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T12:13:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T12:13:21.518 INFO:teuthology.orchestra.run.smithi066.stdout: mon_allow_pool_size_one = true 2020-11-20T12:13:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T12:13:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: osd default data pool replay window = 5 2020-11-20T12:13:21.519 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: mon allow pool delete = true 2020-11-20T12:13:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: mon cluster log file level = debug 2020-11-20T12:13:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: debug asserts on shutdown = true 2020-11-20T12:13:21.520 INFO:teuthology.orchestra.run.smithi066.stdout: mon health detail to clog = false 2020-11-20T12:13:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: mon host = "172.21.15.93,172.21.15.66,172.21.15.132" 2020-11-20T12:13:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: ms die on skipped message = False 2020-11-20T12:13:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: fsid = c8cfafc9-773d-4a52-b4ca-518048ab7244 2020-11-20T12:13:21.521 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.521 INFO:teuthology.orchestra.run.smithi066.stdout:[osd] 2020-11-20T12:13:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: osd journal size = 100 2020-11-20T12:13:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub load threshold = 5.0 2020-11-20T12:13:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: osd scrub max interval = 600 2020-11-20T12:13:21.522 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: osd recover clone overlap = true 2020-11-20T12:13:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: osd recovery max chunk = 1048576 2020-11-20T12:13:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug shutdown = true 2020-11-20T12:13:21.523 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug op order = true 2020-11-20T12:13:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug verify stray on activate = true 2020-11-20T12:13:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: osd open classes on start = true 2020-11-20T12:13:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug pg log writeout = true 2020-11-20T12:13:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.524 INFO:teuthology.orchestra.run.smithi066.stdout: osd deep scrub update digest min age = 30 2020-11-20T12:13:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: osd map max advance = 10 2020-11-20T12:13:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: journal zero on create = true 2020-11-20T12:13:21.525 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: filestore ondisk finisher threads = 3 2020-11-20T12:13:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: filestore apply finisher threads = 3 2020-11-20T12:13:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: bdev debug aio = true 2020-11-20T12:13:21.526 INFO:teuthology.orchestra.run.smithi066.stdout: osd debug misdirected ops = true 2020-11-20T12:13:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore block size = 96636764160 2020-11-20T12:13:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: bluestore fsck on mount = True 2020-11-20T12:13:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluefs = 20 2020-11-20T12:13:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: debug bluestore = 20 2020-11-20T12:13:21.527 INFO:teuthology.orchestra.run.smithi066.stdout: debug filestore = 20 2020-11-20T12:13:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: debug journal = 20 2020-11-20T12:13:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 20 2020-11-20T12:13:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: debug osd = 25 2020-11-20T12:13:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: debug rocksdb = 10 2020-11-20T12:13:21.528 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T12:13:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd full ratio = 0.9 2020-11-20T12:13:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd nearfull ratio = 0.8 2020-11-20T12:13:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: osd failsafe full ratio = 0.95 2020-11-20T12:13:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: osd objectstore = bluestore 2020-11-20T12:13:21.529 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-11-20T12:13:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: osd shutdown pgref assert = True 2020-11-20T12:13:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T12:13:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.530 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr] 2020-11-20T12:13:21.530 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-11-20T12:13:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: debug mgr = 20 2020-11-20T12:13:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-11-20T12:13:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-11-20T12:13:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:21.531 INFO:teuthology.orchestra.run.smithi066.stdout: mgr/telemetry/nag = false 2020-11-20T12:13:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.532 INFO:teuthology.orchestra.run.smithi066.stdout:[mon] 2020-11-20T12:13:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-11-20T12:13:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: debug mon = 20 2020-11-20T12:13:21.532 INFO:teuthology.orchestra.run.smithi066.stdout: debug paxos = 20 2020-11-20T12:13:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: debug auth = 20 2020-11-20T12:13:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: mon data avail warn = 5 2020-11-20T12:13:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: mon mgr mkfs grace = 240 2020-11-20T12:13:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:21.533 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd reporter subtree level = osd 2020-11-20T12:13:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: mon osd prime pg temp = true 2020-11-20T12:13:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: mon op complaint time = 120 2020-11-20T12:13:21.534 INFO:teuthology.orchestra.run.smithi066.stdout: 2020-11-20T12:13:21.534 INFO:teuthology.orchestra.run.smithi066.stdout:[client] 2020-11-20T12:13:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: rgw cache enabled = true 2020-11-20T12:13:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable ops log = true 2020-11-20T12:13:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: rgw enable usage log = true 2020-11-20T12:13:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T12:13:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T12:13:21.535 INFO:teuthology.orchestra.run.smithi066.stdout: client mount timeout = 600 2020-11-20T12:13:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: debug client = 20 2020-11-20T12:13:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-11-20T12:13:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 15m 2020-11-20T12:13:21.536 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 15m 2020-11-20T12:13:21.536 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.a] 2020-11-20T12:13:21.537 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.b] 2020-11-20T12:13:21.537 INFO:teuthology.orchestra.run.smithi066.stdout:[mon.c] 2020-11-20T12:13:21.537 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2020-11-20T12:13:21.537 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2020-11-20T12:13:21.537 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2020-11-20T12:13:21.538 INFO:teuthology.orchestra.run.smithi066.stdout:[mds] 2020-11-20T12:13:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: debug mds = 20 2020-11-20T12:13:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: debug ms = 1 2020-11-20T12:13:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal frag = True 2020-11-20T12:13:21.538 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal fragment size max = 10000 2020-11-20T12:13:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal merge size = 5 2020-11-20T12:13:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split bits = 3 2020-11-20T12:13:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: mds bal split size = 100 2020-11-20T12:13:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug frag = True 2020-11-20T12:13:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: mds debug scatterstat = True 2020-11-20T12:13:21.539 INFO:teuthology.orchestra.run.smithi066.stdout: mds op complaint time = 180 2020-11-20T12:13:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: mds verify scatter = True 2020-11-20T12:13:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: osd op complaint time = 180 2020-11-20T12:13:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: rados mon op timeout = 15m 2020-11-20T12:13:21.540 INFO:teuthology.orchestra.run.smithi066.stdout: rados osd op timeout = 15m 2020-11-20T12:13:21.541 INFO:teuthology.orchestra.run.smithi093.stdout:[global] 2020-11-20T12:13:21.542 INFO:teuthology.orchestra.run.smithi093.stdout: chdir = "" 2020-11-20T12:13:21.542 INFO:teuthology.orchestra.run.smithi093.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T12:13:21.542 INFO:teuthology.orchestra.run.smithi093.stdout: auth supported = cephx 2020-11-20T12:13:21.542 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.542 INFO:teuthology.orchestra.run.smithi093.stdout: filestore xattr use omap = true 2020-11-20T12:13:21.543 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.543 INFO:teuthology.orchestra.run.smithi093.stdout: mon clock drift allowed = 1.000 2020-11-20T12:13:21.543 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.543 INFO:teuthology.orchestra.run.smithi093.stdout: osd crush chooseleaf type = 0 2020-11-20T12:13:21.543 INFO:teuthology.orchestra.run.smithi093.stdout: auth debug = true 2020-11-20T12:13:21.544 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.544 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on old message = true 2020-11-20T12:13:21.544 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on bug = true 2020-11-20T12:13:21.544 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.544 INFO:teuthology.orchestra.run.smithi093.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T12:13:21.545 INFO:teuthology.orchestra.run.smithi093.stdout: mon pg warn max object skew = 0 2020-11-20T12:13:21.545 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.545 INFO:teuthology.orchestra.run.smithi093.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T12:13:21.545 INFO:teuthology.orchestra.run.smithi093.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T12:13:21.545 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.546 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default size = 2 2020-11-20T12:13:21.546 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.546 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow primary affinity = true 2020-11-20T12:13:21.546 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd allow pg remap = true 2020-11-20T12:13:21.546 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on legacy crush tunables = false 2020-11-20T12:13:21.547 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on crush straw calc version zero = false 2020-11-20T12:13:21.547 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on no sortbitwise = false 2020-11-20T12:13:21.547 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on osd down out interval zero = false 2020-11-20T12:13:21.547 INFO:teuthology.orchestra.run.smithi093.stdout: mon warn on too few osds = false 2020-11-20T12:13:21.547 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T12:13:21.547 INFO:teuthology.orchestra.run.smithi093.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T12:13:21.548 INFO:teuthology.orchestra.run.smithi093.stdout: mon_allow_pool_size_one = true 2020-11-20T12:13:21.548 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.548 INFO:teuthology.orchestra.run.smithi093.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T12:13:21.548 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.548 INFO:teuthology.orchestra.run.smithi093.stdout: osd default data pool replay window = 5 2020-11-20T12:13:21.549 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.549 INFO:teuthology.orchestra.run.smithi093.stdout: mon allow pool delete = true 2020-11-20T12:13:21.549 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.549 INFO:teuthology.orchestra.run.smithi093.stdout: mon cluster log file level = debug 2020-11-20T12:13:21.549 INFO:teuthology.orchestra.run.smithi093.stdout: debug asserts on shutdown = true 2020-11-20T12:13:21.550 INFO:teuthology.orchestra.run.smithi093.stdout: mon health detail to clog = false 2020-11-20T12:13:21.550 INFO:teuthology.orchestra.run.smithi093.stdout: mon host = "172.21.15.93,172.21.15.66,172.21.15.132" 2020-11-20T12:13:21.550 INFO:teuthology.orchestra.run.smithi093.stdout: ms die on skipped message = False 2020-11-20T12:13:21.550 INFO:teuthology.orchestra.run.smithi093.stdout: fsid = c8cfafc9-773d-4a52-b4ca-518048ab7244 2020-11-20T12:13:21.550 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.551 INFO:teuthology.orchestra.run.smithi093.stdout:[osd] 2020-11-20T12:13:21.551 INFO:teuthology.orchestra.run.smithi093.stdout: osd journal size = 100 2020-11-20T12:13:21.551 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.551 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub load threshold = 5.0 2020-11-20T12:13:21.551 INFO:teuthology.orchestra.run.smithi093.stdout: osd scrub max interval = 600 2020-11-20T12:13:21.552 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.552 INFO:teuthology.orchestra.run.smithi093.stdout: osd recover clone overlap = true 2020-11-20T12:13:21.552 INFO:teuthology.orchestra.run.smithi093.stdout: osd recovery max chunk = 1048576 2020-11-20T12:13:21.552 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.552 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug shutdown = true 2020-11-20T12:13:21.553 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug op order = true 2020-11-20T12:13:21.553 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug verify stray on activate = true 2020-11-20T12:13:21.553 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.553 INFO:teuthology.orchestra.run.smithi093.stdout: osd open classes on start = true 2020-11-20T12:13:21.553 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug pg log writeout = true 2020-11-20T12:13:21.554 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.554 INFO:teuthology.orchestra.run.smithi093.stdout: osd deep scrub update digest min age = 30 2020-11-20T12:13:21.554 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.554 INFO:teuthology.orchestra.run.smithi093.stdout: osd map max advance = 10 2020-11-20T12:13:21.554 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.554 INFO:teuthology.orchestra.run.smithi093.stdout: journal zero on create = true 2020-11-20T12:13:21.555 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.555 INFO:teuthology.orchestra.run.smithi093.stdout: filestore ondisk finisher threads = 3 2020-11-20T12:13:21.555 INFO:teuthology.orchestra.run.smithi093.stdout: filestore apply finisher threads = 3 2020-11-20T12:13:21.555 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.555 INFO:teuthology.orchestra.run.smithi093.stdout: bdev debug aio = true 2020-11-20T12:13:21.556 INFO:teuthology.orchestra.run.smithi093.stdout: osd debug misdirected ops = true 2020-11-20T12:13:21.556 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore block size = 96636764160 2020-11-20T12:13:21.556 INFO:teuthology.orchestra.run.smithi093.stdout: bluestore fsck on mount = True 2020-11-20T12:13:21.556 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluefs = 20 2020-11-20T12:13:21.556 INFO:teuthology.orchestra.run.smithi093.stdout: debug bluestore = 20 2020-11-20T12:13:21.557 INFO:teuthology.orchestra.run.smithi093.stdout: debug filestore = 20 2020-11-20T12:13:21.557 INFO:teuthology.orchestra.run.smithi093.stdout: debug journal = 20 2020-11-20T12:13:21.557 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 20 2020-11-20T12:13:21.557 INFO:teuthology.orchestra.run.smithi093.stdout: debug osd = 25 2020-11-20T12:13:21.557 INFO:teuthology.orchestra.run.smithi093.stdout: debug rocksdb = 10 2020-11-20T12:13:21.558 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T12:13:21.558 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd full ratio = 0.9 2020-11-20T12:13:21.558 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd nearfull ratio = 0.8 2020-11-20T12:13:21.558 INFO:teuthology.orchestra.run.smithi093.stdout: osd failsafe full ratio = 0.95 2020-11-20T12:13:21.558 INFO:teuthology.orchestra.run.smithi093.stdout: osd objectstore = bluestore 2020-11-20T12:13:21.559 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2020-11-20T12:13:21.559 INFO:teuthology.orchestra.run.smithi093.stdout: osd shutdown pgref assert = True 2020-11-20T12:13:21.559 INFO:teuthology.orchestra.run.smithi093.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T12:13:21.559 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.559 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr] 2020-11-20T12:13:21.559 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2020-11-20T12:13:21.560 INFO:teuthology.orchestra.run.smithi093.stdout: debug mgr = 20 2020-11-20T12:13:21.560 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2020-11-20T12:13:21.560 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2020-11-20T12:13:21.560 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:21.560 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:21.561 INFO:teuthology.orchestra.run.smithi093.stdout: mgr/telemetry/nag = false 2020-11-20T12:13:21.561 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.561 INFO:teuthology.orchestra.run.smithi093.stdout:[mon] 2020-11-20T12:13:21.561 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2020-11-20T12:13:21.561 INFO:teuthology.orchestra.run.smithi093.stdout: debug mon = 20 2020-11-20T12:13:21.562 INFO:teuthology.orchestra.run.smithi093.stdout: debug paxos = 20 2020-11-20T12:13:21.562 INFO:teuthology.orchestra.run.smithi093.stdout: debug auth = 20 2020-11-20T12:13:21.562 INFO:teuthology.orchestra.run.smithi093.stdout: mon data avail warn = 5 2020-11-20T12:13:21.562 INFO:teuthology.orchestra.run.smithi093.stdout: mon mgr mkfs grace = 240 2020-11-20T12:13:21.562 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd reporter subtree level = osd 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi093.stdout: mon osd prime pg temp = true 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi093.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi093.stdout: mon op complaint time = 120 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:13:21.563 INFO:teuthology.orchestra.run.smithi093.stdout:[client] 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi093.stdout: rgw cache enabled = true 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable ops log = true 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi093.stdout: rgw enable usage log = true 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi093.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T12:13:21.564 INFO:teuthology.orchestra.run.smithi093.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T12:13:21.565 INFO:teuthology.orchestra.run.smithi093.stdout: client mount timeout = 600 2020-11-20T12:13:21.565 INFO:teuthology.orchestra.run.smithi093.stdout: debug client = 20 2020-11-20T12:13:21.565 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2020-11-20T12:13:21.565 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 15m 2020-11-20T12:13:21.565 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 15m 2020-11-20T12:13:21.566 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.a] 2020-11-20T12:13:21.566 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.b] 2020-11-20T12:13:21.566 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.c] 2020-11-20T12:13:21.566 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2020-11-20T12:13:21.566 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2020-11-20T12:13:21.567 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2020-11-20T12:13:21.567 INFO:teuthology.orchestra.run.smithi093.stdout:[mds] 2020-11-20T12:13:21.567 INFO:teuthology.orchestra.run.smithi093.stdout: debug mds = 20 2020-11-20T12:13:21.567 INFO:teuthology.orchestra.run.smithi093.stdout: debug ms = 1 2020-11-20T12:13:21.567 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal frag = True 2020-11-20T12:13:21.567 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal fragment size max = 10000 2020-11-20T12:13:21.568 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal merge size = 5 2020-11-20T12:13:21.568 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal split bits = 3 2020-11-20T12:13:21.568 INFO:teuthology.orchestra.run.smithi093.stdout: mds bal split size = 100 2020-11-20T12:13:21.568 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug frag = True 2020-11-20T12:13:21.568 INFO:teuthology.orchestra.run.smithi093.stdout: mds debug scatterstat = True 2020-11-20T12:13:21.569 INFO:teuthology.orchestra.run.smithi093.stdout: mds op complaint time = 180 2020-11-20T12:13:21.569 INFO:teuthology.orchestra.run.smithi093.stdout: mds verify scatter = True 2020-11-20T12:13:21.569 INFO:teuthology.orchestra.run.smithi093.stdout: osd op complaint time = 180 2020-11-20T12:13:21.569 INFO:teuthology.orchestra.run.smithi093.stdout: rados mon op timeout = 15m 2020-11-20T12:13:21.569 INFO:teuthology.orchestra.run.smithi093.stdout: rados osd op timeout = 15m 2020-11-20T12:13:21.571 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2020-11-20T12:13:21.571 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2020-11-20T12:13:21.572 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-11-20T12:13:21.572 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2020-11-20T12:13:21.572 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.572 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2020-11-20T12:13:21.572 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.573 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2020-11-20T12:13:21.573 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.573 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2020-11-20T12:13:21.573 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2020-11-20T12:13:21.573 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.574 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2020-11-20T12:13:21.574 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2020-11-20T12:13:21.574 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.574 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2020-11-20T12:13:21.574 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2020-11-20T12:13:21.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.575 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2020-11-20T12:13:21.575 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2020-11-20T12:13:21.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.575 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2020-11-20T12:13:21.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.576 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2020-11-20T12:13:21.576 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2020-11-20T12:13:21.576 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2020-11-20T12:13:21.576 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2020-11-20T12:13:21.576 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2020-11-20T12:13:21.577 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2020-11-20T12:13:21.577 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2020-11-20T12:13:21.577 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-11-20T12:13:21.577 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2020-11-20T12:13:21.577 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2020-11-20T12:13:21.578 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.578 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-11-20T12:13:21.578 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.578 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2020-11-20T12:13:21.578 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.579 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2020-11-20T12:13:21.579 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.579 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2020-11-20T12:13:21.579 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2020-11-20T12:13:21.579 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2020-11-20T12:13:21.580 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.93,172.21.15.66,172.21.15.132" 2020-11-20T12:13:21.580 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on skipped message = False 2020-11-20T12:13:21.580 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = c8cfafc9-773d-4a52-b4ca-518048ab7244 2020-11-20T12:13:21.580 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.580 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2020-11-20T12:13:21.581 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2020-11-20T12:13:21.581 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.581 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2020-11-20T12:13:21.581 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2020-11-20T12:13:21.581 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.582 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2020-11-20T12:13:21.582 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2020-11-20T12:13:21.582 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.582 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2020-11-20T12:13:21.582 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2020-11-20T12:13:21.582 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2020-11-20T12:13:21.583 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.583 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2020-11-20T12:13:21.583 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2020-11-20T12:13:21.583 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.583 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2020-11-20T12:13:21.584 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.584 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2020-11-20T12:13:21.584 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.584 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2020-11-20T12:13:21.584 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.585 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2020-11-20T12:13:21.585 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2020-11-20T12:13:21.585 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.585 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2020-11-20T12:13:21.585 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2020-11-20T12:13:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2020-11-20T12:13:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2020-11-20T12:13:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 20 2020-11-20T12:13:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 20 2020-11-20T12:13:21.586 INFO:teuthology.orchestra.run.smithi132.stdout: debug filestore = 20 2020-11-20T12:13:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: debug journal = 20 2020-11-20T12:13:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 20 2020-11-20T12:13:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 25 2020-11-20T12:13:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 10 2020-11-20T12:13:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2020-11-20T12:13:21.587 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2020-11-20T12:13:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2020-11-20T12:13:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 0.95 2020-11-20T12:13:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = bluestore 2020-11-20T12:13:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2020-11-20T12:13:21.588 INFO:teuthology.orchestra.run.smithi132.stdout: osd shutdown pgref assert = True 2020-11-20T12:13:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: osd_max_omap_entries_per_request = 10 2020-11-20T12:13:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.589 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2020-11-20T12:13:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2020-11-20T12:13:21.589 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2020-11-20T12:13:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2020-11-20T12:13:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2020-11-20T12:13:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:21.590 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2020-11-20T12:13:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.591 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2020-11-20T12:13:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2020-11-20T12:13:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2020-11-20T12:13:21.591 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2020-11-20T12:13:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2020-11-20T12:13:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2020-11-20T12:13:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2020-11-20T12:13:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2020-11-20T12:13:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2020-11-20T12:13:21.592 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2020-11-20T12:13:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2020-11-20T12:13:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2020-11-20T12:13:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: 2020-11-20T12:13:21.593 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2020-11-20T12:13:21.593 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2020-11-20T12:13:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2020-11-20T12:13:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2020-11-20T12:13:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-11-20T12:13:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-11-20T12:13:21.594 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2020-11-20T12:13:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2020-11-20T12:13:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2020-11-20T12:13:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 15m 2020-11-20T12:13:21.595 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 15m 2020-11-20T12:13:21.595 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2020-11-20T12:13:21.596 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2020-11-20T12:13:21.596 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2020-11-20T12:13:21.596 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2020-11-20T12:13:21.596 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2020-11-20T12:13:21.596 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2020-11-20T12:13:21.596 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2020-11-20T12:13:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2020-11-20T12:13:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2020-11-20T12:13:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal frag = True 2020-11-20T12:13:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal fragment size max = 10000 2020-11-20T12:13:21.597 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal merge size = 5 2020-11-20T12:13:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal split bits = 3 2020-11-20T12:13:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: mds bal split size = 100 2020-11-20T12:13:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2020-11-20T12:13:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2020-11-20T12:13:21.598 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2020-11-20T12:13:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2020-11-20T12:13:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2020-11-20T12:13:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 15m 2020-11-20T12:13:21.599 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 15m 2020-11-20T12:13:21.600 INFO:tasks.ceph:Creating admin key on mon.a... 2020-11-20T12:13:21.600 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-11-20T12:13:21.659 INFO:tasks.ceph:Copying monmap to all nodes... 2020-11-20T12:13:21.659 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:21.660 INFO:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T12:13:21.673 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2020-11-20T12:13:21.674 INFO:teuthology.orchestra.run.smithi093.stdout:[mon.] 2020-11-20T12:13:21.674 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDhsrdfGjmWCxAAhZC5mVH6vV2PtnrkKVPKzA== 2020-11-20T12:13:21.674 INFO:teuthology.orchestra.run.smithi093.stdout:[client.admin] 2020-11-20T12:13:21.674 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDhsrdfDZIGJxAAklzbxtX9RuGC3uiChqfNTQ== 2020-11-20T12:13:21.675 INFO:teuthology.orchestra.run.smithi093.stdout: caps mds = "allow *" 2020-11-20T12:13:21.675 INFO:teuthology.orchestra.run.smithi093.stdout: caps mgr = "allow *" 2020-11-20T12:13:21.675 INFO:teuthology.orchestra.run.smithi093.stdout: caps mon = "allow *" 2020-11-20T12:13:21.676 INFO:teuthology.orchestra.run.smithi093.stdout: caps osd = "allow *" 2020-11-20T12:13:21.676 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:13:21.677 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:13:21.677 INFO:teuthology.orchestra.run.smithi093.stderr:206 bytes copied, 2.7482e-05 s, 7.5 MB/s 2020-11-20T12:13:21.677 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:21.678 INFO:teuthology.orchestra.run.smithi093:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T12:13:21.727 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2020-11-20T12:13:21.728 INFO:teuthology.orchestra.run.smithi093.stdout: ��ϯ�w=JR��Q�H�rDᲷ_Ჷ_�aXa �]��]bXb �B��BcXc �����abc 2020-11-20T12:13:21.728 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:13:21.729 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:13:21.729 INFO:teuthology.orchestra.run.smithi093.stderr:409 bytes copied, 2.7548e-05 s, 14.8 MB/s 2020-11-20T12:13:21.729 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi093.front.sepia.ceph.com 2020-11-20T12:13:21.730 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:21.731 INFO:teuthology.orchestra.run.smithi093:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:21.731 INFO:teuthology.orchestra.run.smithi093:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:21.782 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:21.791 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:13:21.791 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:13:21.792 INFO:teuthology.orchestra.run.smithi093.stderr:206 bytes copied, 5.3847e-05 s, 3.8 MB/s 2020-11-20T12:13:21.792 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:21.802 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:13:21.802 INFO:teuthology.orchestra.run.smithi093:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:21.855 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:21.856 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:13:21.857 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:13:21.857 INFO:teuthology.orchestra.run.smithi093.stderr:409 bytes copied, 5.4016e-05 s, 7.6 MB/s 2020-11-20T12:13:21.857 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi066.front.sepia.ceph.com 2020-11-20T12:13:21.857 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:13:21.858 INFO:teuthology.orchestra.run.smithi066:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:21.858 INFO:teuthology.orchestra.run.smithi066:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:21.875 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:21.887 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:13:21.887 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:13:21.887 INFO:teuthology.orchestra.run.smithi066.stderr:206 bytes copied, 3.8588e-05 s, 5.3 MB/s 2020-11-20T12:13:21.888 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:21.900 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:13:21.901 INFO:teuthology.orchestra.run.smithi066:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:21.955 INFO:teuthology.orchestra.run.smithi066.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:21.956 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:13:21.957 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:13:21.957 INFO:teuthology.orchestra.run.smithi066.stderr:409 bytes copied, 4.0093e-05 s, 10.2 MB/s 2020-11-20T12:13:21.958 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2020-11-20T12:13:21.958 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:13:21.958 INFO:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:21.959 INFO:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:21.975 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd of=/etc/ceph/ceph.keyring 2020-11-20T12:13:21.986 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:13:21.986 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:13:21.986 INFO:teuthology.orchestra.run.smithi132.stderr:206 bytes copied, 3.1312e-05 s, 6.6 MB/s 2020-11-20T12:13:21.987 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo chmod 0644 /etc/ceph/ceph.keyring 2020-11-20T12:13:21.999 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:13:22.000 INFO:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:22.053 INFO:teuthology.orchestra.run.smithi132.stderr:+ dd of=/home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:22.054 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:13:22.054 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:13:22.055 INFO:teuthology.orchestra.run.smithi132.stderr:409 bytes copied, 3.457e-05 s, 11.8 MB/s 2020-11-20T12:13:22.055 INFO:tasks.ceph:Setting up mon nodes... 2020-11-20T12:13:22.055 INFO:tasks.ceph:Setting up mgr nodes... 2020-11-20T12:13:22.056 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T12:13:22.102 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-11-20T12:13:22.104 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T12:13:22.177 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-11-20T12:13:22.180 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T12:13:22.250 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2020-11-20T12:13:22.252 INFO:tasks.ceph:Setting up mds nodes... 2020-11-20T12:13:22.252 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T12:13:22.299 INFO:teuthology.orchestra.run.smithi093.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-11-20T12:13:22.301 INFO:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-11-20T12:13:22.325 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T12:13:22.379 INFO:teuthology.orchestra.run.smithi066.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-11-20T12:13:22.382 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-11-20T12:13:22.408 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T12:13:22.460 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2020-11-20T12:13:22.462 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2020-11-20T12:13:22.488 INFO:tasks.ceph_client:Setting up client nodes... 2020-11-20T12:13:22.489 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-11-20T12:13:22.526 INFO:teuthology.orchestra.run.smithi093.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-11-20T12:13:22.538 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-11-20T12:13:22.539 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi093.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi066.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'}} 2020-11-20T12:13:22.539 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:22.603 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:22.604 INFO:tasks.ceph:role: osd.0 2020-11-20T12:13:22.604 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com 2020-11-20T12:13:22.604 INFO:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T12:13:22.675 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:22.675 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:22.676 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:22.676 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2020-11-20T12:13:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:22.676 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:22.676 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:22.677 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:22.677 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:22.677 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:23.042 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2020-11-20T12:13:23.044 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2020-11-20T12:13:23.044 INFO:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:23.162 INFO:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:23.195 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:23.263 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:23.263 INFO:tasks.ceph:role: osd.3 2020-11-20T12:13:23.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com 2020-11-20T12:13:23.264 INFO:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T12:13:23.337 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:23.337 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:23.337 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:23.337 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2020-11-20T12:13:23.338 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:23.338 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:23.338 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:23.338 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:23.338 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:23.339 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:23.697 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2020-11-20T12:13:23.699 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2020-11-20T12:13:23.699 INFO:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:23.795 INFO:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:23.824 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:23.891 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:23.892 INFO:tasks.ceph:role: osd.6 2020-11-20T12:13:23.892 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com 2020-11-20T12:13:23.892 INFO:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T12:13:23.963 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:23.964 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:23.964 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:23.964 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2020-11-20T12:13:23.964 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:23.965 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:23.965 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:23.965 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:23.965 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:23.966 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:24.327 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2020-11-20T12:13:24.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2020-11-20T12:13:24.332 INFO:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:24.441 INFO:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:24.479 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:24.547 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.3': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.9': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:24.548 INFO:tasks.ceph:role: osd.9 2020-11-20T12:13:24.548 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com 2020-11-20T12:13:24.548 INFO:teuthology.orchestra.run.smithi093:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T12:13:24.625 INFO:teuthology.orchestra.run.smithi093.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:24.626 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:24.626 INFO:teuthology.orchestra.run.smithi093.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:24.626 INFO:teuthology.orchestra.run.smithi093.stdout: = reflink=1 2020-11-20T12:13:24.626 INFO:teuthology.orchestra.run.smithi093.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:24.627 INFO:teuthology.orchestra.run.smithi093.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:24.627 INFO:teuthology.orchestra.run.smithi093.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:24.627 INFO:teuthology.orchestra.run.smithi093.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:24.627 INFO:teuthology.orchestra.run.smithi093.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:24.627 INFO:teuthology.orchestra.run.smithi093.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:24.997 INFO:teuthology.orchestra.run.smithi093.stdout:Discarding blocks...Done. 2020-11-20T12:13:24.998 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi093.front.sepia.ceph.com -o noatime 2020-11-20T12:13:24.999 INFO:teuthology.orchestra.run.smithi093:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:25.122 INFO:teuthology.orchestra.run.smithi093:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:25.149 INFO:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:25.230 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:25.227+0000 7ff2a191af40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-11-20T12:13:25.231 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:25.228+0000 7ff2a191af40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-11-20T12:13:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:25.228+0000 7ff2a191af40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T12:13:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:25.228+0000 7ff2a191af40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T12:13:25.232 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:25.228+0000 7ff2a191af40 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-11-20T12:13:25.238 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:25.236+0000 7ff2a191af40 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-11-20T12:13:28.086 INFO:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-11-20T12:13:28.162 INFO:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:28.254 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:28.250+0000 7fe518a8cf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-11-20T12:13:28.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:28.250+0000 7fe518a8cf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-11-20T12:13:28.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:28.250+0000 7fe518a8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T12:13:28.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:28.250+0000 7fe518a8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T12:13:28.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:28.250+0000 7fe518a8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-11-20T12:13:28.257 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:28.251+0000 7fe518a8cf40 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-11-20T12:13:31.094 INFO:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-11-20T12:13:31.173 INFO:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:31.275 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:31.270+0000 7f4eb5e91f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-11-20T12:13:31.275 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:31.271+0000 7f4eb5e91f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-11-20T12:13:31.276 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:31.271+0000 7f4eb5e91f40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T12:13:31.276 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:31.271+0000 7f4eb5e91f40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T12:13:31.276 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:31.271+0000 7f4eb5e91f40 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-11-20T12:13:31.277 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:31.271+0000 7f4eb5e91f40 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-11-20T12:13:34.122 INFO:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-11-20T12:13:34.191 INFO:teuthology.orchestra.run.smithi093:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 9 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:34.276 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:34.273+0000 7f655de2ef40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-9/keyring: can't open /var/lib/ceph/osd/ceph-9/keyring: (2) No such file or directory 2020-11-20T12:13:34.277 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:34.273+0000 7f655de2ef40 -1 created new key in keyring /var/lib/ceph/osd/ceph-9/keyring 2020-11-20T12:13:34.277 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:34.273+0000 7f655de2ef40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T12:13:34.277 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:34.273+0000 7f655de2ef40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T12:13:34.277 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:34.273+0000 7f655de2ef40 -1 bluestore(/var/lib/ceph/osd/ceph-9/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-9/block: (2) No such file or directory 2020-11-20T12:13:34.278 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:13:34.274+0000 7f655de2ef40 -1 bluestore(/var/lib/ceph/osd/ceph-9) _read_fsid unparsable uuid 2020-11-20T12:13:37.124 INFO:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-9 2020-11-20T12:13:37.160 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:37.193 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:37.194 INFO:tasks.ceph:role: osd.1 2020-11-20T12:13:37.194 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com 2020-11-20T12:13:37.195 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T12:13:37.276 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:37.277 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:37.278 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:37.279 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-11-20T12:13:37.279 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:37.281 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:37.281 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:37.282 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:37.282 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:37.282 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:37.634 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2020-11-20T12:13:37.635 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-11-20T12:13:37.636 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:37.765 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:37.801 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:37.873 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:37.874 INFO:tasks.ceph:role: osd.4 2020-11-20T12:13:37.874 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com 2020-11-20T12:13:37.875 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T12:13:37.949 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:37.949 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:37.949 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:37.950 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-11-20T12:13:37.950 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:37.950 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:37.950 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:37.951 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:37.951 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:37.951 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:38.302 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2020-11-20T12:13:38.304 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-11-20T12:13:38.305 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:38.401 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:38.432 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:38.499 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:38.500 INFO:tasks.ceph:role: osd.7 2020-11-20T12:13:38.500 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com 2020-11-20T12:13:38.500 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T12:13:38.572 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:38.573 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:38.573 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:38.574 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-11-20T12:13:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:38.574 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:38.574 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:38.575 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:38.575 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:38.936 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2020-11-20T12:13:38.938 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-11-20T12:13:38.939 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:39.044 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:39.075 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:39.143 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.10': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:39.143 INFO:tasks.ceph:role: osd.10 2020-11-20T12:13:39.143 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com 2020-11-20T12:13:39.144 INFO:teuthology.orchestra.run.smithi066:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T12:13:39.218 INFO:teuthology.orchestra.run.smithi066.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:39.218 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:39.218 INFO:teuthology.orchestra.run.smithi066.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:39.219 INFO:teuthology.orchestra.run.smithi066.stdout: = reflink=1 2020-11-20T12:13:39.219 INFO:teuthology.orchestra.run.smithi066.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:39.219 INFO:teuthology.orchestra.run.smithi066.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:39.219 INFO:teuthology.orchestra.run.smithi066.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:39.219 INFO:teuthology.orchestra.run.smithi066.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:39.220 INFO:teuthology.orchestra.run.smithi066.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:39.220 INFO:teuthology.orchestra.run.smithi066.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:39.590 INFO:teuthology.orchestra.run.smithi066.stdout:Discarding blocks...Done. 2020-11-20T12:13:39.592 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi066.front.sepia.ceph.com -o noatime 2020-11-20T12:13:39.592 INFO:teuthology.orchestra.run.smithi066:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:39.702 INFO:teuthology.orchestra.run.smithi066:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:39.734 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:39.822 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:39.819+0000 7f4a4485af40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-11-20T12:13:39.826 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:39.823+0000 7f4a4485af40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-11-20T12:13:39.827 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:39.823+0000 7f4a4485af40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T12:13:39.827 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:39.823+0000 7f4a4485af40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T12:13:39.827 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:39.823+0000 7f4a4485af40 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-11-20T12:13:39.829 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:39.826+0000 7f4a4485af40 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-11-20T12:13:42.676 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-11-20T12:13:42.982 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:43.077 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:43.074+0000 7f4549dbaf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-11-20T12:13:43.078 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:43.074+0000 7f4549dbaf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-11-20T12:13:43.078 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:43.074+0000 7f4549dbaf40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T12:13:43.078 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:43.074+0000 7f4549dbaf40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T12:13:43.079 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:43.074+0000 7f4549dbaf40 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-11-20T12:13:43.079 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:43.074+0000 7f4549dbaf40 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-11-20T12:13:45.921 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-11-20T12:13:45.963 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:46.060 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:46.056+0000 7f8979675f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-11-20T12:13:46.060 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:46.057+0000 7f8979675f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-11-20T12:13:46.061 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:46.057+0000 7f8979675f40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T12:13:46.061 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:46.057+0000 7f8979675f40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T12:13:46.061 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:46.057+0000 7f8979675f40 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-11-20T12:13:46.062 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:46.057+0000 7f8979675f40 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-11-20T12:13:48.904 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-11-20T12:13:48.934 INFO:teuthology.orchestra.run.smithi066:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 10 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:49.022 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:49.018+0000 7f31565c4f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-10/keyring: can't open /var/lib/ceph/osd/ceph-10/keyring: (2) No such file or directory 2020-11-20T12:13:49.022 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:49.019+0000 7f31565c4f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-10/keyring 2020-11-20T12:13:49.023 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:49.019+0000 7f31565c4f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T12:13:49.023 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:49.019+0000 7f31565c4f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T12:13:49.023 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:49.019+0000 7f31565c4f40 -1 bluestore(/var/lib/ceph/osd/ceph-10/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-10/block: (2) No such file or directory 2020-11-20T12:13:49.024 INFO:teuthology.orchestra.run.smithi066.stderr:2020-11-20T12:13:49.019+0000 7f31565c4f40 -1 bluestore(/var/lib/ceph/osd/ceph-10) _read_fsid unparsable uuid 2020-11-20T12:13:49.914 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:49.917 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:49.919 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:13:51.865 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-10 2020-11-20T12:13:51.902 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:51.933 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:51.934 INFO:tasks.ceph:role: osd.2 2020-11-20T12:13:51.934 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2020-11-20T12:13:51.935 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-11-20T12:13:52.012 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:52.013 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:52.013 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:52.014 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 2020-11-20T12:13:52.014 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:52.015 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:52.015 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:52.015 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:52.016 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:52.016 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:52.377 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2020-11-20T12:13:52.655 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2020-11-20T12:13:52.656 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:52.777 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:52.820 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-11-20T12:13:52.892 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:52.893 INFO:tasks.ceph:role: osd.5 2020-11-20T12:13:52.893 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2020-11-20T12:13:52.894 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-11-20T12:13:52.973 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:52.974 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:52.974 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:52.974 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 2020-11-20T12:13:52.975 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:52.975 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:52.975 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:52.975 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:52.975 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:52.976 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:53.343 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2020-11-20T12:13:53.344 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2020-11-20T12:13:53.345 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2020-11-20T12:13:53.463 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-11-20T12:13:53.501 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-8 2020-11-20T12:13:53.576 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:53.576 INFO:tasks.ceph:role: osd.8 2020-11-20T12:13:53.577 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2020-11-20T12:13:53.577 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-11-20T12:13:53.660 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:53.661 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:53.661 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:53.661 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 2020-11-20T12:13:53.661 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:53.662 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:53.662 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:53.662 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:53.662 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:53.663 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:54.031 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2020-11-20T12:13:54.033 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2020-11-20T12:13:54.033 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-8 2020-11-20T12:13:54.181 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-8 2020-11-20T12:13:54.215 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-11 2020-11-20T12:13:54.282 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.8': '/dev/vg_nvme/lv_3', 'osd.11': '/dev/vg_nvme/lv_4'} 2020-11-20T12:13:54.283 INFO:tasks.ceph:role: osd.11 2020-11-20T12:13:54.283 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2020-11-20T12:13:54.283 INFO:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-11-20T12:13:54.354 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-11-20T12:13:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2020-11-20T12:13:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-11-20T12:13:54.354 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 2020-11-20T12:13:54.355 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-11-20T12:13:54.355 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2020-11-20T12:13:54.355 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-11-20T12:13:54.355 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-11-20T12:13:54.356 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-11-20T12:13:54.356 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-11-20T12:13:54.717 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2020-11-20T12:13:54.718 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2020-11-20T12:13:54.718 INFO:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-11 2020-11-20T12:13:54.854 INFO:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-11 2020-11-20T12:13:54.882 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:54.964 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:54.961+0000 7f5814aeef40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-11-20T12:13:54.967 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:54.964+0000 7f5814aeef40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-11-20T12:13:54.967 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:54.964+0000 7f5814aeef40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T12:13:54.967 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:54.964+0000 7f5814aeef40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T12:13:54.967 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:54.964+0000 7f5814aeef40 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-11-20T12:13:54.969 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:54.966+0000 7f5814aeef40 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-11-20T12:13:57.812 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-11-20T12:13:57.904 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:13:58.016 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:58.012+0000 7f07c5cbcf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-11-20T12:13:58.016 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:58.013+0000 7f07c5cbcf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-11-20T12:13:58.016 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:58.013+0000 7f07c5cbcf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T12:13:58.017 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:58.013+0000 7f07c5cbcf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T12:13:58.017 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:58.013+0000 7f07c5cbcf40 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-11-20T12:13:58.017 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:13:58.013+0000 7f07c5cbcf40 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-11-20T12:14:00.857 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-11-20T12:14:00.926 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 8 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:14:01.014 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:01.010+0000 7f991de96f40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-8/keyring: can't open /var/lib/ceph/osd/ceph-8/keyring: (2) No such file or directory 2020-11-20T12:14:01.015 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:01.010+0000 7f991de96f40 -1 created new key in keyring /var/lib/ceph/osd/ceph-8/keyring 2020-11-20T12:14:01.015 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:01.010+0000 7f991de96f40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T12:14:01.015 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:01.010+0000 7f991de96f40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T12:14:01.015 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:01.010+0000 7f991de96f40 -1 bluestore(/var/lib/ceph/osd/ceph-8/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-8/block: (2) No such file or directory 2020-11-20T12:14:01.016 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:01.011+0000 7f991de96f40 -1 bluestore(/var/lib/ceph/osd/ceph-8) _read_fsid unparsable uuid 2020-11-20T12:14:03.861 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-8 2020-11-20T12:14:03.892 INFO:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 11 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:14:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:03.979+0000 7f928efebf40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-11/keyring: can't open /var/lib/ceph/osd/ceph-11/keyring: (2) No such file or directory 2020-11-20T12:14:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:03.979+0000 7f928efebf40 -1 created new key in keyring /var/lib/ceph/osd/ceph-11/keyring 2020-11-20T12:14:03.983 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:03.979+0000 7f928efebf40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T12:14:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:03.979+0000 7f928efebf40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T12:14:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:03.979+0000 7f928efebf40 -1 bluestore(/var/lib/ceph/osd/ceph-11/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-11/block: (2) No such file or directory 2020-11-20T12:14:03.984 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:03.979+0000 7f928efebf40 -1 bluestore(/var/lib/ceph/osd/ceph-11) _read_fsid unparsable uuid 2020-11-20T12:14:06.833 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-11 2020-11-20T12:14:06.906 INFO:tasks.ceph:Reading keys from all nodes... 2020-11-20T12:14:06.907 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:06.908 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T12:14:06.930 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2020-11-20T12:14:06.938 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.x] 2020-11-20T12:14:06.939 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfRmz1BRAApQxtlmrC1rwO/5CRJoRzKw== 2020-11-20T12:14:06.939 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:06.939 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:06.940 INFO:teuthology.orchestra.run.smithi093.stderr:56 bytes copied, 4.2798e-05 s, 1.3 MB/s 2020-11-20T12:14:06.941 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:06.941 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T12:14:06.998 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2020-11-20T12:14:07.008 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2020-11-20T12:14:07.008 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfo6+5ERAAU34c1UbPG/pIuJn3iqAgog== 2020-11-20T12:14:07.009 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:07.009 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:07.009 INFO:teuthology.orchestra.run.smithi093.stderr:56 bytes copied, 5.7527e-05 s, 973 kB/s 2020-11-20T12:14:07.010 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:07.011 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T12:14:07.065 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2020-11-20T12:14:07.077 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2020-11-20T12:14:07.077 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDlsrdfieagDRAAbDLskTOuCxEtwaCn40OZfw== 2020-11-20T12:14:07.078 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:07.078 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:07.078 INFO:teuthology.orchestra.run.smithi093.stderr:56 bytes copied, 5.1105e-05 s, 1.1 MB/s 2020-11-20T12:14:07.078 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:07.079 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T12:14:07.130 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2020-11-20T12:14:07.140 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.3] 2020-11-20T12:14:07.140 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDosrdfAS77DhAAMd2zWZ8dkMpKZO431yrezg== 2020-11-20T12:14:07.141 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:07.141 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:07.141 INFO:teuthology.orchestra.run.smithi093.stderr:56 bytes copied, 3.1168e-05 s, 1.8 MB/s 2020-11-20T12:14:07.142 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:07.143 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T12:14:07.196 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2020-11-20T12:14:07.206 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.6] 2020-11-20T12:14:07.207 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDrsrdfpQYyEBAAptImci2HZHQLA7H7FMZBeQ== 2020-11-20T12:14:07.207 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:07.207 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:07.207 INFO:teuthology.orchestra.run.smithi093.stderr:56 bytes copied, 3.1134e-05 s, 1.8 MB/s 2020-11-20T12:14:07.208 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:07.209 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T12:14:07.262 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/keyring of=/dev/stdout 2020-11-20T12:14:07.272 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.9] 2020-11-20T12:14:07.272 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDusrdf0N1WEBAA9vRC/yW1EbG1J7tiZoL7XQ== 2020-11-20T12:14:07.273 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:07.273 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:07.273 INFO:teuthology.orchestra.run.smithi093.stderr:56 bytes copied, 4.7912e-05 s, 1.2 MB/s 2020-11-20T12:14:07.275 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:07.275 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T12:14:07.292 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2020-11-20T12:14:07.304 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2020-11-20T12:14:07.304 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdf0qZ0ChAAPAGJYHRzNizWbO0wRHG7fg== 2020-11-20T12:14:07.304 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:07.305 INFO:teuthology.orchestra.run.smithi066.stderr:56 bytes copied, 4.7221e-05 s, 1.2 MB/s 2020-11-20T12:14:07.306 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:07.306 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T12:14:07.363 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2020-11-20T12:14:07.375 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2020-11-20T12:14:07.375 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdfXL2CFhAAJi/P+FFQn51Zpry8hgcNXg== 2020-11-20T12:14:07.375 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:07.376 INFO:teuthology.orchestra.run.smithi066.stderr:56 bytes copied, 4.9225e-05 s, 1.1 MB/s 2020-11-20T12:14:07.377 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:07.377 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T12:14:07.434 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2020-11-20T12:14:07.445 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2020-11-20T12:14:07.445 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDzsrdfaO/oMBAACxD0VzQFv5Afcf+JCrewXw== 2020-11-20T12:14:07.446 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:07.446 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:07.446 INFO:teuthology.orchestra.run.smithi066.stderr:56 bytes copied, 3.8554e-05 s, 1.5 MB/s 2020-11-20T12:14:07.447 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:07.448 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T12:14:07.521 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2020-11-20T12:14:07.529 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.4] 2020-11-20T12:14:07.529 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD3srdfSo57BBAA3qkEymxyddXtRQK+bMKAfA== 2020-11-20T12:14:07.530 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:07.530 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:07.530 INFO:teuthology.orchestra.run.smithi066.stderr:56 bytes copied, 3.9754e-05 s, 1.4 MB/s 2020-11-20T12:14:07.531 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:07.531 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T12:14:07.619 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2020-11-20T12:14:07.631 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.7] 2020-11-20T12:14:07.631 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD6srdfrL50AxAA/0vL2UONHSXKeNAJtacUag== 2020-11-20T12:14:07.632 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:07.632 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:07.632 INFO:teuthology.orchestra.run.smithi066.stderr:56 bytes copied, 3.639e-05 s, 1.5 MB/s 2020-11-20T12:14:07.633 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:07.634 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T12:14:07.736 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/keyring of=/dev/stdout 2020-11-20T12:14:07.746 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.10] 2020-11-20T12:14:07.747 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD9srdfrUswARAAP7SwVRGO4NopcA0h89Fjcw== 2020-11-20T12:14:07.747 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:07.747 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:07.748 INFO:teuthology.orchestra.run.smithi066.stderr:57 bytes copied, 3.8562e-05 s, 1.5 MB/s 2020-11-20T12:14:07.748 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:07.749 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T12:14:07.771 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2020-11-20T12:14:07.782 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.z] 2020-11-20T12:14:07.783 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfgmTIDhAAybMyxpZHCoeSbHN4mHp8Sg== 2020-11-20T12:14:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:07.783 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:07.784 INFO:teuthology.orchestra.run.smithi132.stderr:56 bytes copied, 6.0296e-05 s, 929 kB/s 2020-11-20T12:14:07.785 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:07.785 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T12:14:07.848 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2020-11-20T12:14:07.858 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2020-11-20T12:14:07.858 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfnU5MGxAAUR+Dv3GtwLrOCHYw5RauMQ== 2020-11-20T12:14:07.859 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:07.859 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:07.859 INFO:teuthology.orchestra.run.smithi132.stderr:56 bytes copied, 4.0953e-05 s, 1.4 MB/s 2020-11-20T12:14:07.860 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:07.861 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T12:14:07.882 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2020-11-20T12:14:07.896 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2020-11-20T12:14:07.898 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQACs7dfD5laORAAIsKl6eymcEJ1EGFTZz6zcQ== 2020-11-20T12:14:07.898 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:07.900 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:07.900 INFO:teuthology.orchestra.run.smithi132.stderr:56 bytes copied, 5.0105e-05 s, 1.1 MB/s 2020-11-20T12:14:07.901 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:07.901 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T12:14:07.961 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2020-11-20T12:14:07.973 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2020-11-20T12:14:07.973 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAGs7dfYqPMABAACwEYxtkDFmcl3QbLmO/jlw== 2020-11-20T12:14:07.973 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:07.973 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:56 bytes copied, 3.1662e-05 s, 1.8 MB/s 2020-11-20T12:14:07.974 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:07.974 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T12:14:08.034 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/keyring of=/dev/stdout 2020-11-20T12:14:08.044 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.8] 2020-11-20T12:14:08.044 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAJs7dftPO5ABAAZauLxEQ/ff3UfboY8g0gYg== 2020-11-20T12:14:08.044 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:08.045 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:08.045 INFO:teuthology.orchestra.run.smithi132.stderr:56 bytes copied, 3.0997e-05 s, 1.8 MB/s 2020-11-20T12:14:08.046 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:08.046 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T12:14:08.102 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/keyring of=/dev/stdout 2020-11-20T12:14:08.113 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.11] 2020-11-20T12:14:08.113 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQALs7df6cZzOhAAlJa0VODDCfcvCSmrVcmnnw== 2020-11-20T12:14:08.115 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:08.115 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:08.115 INFO:teuthology.orchestra.run.smithi132.stderr:57 bytes copied, 2.8406e-05 s, 2.0 MB/s 2020-11-20T12:14:08.117 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:08.118 INFO:teuthology.orchestra.run.smithi093:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T12:14:08.136 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2020-11-20T12:14:08.137 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2020-11-20T12:14:08.138 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfKnFBHxAA9DdHtR+kKaczbAZtKtP2iw== 2020-11-20T12:14:08.138 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:08.138 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:08.138 INFO:teuthology.orchestra.run.smithi093.stderr:59 bytes copied, 3.1934e-05 s, 1.8 MB/s 2020-11-20T12:14:08.139 INFO:tasks.ceph:Adding keys to all mons... 2020-11-20T12:14:08.139 INFO:teuthology.orchestra.run.smithi066:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T12:14:08.144 INFO:teuthology.orchestra.run.smithi093:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T12:14:08.182 INFO:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2020-11-20T12:14:08.188 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.x] 2020-11-20T12:14:08.188 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdfRmz1BRAApQxtlmrC1rwO/5CRJoRzKw== 2020-11-20T12:14:08.189 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.a] 2020-11-20T12:14:08.189 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdfo6+5ERAAU34c1UbPG/pIuJn3iqAgog== 2020-11-20T12:14:08.189 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.0] 2020-11-20T12:14:08.190 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDlsrdfieagDRAAbDLskTOuCxEtwaCn40OZfw== 2020-11-20T12:14:08.190 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.3] 2020-11-20T12:14:08.190 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDosrdfAS77DhAAMd2zWZ8dkMpKZO431yrezg== 2020-11-20T12:14:08.191 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.6] 2020-11-20T12:14:08.191 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDrsrdfpQYyEBAAptImci2HZHQLA7H7FMZBeQ== 2020-11-20T12:14:08.191 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.9] 2020-11-20T12:14:08.192 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDusrdf0N1WEBAA9vRC/yW1EbG1J7tiZoL7XQ== 2020-11-20T12:14:08.192 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.y] 2020-11-20T12:14:08.192 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdf0qZ0ChAAPAGJYHRzNizWbO0wRHG7fg== 2020-11-20T12:14:08.192 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.b] 2020-11-20T12:14:08.194 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdfXL2CFhAAJi/P+FFQn51Zpry8hgcNXg== 2020-11-20T12:14:08.194 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.1] 2020-11-20T12:14:08.195 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDzsrdfaO/oMBAACxD0VzQFv5Afcf+JCrewXw== 2020-11-20T12:14:08.195 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.4] 2020-11-20T12:14:08.196 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD3srdfSo57BBAA3qkEymxyddXtRQK+bMKAfA== 2020-11-20T12:14:08.196 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.7] 2020-11-20T12:14:08.197 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD6srdfrL50AxAA/0vL2UONHSXKeNAJtacUag== 2020-11-20T12:14:08.197 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.10] 2020-11-20T12:14:08.197 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQD9srdfrUswARAAP7SwVRGO4NopcA0h89Fjcw== 2020-11-20T12:14:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:[mgr.z] 2020-11-20T12:14:08.198 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdfgmTIDhAAybMyxpZHCoeSbHN4mHp8Sg== 2020-11-20T12:14:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:[mds.c] 2020-11-20T12:14:08.198 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdfnU5MGxAAUR+Dv3GtwLrOCHYw5RauMQ== 2020-11-20T12:14:08.198 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.2] 2020-11-20T12:14:08.199 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQACs7dfD5laORAAIsKl6eymcEJ1EGFTZz6zcQ== 2020-11-20T12:14:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.5] 2020-11-20T12:14:08.199 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAGs7dfYqPMABAACwEYxtkDFmcl3QbLmO/jlw== 2020-11-20T12:14:08.199 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.8] 2020-11-20T12:14:08.200 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQAJs7dftPO5ABAAZauLxEQ/ff3UfboY8g0gYg== 2020-11-20T12:14:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:[osd.11] 2020-11-20T12:14:08.200 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQALs7df6cZzOhAAlJa0VODDCfcvCSmrVcmnnw== 2020-11-20T12:14:08.200 INFO:teuthology.orchestra.run.smithi066.stdout:[client.0] 2020-11-20T12:14:08.200 INFO:teuthology.orchestra.run.smithi066.stdout: key = AQDisrdfKnFBHxAA9DdHtR+kKaczbAZtKtP2iw== 2020-11-20T12:14:08.204 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.x] 2020-11-20T12:14:08.205 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfRmz1BRAApQxtlmrC1rwO/5CRJoRzKw== 2020-11-20T12:14:08.205 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.a] 2020-11-20T12:14:08.205 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfo6+5ERAAU34c1UbPG/pIuJn3iqAgog== 2020-11-20T12:14:08.205 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.0] 2020-11-20T12:14:08.206 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDlsrdfieagDRAAbDLskTOuCxEtwaCn40OZfw== 2020-11-20T12:14:08.206 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.3] 2020-11-20T12:14:08.206 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDosrdfAS77DhAAMd2zWZ8dkMpKZO431yrezg== 2020-11-20T12:14:08.206 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.6] 2020-11-20T12:14:08.206 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDrsrdfpQYyEBAAptImci2HZHQLA7H7FMZBeQ== 2020-11-20T12:14:08.207 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.9] 2020-11-20T12:14:08.207 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDusrdf0N1WEBAA9vRC/yW1EbG1J7tiZoL7XQ== 2020-11-20T12:14:08.207 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.y] 2020-11-20T12:14:08.207 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdf0qZ0ChAAPAGJYHRzNizWbO0wRHG7fg== 2020-11-20T12:14:08.207 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.b] 2020-11-20T12:14:08.208 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfXL2CFhAAJi/P+FFQn51Zpry8hgcNXg== 2020-11-20T12:14:08.208 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.1] 2020-11-20T12:14:08.208 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDzsrdfaO/oMBAACxD0VzQFv5Afcf+JCrewXw== 2020-11-20T12:14:08.208 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.4] 2020-11-20T12:14:08.208 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD3srdfSo57BBAA3qkEymxyddXtRQK+bMKAfA== 2020-11-20T12:14:08.209 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.7] 2020-11-20T12:14:08.209 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD6srdfrL50AxAA/0vL2UONHSXKeNAJtacUag== 2020-11-20T12:14:08.209 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.10] 2020-11-20T12:14:08.209 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQD9srdfrUswARAAP7SwVRGO4NopcA0h89Fjcw== 2020-11-20T12:14:08.210 INFO:teuthology.orchestra.run.smithi093.stdout:[mgr.z] 2020-11-20T12:14:08.210 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfgmTIDhAAybMyxpZHCoeSbHN4mHp8Sg== 2020-11-20T12:14:08.210 INFO:teuthology.orchestra.run.smithi093.stdout:[mds.c] 2020-11-20T12:14:08.210 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfnU5MGxAAUR+Dv3GtwLrOCHYw5RauMQ== 2020-11-20T12:14:08.210 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.2] 2020-11-20T12:14:08.211 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQACs7dfD5laORAAIsKl6eymcEJ1EGFTZz6zcQ== 2020-11-20T12:14:08.211 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.5] 2020-11-20T12:14:08.211 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQAGs7dfYqPMABAACwEYxtkDFmcl3QbLmO/jlw== 2020-11-20T12:14:08.211 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.8] 2020-11-20T12:14:08.211 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQAJs7dftPO5ABAAZauLxEQ/ff3UfboY8g0gYg== 2020-11-20T12:14:08.212 INFO:teuthology.orchestra.run.smithi093.stdout:[osd.11] 2020-11-20T12:14:08.212 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQALs7df6cZzOhAAlJa0VODDCfcvCSmrVcmnnw== 2020-11-20T12:14:08.212 INFO:teuthology.orchestra.run.smithi093.stdout:[client.0] 2020-11-20T12:14:08.212 INFO:teuthology.orchestra.run.smithi093.stdout: key = AQDisrdfKnFBHxAA9DdHtR+kKaczbAZtKtP2iw== 2020-11-20T12:14:08.213 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2020-11-20T12:14:08.214 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfRmz1BRAApQxtlmrC1rwO/5CRJoRzKw== 2020-11-20T12:14:08.214 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2020-11-20T12:14:08.214 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfo6+5ERAAU34c1UbPG/pIuJn3iqAgog== 2020-11-20T12:14:08.214 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2020-11-20T12:14:08.215 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDlsrdfieagDRAAbDLskTOuCxEtwaCn40OZfw== 2020-11-20T12:14:08.215 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2020-11-20T12:14:08.215 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDosrdfAS77DhAAMd2zWZ8dkMpKZO431yrezg== 2020-11-20T12:14:08.215 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2020-11-20T12:14:08.215 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDrsrdfpQYyEBAAptImci2HZHQLA7H7FMZBeQ== 2020-11-20T12:14:08.216 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.9] 2020-11-20T12:14:08.216 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDusrdf0N1WEBAA9vRC/yW1EbG1J7tiZoL7XQ== 2020-11-20T12:14:08.216 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2020-11-20T12:14:08.216 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdf0qZ0ChAAPAGJYHRzNizWbO0wRHG7fg== 2020-11-20T12:14:08.216 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2020-11-20T12:14:08.217 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfXL2CFhAAJi/P+FFQn51Zpry8hgcNXg== 2020-11-20T12:14:08.218 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2020-11-20T12:14:08.218 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDzsrdfaO/oMBAACxD0VzQFv5Afcf+JCrewXw== 2020-11-20T12:14:08.218 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2020-11-20T12:14:08.219 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD3srdfSo57BBAA3qkEymxyddXtRQK+bMKAfA== 2020-11-20T12:14:08.219 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2020-11-20T12:14:08.219 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD6srdfrL50AxAA/0vL2UONHSXKeNAJtacUag== 2020-11-20T12:14:08.220 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.10] 2020-11-20T12:14:08.220 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQD9srdfrUswARAAP7SwVRGO4NopcA0h89Fjcw== 2020-11-20T12:14:08.220 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.z] 2020-11-20T12:14:08.220 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfgmTIDhAAybMyxpZHCoeSbHN4mHp8Sg== 2020-11-20T12:14:08.220 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2020-11-20T12:14:08.221 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfnU5MGxAAUR+Dv3GtwLrOCHYw5RauMQ== 2020-11-20T12:14:08.221 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2020-11-20T12:14:08.221 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQACs7dfD5laORAAIsKl6eymcEJ1EGFTZz6zcQ== 2020-11-20T12:14:08.221 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2020-11-20T12:14:08.222 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAGs7dfYqPMABAACwEYxtkDFmcl3QbLmO/jlw== 2020-11-20T12:14:08.222 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.8] 2020-11-20T12:14:08.222 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQAJs7dftPO5ABAAZauLxEQ/ff3UfboY8g0gYg== 2020-11-20T12:14:08.222 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.11] 2020-11-20T12:14:08.223 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQALs7df6cZzOhAAlJa0VODDCfcvCSmrVcmnnw== 2020-11-20T12:14:08.223 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2020-11-20T12:14:08.223 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQDisrdfKnFBHxAA9DdHtR+kKaczbAZtKtP2iw== 2020-11-20T12:14:08.224 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:08.245 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:08.257 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:08.304 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:08.307 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:08.310 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:08.358 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.360 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.363 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.408 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.410 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.413 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.457 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.460 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.497 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.542 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.545 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.582 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.9 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.628 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:08.630 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:08.667 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:08.713 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:08.726 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:08.770 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:08.846 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.869 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.883 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.935 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.974 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:08.986 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.039 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.066 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.077 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.129 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.162 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.168 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.10 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.219 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:09.261 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:09.268 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2020-11-20T12:14:09.319 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:09.360 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:09.372 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2020-11-20T12:14:09.427 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.465 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.474 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.523 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.568 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.580 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.635 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.664 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.679 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.8 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.733 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.770 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.781 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.11 --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' 2020-11-20T12:14:09.835 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T12:14:09.858 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T12:14:09.883 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2020-11-20T12:14:09.940 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-11-20T12:14:09.941 INFO:teuthology.orchestra.run.smithi093:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-11-20T12:14:09.995 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T12:14:10.092 INFO:teuthology.orchestra.run.smithi093:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-11-20T12:14:10.119 INFO:teuthology.orchestra.run.smithi066:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-11-20T12:14:10.146 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T12:14:10.242 INFO:teuthology.orchestra.run.smithi066:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-11-20T12:14:10.268 INFO:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-11-20T12:14:10.293 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-11-20T12:14:10.383 INFO:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-11-20T12:14:10.409 INFO:teuthology.orchestra.run.smithi066:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:14:10.412 INFO:teuthology.orchestra.run.smithi093:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:14:10.414 INFO:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-11-20T12:14:10.462 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-11-20T12:14:10.462 INFO:tasks.ceph.mon.a:Restarting daemon 2020-11-20T12:14:10.463 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-11-20T12:14:10.469 INFO:tasks.ceph.mon.a:Started 2020-11-20T12:14:10.469 INFO:tasks.ceph.mon.b:Restarting daemon 2020-11-20T12:14:10.470 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-11-20T12:14:10.472 INFO:tasks.ceph.mon.b:Started 2020-11-20T12:14:10.472 INFO:tasks.ceph.mon.c:Restarting daemon 2020-11-20T12:14:10.472 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-11-20T12:14:10.506 INFO:tasks.ceph.mon.c:Started 2020-11-20T12:14:10.506 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-11-20T12:14:10.507 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-11-20T12:14:10.507 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-11-20T12:14:10.510 INFO:tasks.ceph.mgr.x:Started 2020-11-20T12:14:10.510 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-11-20T12:14:10.510 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-11-20T12:14:10.512 INFO:tasks.ceph.mgr.y:Started 2020-11-20T12:14:10.513 INFO:tasks.ceph.mgr.z:Restarting daemon 2020-11-20T12:14:10.513 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2020-11-20T12:14:10.515 INFO:tasks.ceph.mgr.z:Started 2020-11-20T12:14:10.515 INFO:tasks.ceph:Setting crush tunables to default 2020-11-20T12:14:10.516 INFO:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd crush tunables default 2020-11-20T12:14:10.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.629+0000 7fa7668ba700 1 Processor -- start 2020-11-20T12:14:10.633 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.629+0000 7fa7668ba700 1 -- start start 2020-11-20T12:14:10.634 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa7668ba700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.634 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa7668ba700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:10.635 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa7668ba700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa760151990 con 0x7fa76014ec00 2020-11-20T12:14:10.635 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa7668ba700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7601527a0 con 0x7fa7600bf5e0 2020-11-20T12:14:10.635 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa7668ba700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7600c2620 con 0x7fa76014efe0 2020-11-20T12:14:10.635 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa75ffff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa76014ec00 0x7fa7600beed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:38918/0 (socket says 172.21.15.93:38918) 2020-11-20T12:14:10.636 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa75ffff700 1 -- 172.21.15.93:0/2026505469 learned_addr learned my addr 172.21.15.93:0/2026505469 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:10.636 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.636 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.636 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:10.637 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:10.637 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:10.637 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T12:14:10.637 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T12:14:10.637 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:10.638 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:10.638 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.630+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T12:14:10.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:10.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T12:14:10.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:10.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:10.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T12:14:10.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:10.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:10.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:10.837 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:10.831+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T12:14:11.236 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.236 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:11.236 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T12:14:11.237 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:11.237 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:11.237 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T12:14:11.237 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:11.238 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:11.238 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:11.238 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:11.232+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T12:14:12.037 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:12.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-11-20T12:14:12.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:12.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:12.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T12:14:12.039 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:12.039 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:12.039 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:12.039 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:12.034+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T12:14:13.638 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 msgr2=0x7fa760151dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T12:14:13.640 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.132:3300/0 conn(0x7fa76014efe0 0x7fa760151dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.641 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 msgr2=0x7fa7601522b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T12:14:13.642 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.66:3300/0 conn(0x7fa7600bf5e0 0x7fa7601522b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:13.643 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 -- 172.21.15.93:0/2026505469 >> v1:172.21.15.93:6789/0 conn(0x7fa76014ec00 legacy=0x7fa7600beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:13.643 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:13.644 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 -- 172.21.15.93:0/2026505469 --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7600c28c0 con 0x7fa740003440 2020-11-20T12:14:13.645 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 -- 172.21.15.93:0/2026505469 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74000e9b0 con 0x7fa740007110 2020-11-20T12:14:13.646 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa75dffb700 1 -- 172.21.15.93:0/2026505469 --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7601527a0 con 0x7fa74000ae90 2020-11-20T12:14:13.648 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.630+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:13.649 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.631+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:13.650 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.631+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:13.650 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.631+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:13.651 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.631+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2020-11-20T12:14:13.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.832+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:13.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.832+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:13.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.832+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:13.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.832+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:13.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:13.832+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2020-11-20T12:14:14.236 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:14.233+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:14.237 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:14.233+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:14.237 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:14.233+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:14.238 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:14.233+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:14.238 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:14.233+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.800000 2020-11-20T12:14:15.037 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.034+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.034+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2020-11-20T12:14:15.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.034+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-11-20T12:14:15.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.034+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2020-11-20T12:14:15.038 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.034+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 1.600000 2020-11-20T12:14:15.815 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.812+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3279700685 0 0) 0x7fa7600c28c0 con 0x7fa740003440 2020-11-20T12:14:15.816 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.812+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa74c003280 con 0x7fa740003440 2020-11-20T12:14:15.832 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 <== mon.0 v1:172.21.15.66:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1311338335 0 0) 0x7fa74c003280 con 0x7fa740003440 2020-11-20T12:14:15.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 msgr2=0x7fa74000d330 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-11-20T12:14:15.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 --2- 172.21.15.93:0/2026505469 >> v2:172.21.15.93:3300/0 conn(0x7fa74000ae90 0x7fa74000d330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 >> v1:172.21.15.132:6789/0 conn(0x7fa740007110 legacy=0x7fa7400095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.834 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa764e57700 1 -- 172.21.15.93:0/2026505469 reap_dead start 2020-11-20T12:14:15.834 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 --> v1:172.21.15.66:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74000fc30 con 0x7fa740003440 2020-11-20T12:14:15.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 <== mon.0 v1:172.21.15.66:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7fa7500015a0 con 0x7fa740003440 2020-11-20T12:14:15.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 >> v1:172.21.15.66:6789/0 conn(0x7fa740003440 legacy=0x7fa740005850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa74c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa74c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa74c004e90 0x7fa74c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601527a0 con 0x7fa74c004e90 2020-11-20T12:14:15.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c0053f0 con 0x7fa74c0037c0 2020-11-20T12:14:15.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.814+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa74c00bce0 con 0x7fa74c004520 2020-11-20T12:14:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75ffff700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa74c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa74c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa74c004e90 0x7fa74c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75ffff700 1 -- 172.21.15.93:0/2026505469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 msgr2=0x7fa74c0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:15.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75ffff700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa74c0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75ffff700 1 -- 172.21.15.93:0/2026505469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa74c004e90 msgr2=0x7fa74c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:15.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75ffff700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa74c004e90 0x7fa74c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75ffff700 1 -- 172.21.15.93:0/2026505469 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa74c003280 con 0x7fa74c0037c0 2020-11-20T12:14:15.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa764e57700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa74c004e90 0x7fa74c00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:15.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.815+0000 7fa75ffff700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa74c003be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa75000c210 tx=0x7fa750007710).ready entity=mon.1 client_cookie=c5eb5d4da6cafc68 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.816+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75000ce80 con 0x7fa74c0037c0 2020-11-20T12:14:15.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.816+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7500070d0 con 0x7fa74c0037c0 2020-11-20T12:14:15.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.816+0000 7fa75effd700 1 -- 172.21.15.93:0/2026505469 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa750007450 con 0x7fa74c0037c0 2020-11-20T12:14:15.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.816+0000 7fa7668ba700 1 -- 172.21.15.93:0/2026505469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 msgr2=0x7fa74c003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa74c003be0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7fa75000c210 tx=0x7fa750007710).stop 2020-11-20T12:14:15.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 -- 172.21.15.93:0/2026505469 shutdown_connections 2020-11-20T12:14:15.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa74c004e90 0x7fa74c00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa74c0049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2026505469 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa74c003be0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 -- 172.21.15.93:0/2026505469 >> 172.21.15.93:0/2026505469 conn(0x7fa760060130 msgr2=0x7fa760060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:15.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 -- 172.21.15.93:0/2026505469 shutdown_connections 2020-11-20T12:14:15.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.817+0000 7fa7668ba700 1 -- 172.21.15.93:0/2026505469 wait complete. 2020-11-20T12:14:15.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.819+0000 7fa7668ba700 1 Processor -- start 2020-11-20T12:14:15.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.819+0000 7fa7668ba700 1 -- start start 2020-11-20T12:14:15.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa7668ba700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa740003440 0x7fa7600931b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa7668ba700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa7600936a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa7668ba700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa7600c0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa7668ba700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601623c0 con 0x7fa740003440 2020-11-20T12:14:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa7668ba700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa760155140 con 0x7fa74c0037c0 2020-11-20T12:14:15.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa7668ba700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7601553e0 con 0x7fa74c004520 2020-11-20T12:14:15.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa75f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa7600936a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa75ffff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa740003440 0x7fa7600931b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa75f7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa7600936a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38296/0 (socket says 172.21.15.93:38296) 2020-11-20T12:14:15.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2840114298 learned_addr learned my addr 172.21.15.93:0/2840114298 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:15.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.820+0000 7fa764e57700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa7600c0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:15.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2840114298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 msgr2=0x7fa7600c0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa7600c0f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2840114298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa740003440 msgr2=0x7fa7600931b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa740003440 0x7fa7600931b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa75f7fe700 1 -- 172.21.15.93:0/2840114298 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760155680 con 0x7fa74c0037c0 2020-11-20T12:14:15.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa75f7fe700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa7600936a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa754006c40 tx=0x7fa754008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:15.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa73ffff700 1 -- 172.21.15.93:0/2840114298 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754014bb0 con 0x7fa74c0037c0 2020-11-20T12:14:15.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa73ffff700 1 -- 172.21.15.93:0/2840114298 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754014d10 con 0x7fa74c0037c0 2020-11-20T12:14:15.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa760155920 con 0x7fa74c0037c0 2020-11-20T12:14:15.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa73ffff700 1 -- 172.21.15.93:0/2840114298 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754014e80 con 0x7fa74c0037c0 2020-11-20T12:14:15.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.821+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa760155e60 con 0x7fa74c0037c0 2020-11-20T12:14:15.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.822+0000 7fa73ffff700 1 -- 172.21.15.93:0/2840114298 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fa754012040 con 0x7fa74c0037c0 2020-11-20T12:14:15.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.822+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa760061a40 con 0x7fa74c0037c0 2020-11-20T12:14:15.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.824+0000 7fa73ffff700 1 -- 172.21.15.93:0/2840114298 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fa754020790 con 0x7fa74c0037c0 2020-11-20T12:14:15.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.828+0000 7fa73ffff700 1 -- 172.21.15.93:0/2840114298 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fa754017ae0 con 0x7fa74c0037c0 2020-11-20T12:14:15.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.902+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fa760067590 con 0x7fa74c0037c0 2020-11-20T12:14:15.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.909+0000 7fa73ffff700 1 -- 172.21.15.93:0/2840114298 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fa754020ad0 con 0x7fa74c0037c0 2020-11-20T12:14:15.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 msgr2=0x7fa7600936a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:15.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa7600936a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fa754006c40 tx=0x7fa754008040).stop 2020-11-20T12:14:15.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 shutdown_connections 2020-11-20T12:14:15.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74c004520 0x7fa7600c0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa740003440 0x7fa7600931b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 --2- 172.21.15.93:0/2840114298 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa74c0037c0 0x7fa7600936a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:15.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 >> 172.21.15.93:0/2840114298 conn(0x7fa760060130 msgr2=0x7fa7600620d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:15.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 shutdown_connections 2020-11-20T12:14:15.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:15.910+0000 7fa7668ba700 1 -- 172.21.15.93:0/2840114298 wait complete. 2020-11-20T12:14:15.916 INFO:teuthology.orchestra.run.smithi093.stderr:adjusted tunables profile to default 2020-11-20T12:14:15.925 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-11-20T12:14:15.926 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:15.926 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T12:14:15.941 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2020-11-20T12:14:15.951 INFO:teuthology.orchestra.run.smithi093.stdout:d2c363e4-268b-4d95-888d-c6a61fc5cb16 2020-11-20T12:14:15.951 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:15.951 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:15.951 INFO:teuthology.orchestra.run.smithi093.stderr:37 bytes copied, 3.4112e-05 s, 1.1 MB/s 2020-11-20T12:14:15.952 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:15.953 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T12:14:16.007 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2020-11-20T12:14:16.016 INFO:teuthology.orchestra.run.smithi093.stdout:fa90cb08-95e5-499c-b684-6feeba97c8b3 2020-11-20T12:14:16.017 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:16.017 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:16.017 INFO:teuthology.orchestra.run.smithi093.stderr:37 bytes copied, 2.9621e-05 s, 1.2 MB/s 2020-11-20T12:14:16.018 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:16.019 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T12:14:16.072 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2020-11-20T12:14:16.081 INFO:teuthology.orchestra.run.smithi093.stdout:2a8fa279-a52a-444a-8346-c393fb303f9c 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:16.082 INFO:teuthology.orchestra.run.smithi093.stderr:37 bytes copied, 2.9812e-05 s, 1.2 MB/s 2020-11-20T12:14:16.084 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:14:16.084 INFO:teuthology.orchestra.run.smithi093:> sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T12:14:16.137 INFO:teuthology.orchestra.run.smithi093.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-9/fsid of=/dev/stdout 2020-11-20T12:14:16.146 INFO:teuthology.orchestra.run.smithi093.stdout:dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1 2020-11-20T12:14:16.147 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records in 2020-11-20T12:14:16.147 INFO:teuthology.orchestra.run.smithi093.stderr:0+1 records out 2020-11-20T12:14:16.147 INFO:teuthology.orchestra.run.smithi093.stderr:37 bytes copied, 3.1675e-05 s, 1.2 MB/s 2020-11-20T12:14:16.148 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:16.149 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T12:14:16.163 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2020-11-20T12:14:16.173 INFO:teuthology.orchestra.run.smithi066.stdout:12e02fba-6dfe-4adc-8945-d655124e5142 2020-11-20T12:14:16.173 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:16.174 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:16.174 INFO:teuthology.orchestra.run.smithi066.stderr:37 bytes copied, 3.764e-05 s, 983 kB/s 2020-11-20T12:14:16.175 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:16.175 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T12:14:16.229 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2020-11-20T12:14:16.239 INFO:teuthology.orchestra.run.smithi066.stdout:7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12 2020-11-20T12:14:16.239 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:16.239 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:16.240 INFO:teuthology.orchestra.run.smithi066.stderr:37 bytes copied, 3.7899e-05 s, 976 kB/s 2020-11-20T12:14:16.241 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:16.241 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T12:14:16.294 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2020-11-20T12:14:16.304 INFO:teuthology.orchestra.run.smithi066.stdout:b4ad2429-191b-4dd5-91f2-7cf116eecbbf 2020-11-20T12:14:16.305 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:16.305 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:16.306 INFO:teuthology.orchestra.run.smithi066.stderr:37 bytes copied, 3.5183e-05 s, 1.1 MB/s 2020-11-20T12:14:16.308 INFO:teuthology.orchestra.run.smithi066:> set -ex 2020-11-20T12:14:16.308 INFO:teuthology.orchestra.run.smithi066:> sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T12:14:16.362 INFO:teuthology.orchestra.run.smithi066.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-10/fsid of=/dev/stdout 2020-11-20T12:14:16.372 INFO:teuthology.orchestra.run.smithi066.stdout:fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904 2020-11-20T12:14:16.372 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records in 2020-11-20T12:14:16.372 INFO:teuthology.orchestra.run.smithi066.stderr:0+1 records out 2020-11-20T12:14:16.372 INFO:teuthology.orchestra.run.smithi066.stderr:37 bytes copied, 3.5537e-05 s, 1.0 MB/s 2020-11-20T12:14:16.373 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:16.374 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T12:14:16.387 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2020-11-20T12:14:16.397 INFO:teuthology.orchestra.run.smithi132.stdout:83f6f89f-569f-4dfe-880b-e88d6d993dc0 2020-11-20T12:14:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:16.397 INFO:teuthology.orchestra.run.smithi132.stderr:37 bytes copied, 3.2525e-05 s, 1.1 MB/s 2020-11-20T12:14:16.398 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:16.399 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T12:14:16.452 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2020-11-20T12:14:16.461 INFO:teuthology.orchestra.run.smithi132.stdout:edc6f7d0-4df0-4493-9122-6203686c3ef4 2020-11-20T12:14:16.461 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:16.462 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:16.462 INFO:teuthology.orchestra.run.smithi132.stderr:37 bytes copied, 4.85e-05 s, 763 kB/s 2020-11-20T12:14:16.463 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:16.463 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T12:14:16.516 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-8/fsid of=/dev/stdout 2020-11-20T12:14:16.526 INFO:teuthology.orchestra.run.smithi132.stdout:4daadfa9-1117-4187-acfb-1372c3219ad4 2020-11-20T12:14:16.526 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:37 bytes copied, 3.2321e-05 s, 1.1 MB/s 2020-11-20T12:14:16.528 INFO:teuthology.orchestra.run.smithi132:> set -ex 2020-11-20T12:14:16.528 INFO:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T12:14:16.581 INFO:teuthology.orchestra.run.smithi132.stderr:+ sudo dd if=/var/lib/ceph/osd/ceph-11/fsid of=/dev/stdout 2020-11-20T12:14:16.592 INFO:teuthology.orchestra.run.smithi132.stdout:3432a17e-4237-43a6-b105-1d2839995444 2020-11-20T12:14:16.593 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records in 2020-11-20T12:14:16.593 INFO:teuthology.orchestra.run.smithi132.stderr:0+1 records out 2020-11-20T12:14:16.594 INFO:teuthology.orchestra.run.smithi132.stderr:37 bytes copied, 5.0384e-05 s, 734 kB/s 2020-11-20T12:14:16.595 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new d2c363e4-268b-4d95-888d-c6a61fc5cb16 0 2020-11-20T12:14:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.743+0000 7f0986c44700 1 Processor -- start 2020-11-20T12:14:16.747 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.743+0000 7f0986c44700 1 -- start start 2020-11-20T12:14:16.749 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f0986c44700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f09800bf5e0 0x7f09800c4030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f0986c44700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0980151990 con 0x7f098014ec00 2020-11-20T12:14:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f0986c44700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09800c2620 con 0x7f098014efe0 2020-11-20T12:14:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f0986c44700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09800c28c0 con 0x7f09800bf5e0 2020-11-20T12:14:16.750 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f097ffff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f098014efe0 0x7f0980151dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.132:51894/0 (socket says 172.21.15.132:51894) 2020-11-20T12:14:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f09851e1700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f09800bf5e0 0x7f09800c4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f09849e0700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f098014ec00 0x7f09800beed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.132:40504/0 (socket says 172.21.15.132:40504) 2020-11-20T12:14:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.744+0000 7f097ffff700 1 -- 172.21.15.132:0/3034912035 learned_addr learned my addr 172.21.15.132:0/3034912035 (peer_addr_for_me v1:172.21.15.132:0/0) 2020-11-20T12:14:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f097f7fe700 1 -- 172.21.15.132:0/3034912035 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825029686 0 0) 0x7f0980151990 con 0x7f098014ec00 2020-11-20T12:14:16.751 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f097f7fe700 1 -- 172.21.15.132:0/3034912035 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0964003280 con 0x7f098014ec00 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f09851e1700 1 -- 172.21.15.132:0/3034912035 >> v1:172.21.15.93:6789/0 conn(0x7f098014efe0 legacy=0x7f0980151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f097f7fe700 1 -- 172.21.15.132:0/3034912035 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257042125 0 0) 0x7f09800c2620 con 0x7f098014efe0 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f09851e1700 1 -- 172.21.15.132:0/3034912035 >> v1:172.21.15.66:6789/0 conn(0x7f098014ec00 legacy=0x7f09800beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.752 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f09851e1700 1 -- 172.21.15.132:0/3034912035 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09800c2b60 con 0x7f09800bf5e0 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f09851e1700 1 --2- 172.21.15.132:0/3034912035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09800bf5e0 0x7f09800c4030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f0978009d10 tx=0x7f0978009220).ready entity=mon.1 client_cookie=9cc0619dc1927e01 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f097f7fe700 1 -- 172.21.15.132:0/3034912035 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978009e70 con 0x7f09800bf5e0 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f097f7fe700 1 -- 172.21.15.132:0/3034912035 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f097800bc40 con 0x7f09800bf5e0 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f097f7fe700 1 -- 172.21.15.132:0/3034912035 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978011400 con 0x7f09800bf5e0 2020-11-20T12:14:16.753 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f0986c44700 1 -- 172.21.15.132:0/3034912035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09800bf5e0 msgr2=0x7f09800c4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f0986c44700 1 --2- 172.21.15.132:0/3034912035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09800bf5e0 0x7f09800c4030 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f0978009d10 tx=0x7f0978009220).stop 2020-11-20T12:14:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f0986c44700 1 -- 172.21.15.132:0/3034912035 shutdown_connections 2020-11-20T12:14:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f0986c44700 1 --2- 172.21.15.132:0/3034912035 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f09800bf5e0 0x7f09800c4030 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.745+0000 7f0986c44700 1 -- 172.21.15.132:0/3034912035 >> 172.21.15.132:0/3034912035 conn(0x7f0980060130 msgr2=0x7f0980060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:16.754 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.746+0000 7f0986c44700 1 -- 172.21.15.132:0/3034912035 shutdown_connections 2020-11-20T12:14:16.755 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.746+0000 7f0986c44700 1 -- 172.21.15.132:0/3034912035 wait complete. 2020-11-20T12:14:16.757 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.747+0000 7f0986c44700 1 Processor -- start 2020-11-20T12:14:16.757 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.747+0000 7f0986c44700 1 -- start start 2020-11-20T12:14:16.758 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.747+0000 7f0986c44700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09800bf5e0 0x7f0980152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.758 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.747+0000 7f0986c44700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f098014ec00 0x7f09800646e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.758 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.747+0000 7f0986c44700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014efe0 0x7f0980164ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.758 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.747+0000 7f0986c44700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09801645d0 con 0x7f09800bf5e0 2020-11-20T12:14:16.758 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f0986c44700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09801544d0 con 0x7f098014ec00 2020-11-20T12:14:16.759 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f0986c44700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0980154730 con 0x7f098014efe0 2020-11-20T12:14:16.759 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014efe0 0x7f0980164ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.759 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014efe0 0x7f0980164ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33638/0 (socket says 172.21.15.132:33638) 2020-11-20T12:14:16.759 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 -- 172.21.15.132:0/3317487877 learned_addr learned my addr 172.21.15.132:0/3317487877 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:16.759 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f097ffff700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f098014ec00 0x7f09800646e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.760 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09849e0700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09800bf5e0 0x7f0980152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.760 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 -- 172.21.15.132:0/3317487877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f098014ec00 msgr2=0x7f09800646e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.760 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f098014ec00 0x7f09800646e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.760 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 -- 172.21.15.132:0/3317487877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09800bf5e0 msgr2=0x7f0980152c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.760 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09800bf5e0 0x7f0980152c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.761 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 -- 172.21.15.132:0/3317487877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09801549d0 con 0x7f098014efe0 2020-11-20T12:14:16.761 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09849e0700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09800bf5e0 0x7f0980152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:16.761 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f097ffff700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f098014ec00 0x7f09800646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:16.761 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f09851e1700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014efe0 0x7f0980164ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0978006f90 tx=0x7f0978016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.761 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f097cff9700 1 -- 172.21.15.132:0/3317487877 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978010700 con 0x7f098014efe0 2020-11-20T12:14:16.762 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f097cff9700 1 -- 172.21.15.132:0/3317487877 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0978010860 con 0x7f098014efe0 2020-11-20T12:14:16.762 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0980154c70 con 0x7f098014efe0 2020-11-20T12:14:16.762 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f097cff9700 1 -- 172.21.15.132:0/3317487877 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0978010c20 con 0x7f098014efe0 2020-11-20T12:14:16.762 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.748+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09800c64a0 con 0x7f098014efe0 2020-11-20T12:14:16.762 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.749+0000 7f097cff9700 1 -- 172.21.15.132:0/3317487877 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f0978017070 con 0x7f098014efe0 2020-11-20T12:14:16.763 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.749+0000 7f097cff9700 1 -- 172.21.15.132:0/3317487877 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f09780267d0 con 0x7f098014efe0 2020-11-20T12:14:16.763 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.749+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0980061a40 con 0x7f098014efe0 2020-11-20T12:14:16.763 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.752+0000 7f097cff9700 1 -- 172.21.15.132:0/3317487877 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f0978015020 con 0x7f098014efe0 2020-11-20T12:14:16.834 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.831+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d2c363e4-268b-4d95-888d-c6a61fc5cb16", "id": 0} v 0) v1 -- 0x7f09801649c0 con 0x7f098014efe0 2020-11-20T12:14:16.842 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.838+0000 7f097cff9700 1 -- 172.21.15.132:0/3317487877 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d2c363e4-268b-4d95-888d-c6a61fc5cb16", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f097801c860 con 0x7f098014efe0 2020-11-20T12:14:16.842 INFO:teuthology.orchestra.run.smithi132.stdout:0 2020-11-20T12:14:16.843 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014efe0 msgr2=0x7f0980164ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.844 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014efe0 0x7f0980164ca0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f0978006f90 tx=0x7f0978016000).stop 2020-11-20T12:14:16.844 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 shutdown_connections 2020-11-20T12:14:16.844 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f098014efe0 0x7f0980164ca0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.844 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f09800bf5e0 0x7f0980152c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.844 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 --2- 172.21.15.132:0/3317487877 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f098014ec00 0x7f09800646e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.845 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 >> 172.21.15.132:0/3317487877 conn(0x7f0980060130 msgr2=0x7f09800c4230 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:16.845 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 shutdown_connections 2020-11-20T12:14:16.845 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.839+0000 7f0986c44700 1 -- 172.21.15.132:0/3317487877 wait complete. 2020-11-20T12:14:16.854 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 12e02fba-6dfe-4adc-8945-d655124e5142 1 2020-11-20T12:14:16.987 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.983+0000 7fd8a0ed7700 1 Processor -- start 2020-11-20T12:14:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.984+0000 7fd8a0ed7700 1 -- start start 2020-11-20T12:14:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.984+0000 7fd8a0ed7700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd89c0bbb80 0x7fd89c154f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.984+0000 7fd8a0ed7700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0bc090 con 0x7fd89c154b60 2020-11-20T12:14:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.984+0000 7fd8a0ed7700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd89c0bc330 con 0x7fd89c155670 2020-11-20T12:14:16.991 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.984+0000 7fd8a0ed7700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd89c0bc5d0 con 0x7fd89c0bbb80 2020-11-20T12:14:16.991 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.984+0000 7fd89ad9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd89c0bbb80 0x7fd89c154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.991 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd89ad9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd89c0bbb80 0x7fd89c154f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33644/0 (socket says 172.21.15.132:33644) 2020-11-20T12:14:16.991 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd89ad9d700 1 -- 172.21.15.132:0/3887977906 learned_addr learned my addr 172.21.15.132:0/3887977906 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:16.992 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd899d9b700 1 -- 172.21.15.132:0/3887977906 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3140348684 0 0) 0x7fd89c0bc330 con 0x7fd89c155670 2020-11-20T12:14:16.992 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd89ad9d700 1 -- 172.21.15.132:0/3887977906 >> v1:172.21.15.93:6789/0 conn(0x7fd89c155670 legacy=0x7fd89c066600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.992 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd89ad9d700 1 -- 172.21.15.132:0/3887977906 >> v1:172.21.15.66:6789/0 conn(0x7fd89c154b60 legacy=0x7fd89c064470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.992 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd89ad9d700 1 -- 172.21.15.132:0/3887977906 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c065ec0 con 0x7fd89c0bbb80 2020-11-20T12:14:16.992 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd89ad9d700 1 --2- 172.21.15.132:0/3887977906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c0bbb80 0x7fd89c154f40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fd894009dc0 tx=0x7fd8940092d0).ready entity=mon.2 client_cookie=27088da0a8f2bd3b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:16.993 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd899d9b700 1 -- 172.21.15.132:0/3887977906 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400bc40 con 0x7fd89c0bbb80 2020-11-20T12:14:16.993 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd899d9b700 1 -- 172.21.15.132:0/3887977906 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89400bda0 con 0x7fd89c0bbb80 2020-11-20T12:14:16.993 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.985+0000 7fd899d9b700 1 -- 172.21.15.132:0/3887977906 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894011610 con 0x7fd89c0bbb80 2020-11-20T12:14:16.993 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.986+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/3887977906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c0bbb80 msgr2=0x7fd89c154f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:16.993 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.986+0000 7fd8a0ed7700 1 --2- 172.21.15.132:0/3887977906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c0bbb80 0x7fd89c154f40 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7fd894009dc0 tx=0x7fd8940092d0).stop 2020-11-20T12:14:16.994 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.986+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/3887977906 shutdown_connections 2020-11-20T12:14:16.994 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.986+0000 7fd8a0ed7700 1 --2- 172.21.15.132:0/3887977906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c0bbb80 0x7fd89c154f40 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:16.994 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.986+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/3887977906 >> 172.21.15.132:0/3887977906 conn(0x7fd89c060c00 msgr2=0x7fd89c0c56d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:16.994 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.986+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/3887977906 shutdown_connections 2020-11-20T12:14:16.994 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.986+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/3887977906 wait complete. 2020-11-20T12:14:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.987+0000 7fd8a0ed7700 1 Processor -- start 2020-11-20T12:14:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.987+0000 7fd8a0ed7700 1 -- start start 2020-11-20T12:14:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd89c0bbb80 0x7fd89c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd89c154b60 0x7fd89c160fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c163ba0 0x7fd89c154110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c153e90 con 0x7fd89c154b60 2020-11-20T12:14:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c160640 con 0x7fd89c0bbb80 2020-11-20T12:14:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89c1643f0 con 0x7fd89c163ba0 2020-11-20T12:14:16.999 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c163ba0 0x7fd89c154110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:16.999 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c163ba0 0x7fd89c154110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33650/0 (socket says 172.21.15.132:33650) 2020-11-20T12:14:16.999 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 -- 172.21.15.132:0/2755300430 learned_addr learned my addr 172.21.15.132:0/2755300430 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:16.999 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89a59c700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd89c0bbb80 0x7fd89c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.000 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd893fff700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd89c154b60 0x7fd89c160fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.000 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 -- 172.21.15.132:0/2755300430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd89c0bbb80 msgr2=0x7fd89c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.000 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd89c0bbb80 0x7fd89c157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.000 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 -- 172.21.15.132:0/2755300430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd89c154b60 msgr2=0x7fd89c160fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.001 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd89c154b60 0x7fd89c160fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.001 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 -- 172.21.15.132:0/2755300430 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd89c164690 con 0x7fd89c163ba0 2020-11-20T12:14:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd89ad9d700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c163ba0 0x7fd89c154110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd894009d90 tx=0x7fd894016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8927fc700 1 -- 172.21.15.132:0/2755300430 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89400bc40 con 0x7fd89c163ba0 2020-11-20T12:14:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8927fc700 1 -- 172.21.15.132:0/2755300430 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd894011e30 con 0x7fd89c163ba0 2020-11-20T12:14:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd89c164930 con 0x7fd89c163ba0 2020-11-20T12:14:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8927fc700 1 -- 172.21.15.132:0/2755300430 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd894010cd0 con 0x7fd89c163ba0 2020-11-20T12:14:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.988+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd89c160b10 con 0x7fd89c163ba0 2020-11-20T12:14:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.989+0000 7fd8927fc700 1 -- 172.21.15.132:0/2755300430 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fd894017070 con 0x7fd89c163ba0 2020-11-20T12:14:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.989+0000 7fd8927fc700 1 -- 172.21.15.132:0/2755300430 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7fd894026840 con 0x7fd89c163ba0 2020-11-20T12:14:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.989+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd89c061a40 con 0x7fd89c163ba0 2020-11-20T12:14:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:16.993+0000 7fd8927fc700 1 -- 172.21.15.132:0/2755300430 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fd894015020 con 0x7fd89c163ba0 2020-11-20T12:14:17.073 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.069+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "12e02fba-6dfe-4adc-8945-d655124e5142", "id": 1} v 0) v1 -- 0x7fd89c157c70 con 0x7fd89c163ba0 2020-11-20T12:14:17.080 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.077+0000 7fd8927fc700 1 -- 172.21.15.132:0/2755300430 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "12e02fba-6dfe-4adc-8945-d655124e5142", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd894010e30 con 0x7fd89c163ba0 2020-11-20T12:14:17.081 INFO:teuthology.orchestra.run.smithi132.stdout:1 2020-11-20T12:14:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c163ba0 msgr2=0x7fd89c154110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.082 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c163ba0 0x7fd89c154110 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fd894009d90 tx=0x7fd894016000).stop 2020-11-20T12:14:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 shutdown_connections 2020-11-20T12:14:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd89c163ba0 0x7fd89c154110 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd89c0bbb80 0x7fd89c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 --2- 172.21.15.132:0/2755300430 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd89c154b60 0x7fd89c160fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 >> 172.21.15.132:0/2755300430 conn(0x7fd89c060c00 msgr2=0x7fd89c14eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 shutdown_connections 2020-11-20T12:14:17.084 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.078+0000 7fd8a0ed7700 1 -- 172.21.15.132:0/2755300430 wait complete. 2020-11-20T12:14:17.093 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 83f6f89f-569f-4dfe-880b-e88d6d993dc0 2 2020-11-20T12:14:17.203 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.200+0000 7ff612f3c700 1 Processor -- start 2020-11-20T12:14:17.204 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.200+0000 7ff612f3c700 1 -- start start 2020-11-20T12:14:17.206 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff612f3c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff60c0642f0 0x7ff60c0646d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.206 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff612f3c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff60c152a60 0x7ff60c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.206 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff612f3c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff60c152630 con 0x7ff60c0abf20 2020-11-20T12:14:17.207 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff612f3c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0bf960 con 0x7ff60c152a60 2020-11-20T12:14:17.207 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff612f3c700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0bfc00 con 0x7ff60c0642f0 2020-11-20T12:14:17.207 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff60c0642f0 0x7ff60c0646d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.207 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff60c0642f0 0x7ff60c0646d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33652/0 (socket says 172.21.15.132:33652) 2020-11-20T12:14:17.208 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 -- 172.21.15.132:0/2107384228 learned_addr learned my addr 172.21.15.132:0/2107384228 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:17.208 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff61273b700 1 --2- 172.21.15.132:0/2107384228 >> v2:172.21.15.93:3300/0 conn(0x7ff60c152a60 0x7ff60c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.208 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 -- 172.21.15.132:0/2107384228 >> v2:172.21.15.93:3300/0 conn(0x7ff60c152a60 msgr2=0x7ff60c152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:17.208 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 --2- 172.21.15.132:0/2107384228 >> v2:172.21.15.93:3300/0 conn(0x7ff60c152a60 0x7ff60c152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.208 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 -- 172.21.15.132:0/2107384228 >> v1:172.21.15.66:6789/0 conn(0x7ff60c0abf20 legacy=0x7ff60c0bdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.209 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 -- 172.21.15.132:0/2107384228 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c0b9b50 con 0x7ff60c0642f0 2020-11-20T12:14:17.209 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff611f3a700 1 --2- 172.21.15.132:0/2107384228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c0646d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff60c0c0e90 tx=0x7ff608006ef0).ready entity=mon.2 client_cookie=373b2b71be56a0e8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.209 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.201+0000 7ff610f38700 1 -- 172.21.15.132:0/2107384228 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800b8f0 con 0x7ff60c0642f0 2020-11-20T12:14:17.209 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff610f38700 1 -- 172.21.15.132:0/2107384228 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608000e90 con 0x7ff60c0642f0 2020-11-20T12:14:17.209 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff610f38700 1 -- 172.21.15.132:0/2107384228 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60800bc60 con 0x7ff60c0642f0 2020-11-20T12:14:17.210 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 -- 172.21.15.132:0/2107384228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 msgr2=0x7ff60c0646d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.210 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 --2- 172.21.15.132:0/2107384228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c0646d0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7ff60c0c0e90 tx=0x7ff608006ef0).stop 2020-11-20T12:14:17.210 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 -- 172.21.15.132:0/2107384228 shutdown_connections 2020-11-20T12:14:17.210 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 --2- 172.21.15.132:0/2107384228 >> v2:172.21.15.93:3300/0 conn(0x7ff60c152a60 0x7ff60c152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.210 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 --2- 172.21.15.132:0/2107384228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c0646d0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.211 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 -- 172.21.15.132:0/2107384228 >> 172.21.15.132:0/2107384228 conn(0x7ff60c0c3380 msgr2=0x7ff60c0c3790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.211 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 -- 172.21.15.132:0/2107384228 shutdown_connections 2020-11-20T12:14:17.211 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.202+0000 7ff612f3c700 1 -- 172.21.15.132:0/2107384228 wait complete. 2020-11-20T12:14:17.213 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.203+0000 7ff612f3c700 1 Processor -- start 2020-11-20T12:14:17.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.203+0000 7ff612f3c700 1 -- start start 2020-11-20T12:14:17.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff612f3c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff612f3c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff60c0abf20 0x7ff60c155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff612f3c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff60c152a60 0x7ff60c1628a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff612f3c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c1558f0 con 0x7ff60c0abf20 2020-11-20T12:14:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff612f3c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c161f30 con 0x7ff60c152a60 2020-11-20T12:14:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff612f3c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c149830 con 0x7ff60c0642f0 2020-11-20T12:14:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c147f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33658/0 (socket says 172.21.15.132:33658) 2020-11-20T12:14:17.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 -- 172.21.15.132:0/2688654853 learned_addr learned my addr 172.21.15.132:0/2688654853 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:17.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611739700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff60c0abf20 0x7ff60c155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff61273b700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff60c152a60 0x7ff60c1628a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 -- 172.21.15.132:0/2688654853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff60c152a60 msgr2=0x7ff60c1628a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff60c152a60 0x7ff60c1628a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 -- 172.21.15.132:0/2688654853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff60c0abf20 msgr2=0x7ff60c155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff60c0abf20 0x7ff60c155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 -- 172.21.15.132:0/2688654853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c162d90 con 0x7ff60c0642f0 2020-11-20T12:14:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.204+0000 7ff611f3a700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c147f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff60c0bfd40 tx=0x7ff608016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.205+0000 7ff5f9ffb700 1 -- 172.21.15.132:0/2688654853 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff608009e00 con 0x7ff60c0642f0 2020-11-20T12:14:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.205+0000 7ff5f9ffb700 1 -- 172.21.15.132:0/2688654853 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff608011e00 con 0x7ff60c0642f0 2020-11-20T12:14:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.205+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c149a90 con 0x7ff60c0642f0 2020-11-20T12:14:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.205+0000 7ff5f9ffb700 1 -- 172.21.15.132:0/2688654853 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60801c690 con 0x7ff60c0642f0 2020-11-20T12:14:17.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.205+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c162160 con 0x7ff60c0642f0 2020-11-20T12:14:17.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.206+0000 7ff5f9ffb700 1 -- 172.21.15.132:0/2688654853 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ff608017040 con 0x7ff60c0642f0 2020-11-20T12:14:17.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.206+0000 7ff5f9ffb700 1 -- 172.21.15.132:0/2688654853 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7ff608027900 con 0x7ff60c0642f0 2020-11-20T12:14:17.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.206+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c061760 con 0x7ff60c0642f0 2020-11-20T12:14:17.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.208+0000 7ff5f9ffb700 1 -- 172.21.15.132:0/2688654853 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7ff608015020 con 0x7ff60c0642f0 2020-11-20T12:14:17.289 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.285+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "83f6f89f-569f-4dfe-880b-e88d6d993dc0", "id": 2} v 0) v1 -- 0x7ff60c066750 con 0x7ff60c0642f0 2020-11-20T12:14:17.296 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.292+0000 7ff5f9ffb700 1 -- 172.21.15.132:0/2688654853 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "83f6f89f-569f-4dfe-880b-e88d6d993dc0", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff608027be0 con 0x7ff60c0642f0 2020-11-20T12:14:17.297 INFO:teuthology.orchestra.run.smithi132.stdout:2 2020-11-20T12:14:17.298 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.293+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 msgr2=0x7ff60c147f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.298 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.293+0000 7ff612f3c700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c147f80 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7ff60c0bfd40 tx=0x7ff608016000).stop 2020-11-20T12:14:17.298 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.294+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 shutdown_connections 2020-11-20T12:14:17.298 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.294+0000 7ff612f3c700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff60c152a60 0x7ff60c1628a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.299 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.294+0000 7ff612f3c700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff60c0642f0 0x7ff60c147f80 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.299 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.294+0000 7ff612f3c700 1 --2- 172.21.15.132:0/2688654853 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff60c0abf20 0x7ff60c155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.299 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.294+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 >> 172.21.15.132:0/2688654853 conn(0x7ff60c0c3380 msgr2=0x7ff60c0bc9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.299 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.294+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 shutdown_connections 2020-11-20T12:14:17.300 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.294+0000 7ff612f3c700 1 -- 172.21.15.132:0/2688654853 wait complete. 2020-11-20T12:14:17.310 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new fa90cb08-95e5-499c-b684-6feeba97c8b3 3 2020-11-20T12:14:17.420 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.416+0000 7f6671d92700 1 Processor -- start 2020-11-20T12:14:17.420 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.416+0000 7f6671d92700 1 -- start start 2020-11-20T12:14:17.422 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6671d92700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f666c0c0680 0x7f666c0c0a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.423 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6671d92700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f666c0bf870 0x7f666c060130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.423 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6671d92700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f666c14af20 con 0x7f666c14a3a0 2020-11-20T12:14:17.423 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6671d92700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0be6b0 con 0x7f666c0bf870 2020-11-20T12:14:17.423 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6671d92700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f666c0be950 con 0x7f666c0c0680 2020-11-20T12:14:17.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f666c0c0680 0x7f666c0c0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f666c0c0680 0x7f666c0c0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33664/0 (socket says 172.21.15.132:33664) 2020-11-20T12:14:17.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 -- 172.21.15.132:0/3423731269 learned_addr learned my addr 172.21.15.132:0/3423731269 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:17.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f666bfff700 1 --2- 172.21.15.132:0/3423731269 >> v2:172.21.15.66:3300/0 conn(0x7f666c0bf870 0x7f666c060130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 -- 172.21.15.132:0/3423731269 >> v2:172.21.15.66:3300/0 conn(0x7f666c0bf870 msgr2=0x7f666c060130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:17.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 --2- 172.21.15.132:0/3423731269 >> v2:172.21.15.66:3300/0 conn(0x7f666c0bf870 0x7f666c060130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 -- 172.21.15.132:0/3423731269 >> v1:172.21.15.66:6789/0 conn(0x7f666c14a3a0 legacy=0x7f666c14a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 -- 172.21.15.132:0/3423731269 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c0bebf0 con 0x7f666c0c0680 2020-11-20T12:14:17.426 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f6670d90700 1 --2- 172.21.15.132:0/3423731269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c0c0a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f666c0c4ce0 tx=0x7f666000ae20).ready entity=mon.2 client_cookie=5b3db3eaf2e8a71e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.426 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f666b7fe700 1 -- 172.21.15.132:0/3423731269 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666000cad0 con 0x7f666c0c0680 2020-11-20T12:14:17.426 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f666b7fe700 1 -- 172.21.15.132:0/3423731269 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6660000e90 con 0x7f666c0c0680 2020-11-20T12:14:17.426 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.417+0000 7f666b7fe700 1 -- 172.21.15.132:0/3423731269 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f666000ce40 con 0x7f666c0c0680 2020-11-20T12:14:17.426 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 -- 172.21.15.132:0/3423731269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 msgr2=0x7f666c0c0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.427 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 --2- 172.21.15.132:0/3423731269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c0c0a60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f666c0c4ce0 tx=0x7f666000ae20).stop 2020-11-20T12:14:17.427 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 -- 172.21.15.132:0/3423731269 shutdown_connections 2020-11-20T12:14:17.427 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 --2- 172.21.15.132:0/3423731269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c0c0a60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.427 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 --2- 172.21.15.132:0/3423731269 >> v2:172.21.15.66:3300/0 conn(0x7f666c0bf870 0x7f666c060130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.428 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 -- 172.21.15.132:0/3423731269 >> 172.21.15.132:0/3423731269 conn(0x7f666c0670e0 msgr2=0x7f666c062220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.428 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 -- 172.21.15.132:0/3423731269 shutdown_connections 2020-11-20T12:14:17.428 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.418+0000 7f6671d92700 1 -- 172.21.15.132:0/3423731269 wait complete. 2020-11-20T12:14:17.428 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.419+0000 7f6671d92700 1 Processor -- start 2020-11-20T12:14:17.431 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.419+0000 7f6671d92700 1 -- start start 2020-11-20T12:14:17.431 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6671d92700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c0bf870 0x7f666c14f740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.431 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6671d92700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c140200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.432 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6671d92700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f666c14a3a0 0x7f666c150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.432 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6671d92700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c14fc30 con 0x7f666c0bf870 2020-11-20T12:14:17.432 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6671d92700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c140ac0 con 0x7f666c14a3a0 2020-11-20T12:14:17.432 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6671d92700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c1606f0 con 0x7f666c0c0680 2020-11-20T12:14:17.433 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f666bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c140200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.433 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f666bfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c140200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33672/0 (socket says 172.21.15.132:33672) 2020-11-20T12:14:17.433 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f666bfff700 1 -- 172.21.15.132:0/209207312 learned_addr learned my addr 172.21.15.132:0/209207312 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:17.434 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6670d90700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c0bf870 0x7f666c14f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.434 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f6671591700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f666c14a3a0 0x7f666c150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.434 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f666bfff700 1 -- 172.21.15.132:0/209207312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f666c14a3a0 msgr2=0x7f666c150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.434 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.420+0000 7f666bfff700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f666c14a3a0 0x7f666c150020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.434 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f666bfff700 1 -- 172.21.15.132:0/209207312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c0bf870 msgr2=0x7f666c14f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.435 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f666bfff700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c0bf870 0x7f666c14f740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.436 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f666bfff700 1 -- 172.21.15.132:0/209207312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f666c160990 con 0x7f666c0c0680 2020-11-20T12:14:17.436 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6670d90700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c0bf870 0x7f666c14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:17.436 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f666bfff700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c140200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f665800ebd0 tx=0x7f6658006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.436 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6668ff9700 1 -- 172.21.15.132:0/209207312 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665800c9b0 con 0x7f666c0c0680 2020-11-20T12:14:17.437 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6668ff9700 1 -- 172.21.15.132:0/209207312 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f665800cb10 con 0x7f666c0c0680 2020-11-20T12:14:17.437 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c160c30 con 0x7f666c0c0680 2020-11-20T12:14:17.437 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6668ff9700 1 -- 172.21.15.132:0/209207312 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f665800ce90 con 0x7f666c0c0680 2020-11-20T12:14:17.437 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c161170 con 0x7f666c0c0680 2020-11-20T12:14:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6668ff9700 1 -- 172.21.15.132:0/209207312 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f6658012860 con 0x7f666c0c0680 2020-11-20T12:14:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.421+0000 7f6668ff9700 1 -- 172.21.15.132:0/209207312 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f665801c920 con 0x7f666c0c0680 2020-11-20T12:14:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.422+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c0be310 con 0x7f666c0c0680 2020-11-20T12:14:17.438 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.424+0000 7f6668ff9700 1 -- 172.21.15.132:0/209207312 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f6658012c80 con 0x7f666c0c0680 2020-11-20T12:14:17.505 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.502+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa90cb08-95e5-499c-b684-6feeba97c8b3", "id": 3} v 0) v1 -- 0x7f666c069c70 con 0x7f666c0c0680 2020-11-20T12:14:17.511 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.507+0000 7f6668ff9700 1 -- 172.21.15.132:0/209207312 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa90cb08-95e5-499c-b684-6feeba97c8b3", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f665801cce0 con 0x7f666c0c0680 2020-11-20T12:14:17.511 INFO:teuthology.orchestra.run.smithi132.stdout:3 2020-11-20T12:14:17.512 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 msgr2=0x7f666c140200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.512 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c140200 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f665800ebd0 tx=0x7f6658006e30).stop 2020-11-20T12:14:17.513 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 shutdown_connections 2020-11-20T12:14:17.513 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f666c14a3a0 0x7f666c150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.513 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f666c0bf870 0x7f666c14f740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.513 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 --2- 172.21.15.132:0/209207312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f666c0c0680 0x7f666c140200 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.514 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 >> 172.21.15.132:0/209207312 conn(0x7f666c0670e0 msgr2=0x7f666c14a810 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.514 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 shutdown_connections 2020-11-20T12:14:17.514 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.508+0000 7f6671d92700 1 -- 172.21.15.132:0/209207312 wait complete. 2020-11-20T12:14:17.523 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12 4 2020-11-20T12:14:17.636 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.632+0000 7f63f2882700 1 Processor -- start 2020-11-20T12:14:17.636 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.632+0000 7f63f2882700 1 -- start start 2020-11-20T12:14:17.638 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63f2882700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63ec151260 0x7f63ec0c1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.638 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63f2882700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0c1960 con 0x7f63ec0b8c90 2020-11-20T12:14:17.639 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63f2882700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63ec0c1c00 con 0x7f63ec0b9100 2020-11-20T12:14:17.639 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63f2882700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63ec0c1ea0 con 0x7f63ec151260 2020-11-20T12:14:17.639 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63ebfff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f63ec151260 0x7f63ec0c1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.639 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63f0e1f700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f63ec0b9100 0x7f63ec0bd660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58022/0 (socket says 172.21.15.132:58022) 2020-11-20T12:14:17.639 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63f0e1f700 1 -- 172.21.15.132:0/1198209495 learned_addr learned my addr 172.21.15.132:0/1198209495 (peer_addr_for_me v1:172.21.15.132:0/0) 2020-11-20T12:14:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63ebfff700 1 -- 172.21.15.132:0/1198209495 >> v1:172.21.15.132:6789/0 conn(0x7f63ec0b9100 legacy=0x7f63ec0bd660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63eaffd700 1 -- 172.21.15.132:0/1198209495 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 633755588 0 0) 0x7f63ec0c1c00 con 0x7f63ec0b9100 2020-11-20T12:14:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.633+0000 7f63ebfff700 1 -- 172.21.15.132:0/1198209495 >> v1:172.21.15.66:6789/0 conn(0x7f63ec0b8c90 legacy=0x7f63ec151640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63ebfff700 1 -- 172.21.15.132:0/1198209495 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec063980 con 0x7f63ec151260 2020-11-20T12:14:17.640 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63ebfff700 1 --2- 172.21.15.132:0/1198209495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec151260 0x7f63ec0c1130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f63e0006fd0 tx=0x7f63e0006e30).ready entity=mon.2 client_cookie=986595a808f4a26d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63eaffd700 1 -- 172.21.15.132:0/1198209495 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e00097e0 con 0x7f63ec151260 2020-11-20T12:14:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63eaffd700 1 -- 172.21.15.132:0/1198209495 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63e0000e90 con 0x7f63ec151260 2020-11-20T12:14:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63eaffd700 1 -- 172.21.15.132:0/1198209495 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63e0009b50 con 0x7f63ec151260 2020-11-20T12:14:17.641 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63f2882700 1 -- 172.21.15.132:0/1198209495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec151260 msgr2=0x7f63ec0c1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63f2882700 1 --2- 172.21.15.132:0/1198209495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec151260 0x7f63ec0c1130 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f63e0006fd0 tx=0x7f63e0006e30).stop 2020-11-20T12:14:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63f2882700 1 -- 172.21.15.132:0/1198209495 shutdown_connections 2020-11-20T12:14:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63f2882700 1 --2- 172.21.15.132:0/1198209495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec151260 0x7f63ec0c1130 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63f2882700 1 -- 172.21.15.132:0/1198209495 >> 172.21.15.132:0/1198209495 conn(0x7f63ec060b90 msgr2=0x7f63ec0c57a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.642 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.634+0000 7f63f2882700 1 -- 172.21.15.132:0/1198209495 shutdown_connections 2020-11-20T12:14:17.643 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.635+0000 7f63f2882700 1 -- 172.21.15.132:0/1198209495 wait complete. 2020-11-20T12:14:17.645 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 Processor -- start 2020-11-20T12:14:17.646 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 -- start start 2020-11-20T12:14:17.646 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63ec0b8c90 0x7f63ec14d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.646 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec0b9100 0x7f63ec157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.646 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63ec151260 0x7f63ec158190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.647 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c43d0 con 0x7f63ec151260 2020-11-20T12:14:17.647 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c4670 con 0x7f63ec0b8c90 2020-11-20T12:14:17.647 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.636+0000 7f63f2882700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63ec0c4910 con 0x7f63ec0b9100 2020-11-20T12:14:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec0b9100 0x7f63ec157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec0b9100 0x7f63ec157ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33684/0 (socket says 172.21.15.132:33684) 2020-11-20T12:14:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 -- 172.21.15.132:0/4279915845 learned_addr learned my addr 172.21.15.132:0/4279915845 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63f0e1f700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63ec151260 0x7f63ec158190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.648 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63ebfff700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63ec0b8c90 0x7f63ec14d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 -- 172.21.15.132:0/4279915845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63ec0b8c90 msgr2=0x7f63ec14d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63ec0b8c90 0x7f63ec14d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 -- 172.21.15.132:0/4279915845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63ec151260 msgr2=0x7f63ec158190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63ec151260 0x7f63ec158190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.649 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 -- 172.21.15.132:0/4279915845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63ec0c4bb0 con 0x7f63ec0b9100 2020-11-20T12:14:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63ebfff700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63ec0b8c90 0x7f63ec14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63eb7fe700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec0b9100 0x7f63ec157ca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f63dc00c710 tx=0x7f63dc007c90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63cbfff700 1 -- 172.21.15.132:0/4279915845 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc007020 con 0x7f63ec0b9100 2020-11-20T12:14:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63cbfff700 1 -- 172.21.15.132:0/4279915845 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63dc007180 con 0x7f63ec0b9100 2020-11-20T12:14:17.650 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63ec0c4e50 con 0x7f63ec0b9100 2020-11-20T12:14:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63cbfff700 1 -- 172.21.15.132:0/4279915845 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63dc006530 con 0x7f63ec0b9100 2020-11-20T12:14:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.637+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63ec14d930 con 0x7f63ec0b9100 2020-11-20T12:14:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.638+0000 7f63cbfff700 1 -- 172.21.15.132:0/4279915845 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f63dc01a060 con 0x7f63ec0b9100 2020-11-20T12:14:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.638+0000 7f63cbfff700 1 -- 172.21.15.132:0/4279915845 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7f63dc00eb40 con 0x7f63ec0b9100 2020-11-20T12:14:17.651 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.638+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f63ec0c54b0 con 0x7f63ec0b9100 2020-11-20T12:14:17.652 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.640+0000 7f63cbfff700 1 -- 172.21.15.132:0/4279915845 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f63dc018070 con 0x7f63ec0b9100 2020-11-20T12:14:17.722 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.718+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12", "id": 4} v 0) v1 -- 0x7f63ec061b90 con 0x7f63ec0b9100 2020-11-20T12:14:17.727 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.723+0000 7f63cbfff700 1 -- 172.21.15.132:0/4279915845 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f63dc00ee10 con 0x7f63ec0b9100 2020-11-20T12:14:17.727 INFO:teuthology.orchestra.run.smithi132.stdout:4 2020-11-20T12:14:17.728 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.724+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec0b9100 msgr2=0x7f63ec157ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.729 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.724+0000 7f63f2882700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec0b9100 0x7f63ec157ca0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f63dc00c710 tx=0x7f63dc007c90).stop 2020-11-20T12:14:17.729 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.724+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 shutdown_connections 2020-11-20T12:14:17.729 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.724+0000 7f63f2882700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f63ec151260 0x7f63ec158190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.729 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.724+0000 7f63f2882700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f63ec0b8c90 0x7f63ec14d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.730 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.724+0000 7f63f2882700 1 --2- 172.21.15.132:0/4279915845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f63ec0b9100 0x7f63ec157ca0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.730 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.724+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 >> 172.21.15.132:0/4279915845 conn(0x7f63ec060b90 msgr2=0x7f63ec0be6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.730 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.725+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 shutdown_connections 2020-11-20T12:14:17.730 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.725+0000 7f63f2882700 1 -- 172.21.15.132:0/4279915845 wait complete. 2020-11-20T12:14:17.740 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new edc6f7d0-4df0-4493-9122-6203686c3ef4 5 2020-11-20T12:14:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.847+0000 7fcfaca83700 1 Processor -- start 2020-11-20T12:14:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.847+0000 7fcfaca83700 1 -- start start 2020-11-20T12:14:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfaca83700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcfa8068580 0x7fcfa80606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfaca83700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcfa81506d0 0x7fcfa8150b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfaca83700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfa8067660 con 0x7fcfa80602f0 2020-11-20T12:14:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfaca83700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa8067900 con 0x7fcfa81506d0 2020-11-20T12:14:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfaca83700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfa8067ba0 con 0x7fcfa8068580 2020-11-20T12:14:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa77fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcfa80602f0 0x7fcfa80c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58030/0 (socket says 172.21.15.132:58030) 2020-11-20T12:14:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa77fe700 1 -- 172.21.15.132:0/4046094891 learned_addr learned my addr 172.21.15.132:0/4046094891 (peer_addr_for_me v1:172.21.15.132:0/0) 2020-11-20T12:14:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa7fff700 1 --2- 172.21.15.132:0/4046094891 >> v2:172.21.15.66:3300/0 conn(0x7fcfa81506d0 0x7fcfa8150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcf9ffff700 1 --2- 172.21.15.132:0/4046094891 >> v2:172.21.15.93:3300/0 conn(0x7fcfa8068580 0x7fcfa80606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa6ffd700 1 -- 172.21.15.132:0/4046094891 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215928061 0 0) 0x7fcfa8067660 con 0x7fcfa80602f0 2020-11-20T12:14:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa6ffd700 1 -- 172.21.15.132:0/4046094891 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf88003280 con 0x7fcfa80602f0 2020-11-20T12:14:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa7fff700 1 -- 172.21.15.132:0/4046094891 >> v2:172.21.15.93:3300/0 conn(0x7fcfa8068580 msgr2=0x7fcfa80606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa7fff700 1 --2- 172.21.15.132:0/4046094891 >> v2:172.21.15.93:3300/0 conn(0x7fcfa8068580 0x7fcfa80606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.856 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa7fff700 1 -- 172.21.15.132:0/4046094891 >> v1:172.21.15.132:6789/0 conn(0x7fcfa80602f0 legacy=0x7fcfa80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.856 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa7fff700 1 -- 172.21.15.132:0/4046094891 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa8067e40 con 0x7fcfa81506d0 2020-11-20T12:14:17.856 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcf9ffff700 1 --2- 172.21.15.132:0/4046094891 >> v2:172.21.15.93:3300/0 conn(0x7fcfa8068580 0x7fcfa80606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:17.856 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.848+0000 7fcfa7fff700 1 --2- 172.21.15.132:0/4046094891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 0x7fcfa8150b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fcfa80c2030 tx=0x7fcfa0009220).ready entity=mon.0 client_cookie=8d7c00ebda5364e4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.857 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfa6ffd700 1 -- 172.21.15.132:0/4046094891 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000b950 con 0x7fcfa81506d0 2020-11-20T12:14:17.857 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfa6ffd700 1 -- 172.21.15.132:0/4046094891 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfa000bab0 con 0x7fcfa81506d0 2020-11-20T12:14:17.857 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfa6ffd700 1 -- 172.21.15.132:0/4046094891 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000be30 con 0x7fcfa81506d0 2020-11-20T12:14:17.857 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 -- 172.21.15.132:0/4046094891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 msgr2=0x7fcfa8150b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.860 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 --2- 172.21.15.132:0/4046094891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 0x7fcfa8150b80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fcfa80c2030 tx=0x7fcfa0009220).stop 2020-11-20T12:14:17.860 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 -- 172.21.15.132:0/4046094891 shutdown_connections 2020-11-20T12:14:17.861 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 --2- 172.21.15.132:0/4046094891 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 0x7fcfa8150b80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.861 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 --2- 172.21.15.132:0/4046094891 >> v2:172.21.15.93:3300/0 conn(0x7fcfa8068580 0x7fcfa80606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.861 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 -- 172.21.15.132:0/4046094891 >> 172.21.15.132:0/4046094891 conn(0x7fcfa80c7790 msgr2=0x7fcfa80c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.861 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 -- 172.21.15.132:0/4046094891 shutdown_connections 2020-11-20T12:14:17.862 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.849+0000 7fcfaca83700 1 -- 172.21.15.132:0/4046094891 wait complete. 2020-11-20T12:14:17.862 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.850+0000 7fcfaca83700 1 Processor -- start 2020-11-20T12:14:17.862 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.850+0000 7fcfaca83700 1 -- start start 2020-11-20T12:14:17.862 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfaca83700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80602f0 0x7fcfa814c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.862 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfaca83700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa8068580 0x7fcfa81550f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.863 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfaca83700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 0x7fcfa8145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:17.863 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfaca83700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa814b6f0 con 0x7fcfa81506d0 2020-11-20T12:14:17.863 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfaca83700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8160fb0 con 0x7fcfa8068580 2020-11-20T12:14:17.863 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfaca83700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfa8161250 con 0x7fcfa80602f0 2020-11-20T12:14:17.863 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80602f0 0x7fcfa814c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.864 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80602f0 0x7fcfa814c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33694/0 (socket says 172.21.15.132:33694) 2020-11-20T12:14:17.864 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 -- 172.21.15.132:0/2554817540 learned_addr learned my addr 172.21.15.132:0/2554817540 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:17.864 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcf9ffff700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa8068580 0x7fcfa81550f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.864 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa7fff700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 0x7fcfa8145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:17.865 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 -- 172.21.15.132:0/2554817540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa8068580 msgr2=0x7fcfa81550f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.865 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa8068580 0x7fcfa81550f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.865 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 -- 172.21.15.132:0/2554817540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 msgr2=0x7fcfa8145f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.865 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 0x7fcfa8145f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.865 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 -- 172.21.15.132:0/2554817540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfa814b920 con 0x7fcfa80602f0 2020-11-20T12:14:17.866 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.851+0000 7fcfa77fe700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80602f0 0x7fcfa814c300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcf9800c6e0 tx=0x7fcf98007b00).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:17.866 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.852+0000 7fcf9f7fe700 1 -- 172.21.15.132:0/2554817540 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf980072e0 con 0x7fcfa80602f0 2020-11-20T12:14:17.866 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.852+0000 7fcf9f7fe700 1 -- 172.21.15.132:0/2554817540 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf98007440 con 0x7fcfa80602f0 2020-11-20T12:14:17.867 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.852+0000 7fcf9f7fe700 1 -- 172.21.15.132:0/2554817540 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf98005860 con 0x7fcfa80602f0 2020-11-20T12:14:17.867 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.852+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfa814bbc0 con 0x7fcfa80602f0 2020-11-20T12:14:17.867 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.852+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfa81555e0 con 0x7fcfa80602f0 2020-11-20T12:14:17.867 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.852+0000 7fcf9f7fe700 1 -- 172.21.15.132:0/2554817540 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fcf98010070 con 0x7fcfa80602f0 2020-11-20T12:14:17.868 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.852+0000 7fcf9f7fe700 1 -- 172.21.15.132:0/2554817540 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7fcf98013d20 con 0x7fcfa80602f0 2020-11-20T12:14:17.868 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.853+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfa8061760 con 0x7fcfa80602f0 2020-11-20T12:14:17.868 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.855+0000 7fcf9f7fe700 1 -- 172.21.15.132:0/2554817540 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fcf98018020 con 0x7fcfa80602f0 2020-11-20T12:14:17.937 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.933+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "edc6f7d0-4df0-4493-9122-6203686c3ef4", "id": 5} v 0) v1 -- 0x7fcfa8069c70 con 0x7fcfa80602f0 2020-11-20T12:14:17.940 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.936+0000 7fcf9f7fe700 1 -- 172.21.15.132:0/2554817540 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "edc6f7d0-4df0-4493-9122-6203686c3ef4", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7fcf98013770 con 0x7fcfa80602f0 2020-11-20T12:14:17.940 INFO:teuthology.orchestra.run.smithi132.stdout:5 2020-11-20T12:14:17.941 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.937+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80602f0 msgr2=0x7fcfa814c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:17.942 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.937+0000 7fcfaca83700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80602f0 0x7fcfa814c300 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fcf9800c6e0 tx=0x7fcf98007b00).stop 2020-11-20T12:14:17.942 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.938+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 shutdown_connections 2020-11-20T12:14:17.942 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.938+0000 7fcfaca83700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcfa81506d0 0x7fcfa8145f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.942 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.938+0000 7fcfaca83700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfa80602f0 0x7fcfa814c300 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.943 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.938+0000 7fcfaca83700 1 --2- 172.21.15.132:0/2554817540 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcfa8068580 0x7fcfa81550f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:17.943 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.938+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 >> 172.21.15.132:0/2554817540 conn(0x7fcfa80c7790 msgr2=0x7fcfa80c5850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:17.943 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.938+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 shutdown_connections 2020-11-20T12:14:17.943 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:17.938+0000 7fcfaca83700 1 -- 172.21.15.132:0/2554817540 wait complete. 2020-11-20T12:14:17.953 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 2a8fa279-a52a-444a-8346-c393fb303f9c 6 2020-11-20T12:14:18.070 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.064+0000 7fed34a6a700 1 Processor -- start 2020-11-20T12:14:18.071 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.064+0000 7fed34a6a700 1 -- start start 2020-11-20T12:14:18.071 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.064+0000 7fed34a6a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fed300bb370 0x7fed30154c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.071 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.064+0000 7fed34a6a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed30155300 0x7fed30064770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.071 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.064+0000 7fed34a6a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed30063b60 con 0x7fed301548b0 2020-11-20T12:14:18.071 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.064+0000 7fed34a6a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed30065dd0 con 0x7fed300bb370 2020-11-20T12:14:18.072 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.064+0000 7fed34a6a700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed30060130 con 0x7fed30155300 2020-11-20T12:14:18.072 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed30155300 0x7fed30064770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.072 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fed30155300 0x7fed30064770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33704/0 (socket says 172.21.15.132:33704) 2020-11-20T12:14:18.072 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 -- 172.21.15.132:0/4043085204 learned_addr learned my addr 172.21.15.132:0/4043085204 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:18.072 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed27fff700 1 --2- 172.21.15.132:0/4043085204 >> v2:172.21.15.66:3300/0 conn(0x7fed300bb370 0x7fed30154c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.073 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 -- 172.21.15.132:0/4043085204 >> v2:172.21.15.66:3300/0 conn(0x7fed300bb370 msgr2=0x7fed30154c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:18.073 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 --2- 172.21.15.132:0/4043085204 >> v2:172.21.15.66:3300/0 conn(0x7fed300bb370 0x7fed30154c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.073 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 -- 172.21.15.132:0/4043085204 >> v1:172.21.15.66:6789/0 conn(0x7fed301548b0 legacy=0x7fed300bf1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.073 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 -- 172.21.15.132:0/4043085204 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed300bb870 con 0x7fed30155300 2020-11-20T12:14:18.074 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed27fff700 1 --2- 172.21.15.132:0/4043085204 >> v2:172.21.15.66:3300/0 conn(0x7fed300bb370 0x7fed30154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:18.074 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2ed9d700 1 --2- 172.21.15.132:0/4043085204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed30155300 0x7fed30064770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fed30061bb0 tx=0x7fed280092d0).ready entity=mon.2 client_cookie=25752065c36ff78f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.074 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2dd9b700 1 -- 172.21.15.132:0/4043085204 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2800bbf0 con 0x7fed30155300 2020-11-20T12:14:18.074 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2dd9b700 1 -- 172.21.15.132:0/4043085204 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed2800bd50 con 0x7fed30155300 2020-11-20T12:14:18.075 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.065+0000 7fed2dd9b700 1 -- 172.21.15.132:0/4043085204 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed28011610 con 0x7fed30155300 2020-11-20T12:14:18.075 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 -- 172.21.15.132:0/4043085204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed30155300 msgr2=0x7fed30064770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.075 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 --2- 172.21.15.132:0/4043085204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed30155300 0x7fed30064770 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fed30061bb0 tx=0x7fed280092d0).stop 2020-11-20T12:14:18.075 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 -- 172.21.15.132:0/4043085204 shutdown_connections 2020-11-20T12:14:18.076 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 --2- 172.21.15.132:0/4043085204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed30155300 0x7fed30064770 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.076 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 --2- 172.21.15.132:0/4043085204 >> v2:172.21.15.66:3300/0 conn(0x7fed300bb370 0x7fed30154c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.076 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 -- 172.21.15.132:0/4043085204 >> 172.21.15.132:0/4043085204 conn(0x7fed300c3e40 msgr2=0x7fed300c4250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.076 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 -- 172.21.15.132:0/4043085204 shutdown_connections 2020-11-20T12:14:18.076 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.066+0000 7fed34a6a700 1 -- 172.21.15.132:0/4043085204 wait complete. 2020-11-20T12:14:18.079 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.067+0000 7fed34a6a700 1 Processor -- start 2020-11-20T12:14:18.079 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.067+0000 7fed34a6a700 1 -- start start 2020-11-20T12:14:18.079 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed300bb370 0x7fed301493d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.079 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed301548b0 0x7fed3014f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.080 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed30155300 0x7fed30145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.080 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301498c0 con 0x7fed30155300 2020-11-20T12:14:18.080 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed301604b0 con 0x7fed301548b0 2020-11-20T12:14:18.080 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed30160750 con 0x7fed300bb370 2020-11-20T12:14:18.080 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed300bb370 0x7fed301493d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.081 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed300bb370 0x7fed301493d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33706/0 (socket says 172.21.15.132:33706) 2020-11-20T12:14:18.081 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 -- 172.21.15.132:0/499978919 learned_addr learned my addr 172.21.15.132:0/499978919 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:18.082 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2ed9d700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed30155300 0x7fed30145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.082 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed27fff700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed301548b0 0x7fed3014f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.082 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 -- 172.21.15.132:0/499978919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed301548b0 msgr2=0x7fed3014f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed301548b0 0x7fed3014f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 -- 172.21.15.132:0/499978919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed30155300 msgr2=0x7fed30145f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed30155300 0x7fed30145f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 -- 172.21.15.132:0/499978919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed301609f0 con 0x7fed300bb370 2020-11-20T12:14:18.083 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed2e59c700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed300bb370 0x7fed301493d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed2000c6e0 tx=0x7fed20007c70).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.084 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed267fc700 1 -- 172.21.15.132:0/499978919 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000e4a0 con 0x7fed300bb370 2020-11-20T12:14:18.084 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed267fc700 1 -- 172.21.15.132:0/499978919 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed20001e90 con 0x7fed300bb370 2020-11-20T12:14:18.084 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed30160c90 con 0x7fed300bb370 2020-11-20T12:14:18.084 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed267fc700 1 -- 172.21.15.132:0/499978919 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed2000e830 con 0x7fed300bb370 2020-11-20T12:14:18.084 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.068+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed30150090 con 0x7fed300bb370 2020-11-20T12:14:18.085 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.069+0000 7fed267fc700 1 -- 172.21.15.132:0/499978919 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7fed20019030 con 0x7fed300bb370 2020-11-20T12:14:18.085 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.069+0000 7fed267fc700 1 -- 172.21.15.132:0/499978919 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7fed20012a20 con 0x7fed300bb370 2020-11-20T12:14:18.085 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.069+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed3005cad0 con 0x7fed300bb370 2020-11-20T12:14:18.086 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.071+0000 7fed267fc700 1 -- 172.21.15.132:0/499978919 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fed20017070 con 0x7fed300bb370 2020-11-20T12:14:18.150 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.146+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2a8fa279-a52a-444a-8346-c393fb303f9c", "id": 6} v 0) v1 -- 0x7fed300c1e80 con 0x7fed300bb370 2020-11-20T12:14:18.154 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.150+0000 7fed267fc700 1 -- 172.21.15.132:0/499978919 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a8fa279-a52a-444a-8346-c393fb303f9c", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fed2001c440 con 0x7fed300bb370 2020-11-20T12:14:18.154 INFO:teuthology.orchestra.run.smithi132.stdout:6 2020-11-20T12:14:18.155 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.150+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed300bb370 msgr2=0x7fed301493d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.155 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.150+0000 7fed34a6a700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed300bb370 0x7fed301493d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fed2000c6e0 tx=0x7fed20007c70).stop 2020-11-20T12:14:18.155 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.150+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 shutdown_connections 2020-11-20T12:14:18.156 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.150+0000 7fed34a6a700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fed30155300 0x7fed30145f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.156 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.151+0000 7fed34a6a700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed300bb370 0x7fed301493d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.156 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.151+0000 7fed34a6a700 1 --2- 172.21.15.132:0/499978919 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fed301548b0 0x7fed3014f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.156 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.151+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 >> 172.21.15.132:0/499978919 conn(0x7fed300c3e40 msgr2=0x7fed300c0350 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.157 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.151+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 shutdown_connections 2020-11-20T12:14:18.157 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.151+0000 7fed34a6a700 1 -- 172.21.15.132:0/499978919 wait complete. 2020-11-20T12:14:18.165 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new b4ad2429-191b-4dd5-91f2-7cf116eecbbf 7 2020-11-20T12:14:18.276 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.272+0000 7ffabea7d700 1 Processor -- start 2020-11-20T12:14:18.276 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.272+0000 7ffabea7d700 1 -- start start 2020-11-20T12:14:18.278 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabea7d700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffab80679a0 0x7ffab8067d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.279 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabea7d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ffab80bbe10 0x7ffab8063a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.279 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabea7d700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffab80bc700 con 0x7ffab80bc270 2020-11-20T12:14:18.279 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabea7d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab80bccb0 con 0x7ffab80bbe10 2020-11-20T12:14:18.279 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabea7d700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffab80bcf50 con 0x7ffab80679a0 2020-11-20T12:14:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabc819700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffab80679a0 0x7ffab8067d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabd01a700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffab80bc270 0x7ffab8150c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58058/0 (socket says 172.21.15.132:58058) 2020-11-20T12:14:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabd01a700 1 -- 172.21.15.132:0/1716269162 learned_addr learned my addr 172.21.15.132:0/1716269162 (peer_addr_for_me v1:172.21.15.132:0/0) 2020-11-20T12:14:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffab7fff700 1 --2- 172.21.15.132:0/1716269162 >> v2:172.21.15.66:3300/0 conn(0x7ffab80bbe10 0x7ffab8063a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabc819700 1 -- 172.21.15.132:0/1716269162 >> v2:172.21.15.66:3300/0 conn(0x7ffab80bbe10 msgr2=0x7ffab8063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabc819700 1 --2- 172.21.15.132:0/1716269162 >> v2:172.21.15.66:3300/0 conn(0x7ffab80bbe10 0x7ffab8063a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabc819700 1 -- 172.21.15.132:0/1716269162 >> v1:172.21.15.132:6789/0 conn(0x7ffab80bc270 legacy=0x7ffab8150c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffab77fe700 1 -- 172.21.15.132:0/1716269162 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1099350351 0 0) 0x7ffab80bc700 con 0x7ffab80bc270 2020-11-20T12:14:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.273+0000 7ffabc819700 1 -- 172.21.15.132:0/1716269162 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab80bd1f0 con 0x7ffab80679a0 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabc819700 1 --2- 172.21.15.132:0/1716269162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab8067d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ffab80c45d0 tx=0x7ffaac006e30).ready entity=mon.2 client_cookie=8025f16a758355a1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffab77fe700 1 -- 172.21.15.132:0/1716269162 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac0097b0 con 0x7ffab80679a0 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffab77fe700 1 -- 172.21.15.132:0/1716269162 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac000e90 con 0x7ffab80679a0 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffab77fe700 1 -- 172.21.15.132:0/1716269162 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac009b20 con 0x7ffab80679a0 2020-11-20T12:14:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 -- 172.21.15.132:0/1716269162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 msgr2=0x7ffab8067d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 --2- 172.21.15.132:0/1716269162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab8067d80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7ffab80c45d0 tx=0x7ffaac006e30).stop 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 -- 172.21.15.132:0/1716269162 shutdown_connections 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 --2- 172.21.15.132:0/1716269162 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab8067d80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 --2- 172.21.15.132:0/1716269162 >> v2:172.21.15.66:3300/0 conn(0x7ffab80bbe10 0x7ffab8063a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.283 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 -- 172.21.15.132:0/1716269162 >> 172.21.15.132:0/1716269162 conn(0x7ffab8060130 msgr2=0x7ffab8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 -- 172.21.15.132:0/1716269162 shutdown_connections 2020-11-20T12:14:18.284 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.274+0000 7ffabea7d700 1 -- 172.21.15.132:0/1716269162 wait complete. 2020-11-20T12:14:18.286 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.275+0000 7ffabea7d700 1 Processor -- start 2020-11-20T12:14:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabea7d700 1 -- start start 2020-11-20T12:14:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabea7d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab815cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabea7d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab80bbe10 0x7ffab8146310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabea7d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80ad960 0x7ffab8146800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabea7d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80b0ce0 con 0x7ffab80bbe10 2020-11-20T12:14:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabea7d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab815d290 con 0x7ffab80ad960 2020-11-20T12:14:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabea7d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffab80ae320 con 0x7ffab80679a0 2020-11-20T12:14:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabc819700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab815cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabc819700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab815cda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33718/0 (socket says 172.21.15.132:33718) 2020-11-20T12:14:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.276+0000 7ffabc819700 1 -- 172.21.15.132:0/1646618193 learned_addr learned my addr 172.21.15.132:0/1646618193 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffab7fff700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab80bbe10 0x7ffab8146310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabd01a700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80ad960 0x7ffab8146800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabc819700 1 -- 172.21.15.132:0/1646618193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80ad960 msgr2=0x7ffab8146800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabc819700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80ad960 0x7ffab8146800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabc819700 1 -- 172.21.15.132:0/1646618193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab80bbe10 msgr2=0x7ffab8146310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabc819700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab80bbe10 0x7ffab8146310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabc819700 1 -- 172.21.15.132:0/1646618193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab8146cf0 con 0x7ffab80679a0 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabd01a700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80ad960 0x7ffab8146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:18.290 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabc819700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab815cda0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ffaac009490 tx=0x7ffaac015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffab4ff9700 1 -- 172.21.15.132:0/1646618193 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac011cc0 con 0x7ffab80679a0 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffab4ff9700 1 -- 172.21.15.132:0/1646618193 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaac011e20 con 0x7ffab80679a0 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffab80ae080 con 0x7ffab80679a0 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffab4ff9700 1 -- 172.21.15.132:0/1646618193 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaac01e690 con 0x7ffab80679a0 2020-11-20T12:14:18.291 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffab80b1170 con 0x7ffab80679a0 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffab4ff9700 1 -- 172.21.15.132:0/1646618193 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7ffaac025030 con 0x7ffab80679a0 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.277+0000 7ffab4ff9700 1 -- 172.21.15.132:0/1646618193 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7ffaac01da50 con 0x7ffab80679a0 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.278+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffab80c32e0 con 0x7ffab80679a0 2020-11-20T12:14:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.280+0000 7ffab4ff9700 1 -- 172.21.15.132:0/1646618193 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7ffaac023070 con 0x7ffab80679a0 2020-11-20T12:14:18.361 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.357+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b4ad2429-191b-4dd5-91f2-7cf116eecbbf", "id": 7} v 0) v1 -- 0x7ffab80ae550 con 0x7ffab80679a0 2020-11-20T12:14:18.364 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.360+0000 7ffab4ff9700 1 -- 172.21.15.132:0/1646618193 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4ad2429-191b-4dd5-91f2-7cf116eecbbf", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffaac01ddf0 con 0x7ffab80679a0 2020-11-20T12:14:18.364 INFO:teuthology.orchestra.run.smithi132.stdout:7 2020-11-20T12:14:18.365 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 msgr2=0x7ffab815cda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.366 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab815cda0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7ffaac009490 tx=0x7ffaac015000).stop 2020-11-20T12:14:18.366 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 shutdown_connections 2020-11-20T12:14:18.366 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ffab80ad960 0x7ffab8146800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.366 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffab80679a0 0x7ffab815cda0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.367 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 --2- 172.21.15.132:0/1646618193 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ffab80bbe10 0x7ffab8146310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.367 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 >> 172.21.15.132:0/1646618193 conn(0x7ffab8060130 msgr2=0x7ffab8149cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.367 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.361+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 shutdown_connections 2020-11-20T12:14:18.367 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.362+0000 7ffabea7d700 1 -- 172.21.15.132:0/1646618193 wait complete. 2020-11-20T12:14:18.376 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 4daadfa9-1117-4187-acfb-1372c3219ad4 8 2020-11-20T12:14:18.487 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.483+0000 7f7c333e3700 1 Processor -- start 2020-11-20T12:14:18.487 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.483+0000 7f7c333e3700 1 -- start start 2020-11-20T12:14:18.490 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c333e3700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c2c14ec00 0x7f7c2c0beed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.490 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c333e3700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c151990 con 0x7f7c2c1524d0 2020-11-20T12:14:18.490 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c333e3700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2c0c2620 con 0x7f7c2c14efe0 2020-11-20T12:14:18.490 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c333e3700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c2c0c28c0 con 0x7f7c2c14ec00 2020-11-20T12:14:18.491 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c3117f700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c2c14ec00 0x7f7c2c0beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.491 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c3097e700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7c2c14efe0 0x7f7c2c151dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58068/0 (socket says 172.21.15.132:58068) 2020-11-20T12:14:18.491 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c3097e700 1 -- 172.21.15.132:0/4141683648 learned_addr learned my addr 172.21.15.132:0/4141683648 (peer_addr_for_me v1:172.21.15.132:0/0) 2020-11-20T12:14:18.491 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.484+0000 7f7c3117f700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c2c14ec00 0x7f7c2c0beed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33724/0 (socket says 172.21.15.132:33724) 2020-11-20T12:14:18.491 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c3117f700 1 -- 172.21.15.132:0/4141683648 >> v1:172.21.15.132:6789/0 conn(0x7f7c2c14efe0 legacy=0x7f7c2c151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.492 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c3117f700 1 -- 172.21.15.132:0/4141683648 >> v1:172.21.15.66:6789/0 conn(0x7f7c2c1524d0 legacy=0x7f7c2c0c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.492 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c3117f700 1 -- 172.21.15.132:0/4141683648 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c0c2b60 con 0x7f7c2c14ec00 2020-11-20T12:14:18.492 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c3117f700 1 --2- 172.21.15.132:0/4141683648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c14ec00 0x7f7c2c0beed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7c1c006fd0 tx=0x7f7c1c006e30).ready entity=mon.2 client_cookie=5dd94f89d48602c1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.492 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c1bfff700 1 -- 172.21.15.132:0/4141683648 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c009870 con 0x7f7c2c14ec00 2020-11-20T12:14:18.492 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c1bfff700 1 -- 172.21.15.132:0/4141683648 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c1c000e90 con 0x7f7c2c14ec00 2020-11-20T12:14:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c1bfff700 1 -- 172.21.15.132:0/4141683648 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c009be0 con 0x7f7c2c14ec00 2020-11-20T12:14:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c333e3700 1 -- 172.21.15.132:0/4141683648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c14ec00 msgr2=0x7f7c2c0beed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.485+0000 7f7c333e3700 1 --2- 172.21.15.132:0/4141683648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c14ec00 0x7f7c2c0beed0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f7c1c006fd0 tx=0x7f7c1c006e30).stop 2020-11-20T12:14:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.486+0000 7f7c333e3700 1 -- 172.21.15.132:0/4141683648 shutdown_connections 2020-11-20T12:14:18.493 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.486+0000 7f7c333e3700 1 --2- 172.21.15.132:0/4141683648 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c14ec00 0x7f7c2c0beed0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.486+0000 7f7c333e3700 1 -- 172.21.15.132:0/4141683648 >> 172.21.15.132:0/4141683648 conn(0x7f7c2c060130 msgr2=0x7f7c2c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.486+0000 7f7c333e3700 1 -- 172.21.15.132:0/4141683648 shutdown_connections 2020-11-20T12:14:18.494 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.486+0000 7f7c333e3700 1 -- 172.21.15.132:0/4141683648 wait complete. 2020-11-20T12:14:18.496 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.487+0000 7f7c333e3700 1 Processor -- start 2020-11-20T12:14:18.497 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.487+0000 7f7c333e3700 1 -- start start 2020-11-20T12:14:18.497 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c2c14ec00 0x7f7c2c1645d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.497 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2c14efe0 0x7f7c2c14a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.497 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c1524d0 0x7f7c2c0c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:18.498 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c164c20 con 0x7f7c2c14ec00 2020-11-20T12:14:18.498 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c164ec0 con 0x7f7c2c14efe0 2020-11-20T12:14:18.498 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c2c165160 con 0x7f7c2c1524d0 2020-11-20T12:14:18.498 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c1524d0 0x7f7c2c0c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c1524d0 0x7f7c2c0c6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33734/0 (socket says 172.21.15.132:33734) 2020-11-20T12:14:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 -- 172.21.15.132:0/2169226108 learned_addr learned my addr 172.21.15.132:0/2169226108 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c3117f700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c2c14ec00 0x7f7c2c1645d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c3097e700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2c14efe0 0x7f7c2c14a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:18.499 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 -- 172.21.15.132:0/2169226108 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2c14efe0 msgr2=0x7f7c2c14a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2c14efe0 0x7f7c2c14a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 -- 172.21.15.132:0/2169226108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c2c14ec00 msgr2=0x7f7c2c1645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c2c14ec00 0x7f7c2c1645d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 -- 172.21.15.132:0/2169226108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c2c165400 con 0x7f7c2c1524d0 2020-11-20T12:14:18.500 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c31980700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c1524d0 0x7f7c2c0c6130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7c2400ca90 tx=0x7f7c240013a0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c197fa700 1 -- 172.21.15.132:0/2169226108 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400ce50 con 0x7f7c2c1524d0 2020-11-20T12:14:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c197fa700 1 -- 172.21.15.132:0/2169226108 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c2400a7f0 con 0x7f7c2c1524d0 2020-11-20T12:14:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c2c162570 con 0x7f7c2c1524d0 2020-11-20T12:14:18.501 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c197fa700 1 -- 172.21.15.132:0/2169226108 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c2400ab70 con 0x7f7c2c1524d0 2020-11-20T12:14:18.502 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c2c13ef90 con 0x7f7c2c1524d0 2020-11-20T12:14:18.502 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.488+0000 7f7c197fa700 1 -- 172.21.15.132:0/2169226108 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f7c24018020 con 0x7f7c2c1524d0 2020-11-20T12:14:18.502 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.489+0000 7f7c197fa700 1 -- 172.21.15.132:0/2169226108 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7f7c2401be30 con 0x7f7c2c1524d0 2020-11-20T12:14:18.502 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.489+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c2c1623e0 con 0x7f7c2c1524d0 2020-11-20T12:14:18.502 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.493+0000 7f7c197fa700 1 -- 172.21.15.132:0/2169226108 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f7c24016020 con 0x7f7c2c1524d0 2020-11-20T12:14:18.574 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.570+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4daadfa9-1117-4187-acfb-1372c3219ad4", "id": 8} v 0) v1 -- 0x7f7c2c061a40 con 0x7f7c2c1524d0 2020-11-20T12:14:18.577 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.574+0000 7f7c197fa700 1 -- 172.21.15.132:0/2169226108 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4daadfa9-1117-4187-acfb-1372c3219ad4", "id": 8}]=0 v11) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7c2402a0b0 con 0x7f7c2c1524d0 2020-11-20T12:14:18.578 INFO:teuthology.orchestra.run.smithi132.stdout:8 2020-11-20T12:14:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.574+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c1524d0 msgr2=0x7f7c2c0c6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.574+0000 7f7c333e3700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c1524d0 0x7f7c2c0c6130 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7c2400ca90 tx=0x7f7c240013a0).stop 2020-11-20T12:14:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.575+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 shutdown_connections 2020-11-20T12:14:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.575+0000 7f7c333e3700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c2c1524d0 0x7f7c2c0c6130 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.579 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.575+0000 7f7c333e3700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7c2c14ec00 0x7f7c2c1645d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.580 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.575+0000 7f7c333e3700 1 --2- 172.21.15.132:0/2169226108 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7c2c14efe0 0x7f7c2c14a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:18.581 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.575+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 >> 172.21.15.132:0/2169226108 conn(0x7f7c2c060130 msgr2=0x7f7c2c0c57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:18.581 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.575+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 shutdown_connections 2020-11-20T12:14:18.582 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.575+0000 7f7c333e3700 1 -- 172.21.15.132:0/2169226108 wait complete. 2020-11-20T12:14:18.590 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1 9 2020-11-20T12:14:18.704 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.700+0000 7f16b0cf0700 1 Processor -- start 2020-11-20T12:14:19.207 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.700+0000 7f16b0cf0700 1 -- start start 2020-11-20T12:14:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16b0cf0700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f16ac0c0a60 0x7f16ac0bf870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16b0cf0700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f16ac14a3a0 0x7f16ac14a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.213 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16b0cf0700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16ac0bfd60 con 0x7f16ac0c0680 2020-11-20T12:14:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16b0cf0700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac0c0ee0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16b0cf0700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16ac0be6b0 con 0x7f16ac0c0a60 2020-11-20T12:14:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16ab7fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f16ac0c0680 0x7f16ac060130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58078/0 (socket says 172.21.15.132:58078) 2020-11-20T12:14:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16ab7fe700 1 -- 172.21.15.132:0/2230384311 learned_addr learned my addr 172.21.15.132:0/2230384311 (peer_addr_for_me v1:172.21.15.132:0/0) 2020-11-20T12:14:19.214 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aaffd700 1 --2- 172.21.15.132:0/2230384311 >> v2:172.21.15.93:3300/0 conn(0x7f16ac0c0a60 0x7f16ac0bf870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16abfff700 1 --2- 172.21.15.132:0/2230384311 >> v2:172.21.15.66:3300/0 conn(0x7f16ac14a3a0 0x7f16ac14a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aa7fc700 1 -- 172.21.15.132:0/2230384311 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 786608145 0 0) 0x7f16ac0bfd60 con 0x7f16ac0c0680 2020-11-20T12:14:19.215 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aa7fc700 1 -- 172.21.15.132:0/2230384311 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f168c003280 con 0x7f16ac0c0680 2020-11-20T12:14:19.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aa7fc700 1 -- 172.21.15.132:0/2230384311 <== mon.2 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4115126255 0 0) 0x7f168c003280 con 0x7f16ac0c0680 2020-11-20T12:14:19.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aaffd700 1 -- 172.21.15.132:0/2230384311 >> v2:172.21.15.66:3300/0 conn(0x7f16ac14a3a0 msgr2=0x7f16ac14a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aaffd700 1 --2- 172.21.15.132:0/2230384311 >> v2:172.21.15.66:3300/0 conn(0x7f16ac14a3a0 0x7f16ac14a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aaffd700 1 -- 172.21.15.132:0/2230384311 >> v1:172.21.15.132:6789/0 conn(0x7f16ac0c0680 legacy=0x7f16ac060130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.216 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aaffd700 1 -- 172.21.15.132:0/2230384311 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac0be950 con 0x7f16ac0c0a60 2020-11-20T12:14:19.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16abfff700 1 --2- 172.21.15.132:0/2230384311 >> v2:172.21.15.66:3300/0 conn(0x7f16ac14a3a0 0x7f16ac14a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:19.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.701+0000 7f16aaffd700 1 --2- 172.21.15.132:0/2230384311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 0x7f16ac0bf870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f16ac060840 tx=0x7f1694006e30).ready entity=mon.1 client_cookie=228bcbea05c25660 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16aa7fc700 1 -- 172.21.15.132:0/2230384311 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16a40018a0 con 0x7f16ac0c0a60 2020-11-20T12:14:19.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16aa7fc700 1 -- 172.21.15.132:0/2230384311 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1694000e90 con 0x7f16ac0c0a60 2020-11-20T12:14:19.217 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16aa7fc700 1 -- 172.21.15.132:0/2230384311 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1694011610 con 0x7f16ac0c0a60 2020-11-20T12:14:19.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 -- 172.21.15.132:0/2230384311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 msgr2=0x7f16ac0bf870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 --2- 172.21.15.132:0/2230384311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 0x7f16ac0bf870 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f16ac060840 tx=0x7f1694006e30).stop 2020-11-20T12:14:19.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 -- 172.21.15.132:0/2230384311 shutdown_connections 2020-11-20T12:14:19.218 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 --2- 172.21.15.132:0/2230384311 >> v2:172.21.15.66:3300/0 conn(0x7f16ac14a3a0 0x7f16ac14a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 --2- 172.21.15.132:0/2230384311 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 0x7f16ac0bf870 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 -- 172.21.15.132:0/2230384311 >> 172.21.15.132:0/2230384311 conn(0x7f16ac0670e0 msgr2=0x7f16ac062220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 -- 172.21.15.132:0/2230384311 shutdown_connections 2020-11-20T12:14:19.219 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.702+0000 7f16b0cf0700 1 -- 172.21.15.132:0/2230384311 wait complete. 2020-11-20T12:14:19.220 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.703+0000 7f16b0cf0700 1 Processor -- start 2020-11-20T12:14:19.220 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.703+0000 7f16b0cf0700 1 -- start start 2020-11-20T12:14:19.220 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16b0cf0700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ac0c0680 0x7f16ac164420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.220 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16b0cf0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 0x7f16ac14a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.220 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16b0cf0700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16ac14a3a0 0x7f16ac1502a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.221 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16b0cf0700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14ef60 con 0x7f16ac0c0680 2020-11-20T12:14:19.221 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16b0cf0700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14acd0 con 0x7f16ac0c0a60 2020-11-20T12:14:19.221 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16b0cf0700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16ac14ea20 con 0x7f16ac14a3a0 2020-11-20T12:14:19.221 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16abfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16ac14a3a0 0x7f16ac1502a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.222 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16abfff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16ac14a3a0 0x7f16ac1502a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33746/0 (socket says 172.21.15.132:33746) 2020-11-20T12:14:19.222 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16abfff700 1 -- 172.21.15.132:0/3431297390 learned_addr learned my addr 172.21.15.132:0/3431297390 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:19.222 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16ab7fe700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ac0c0680 0x7f16ac164420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.222 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.704+0000 7f16aaffd700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 0x7f16ac14a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.223 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16abfff700 1 -- 172.21.15.132:0/3431297390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 msgr2=0x7f16ac14a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.223 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16abfff700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 0x7f16ac14a7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.223 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16abfff700 1 -- 172.21.15.132:0/3431297390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ac0c0680 msgr2=0x7f16ac164420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.223 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16abfff700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ac0c0680 0x7f16ac164420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.223 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16abfff700 1 -- 172.21.15.132:0/3431297390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16ac14ecc0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.224 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16abfff700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16ac14a3a0 0x7f16ac1502a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f169c00ecd0 tx=0x7f169c006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.224 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16a37fe700 1 -- 172.21.15.132:0/3431297390 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c00c9b0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.224 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16a37fe700 1 -- 172.21.15.132:0/3431297390 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f169c00cb10 con 0x7f16ac14a3a0 2020-11-20T12:14:19.224 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16b0cf0700 1 -- 172.21.15.132:0/3431297390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16ac163a40 con 0x7f16ac14a3a0 2020-11-20T12:14:19.225 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16a37fe700 1 -- 172.21.15.132:0/3431297390 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f169c0123f0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.225 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16b0cf0700 1 -- 172.21.15.132:0/3431297390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16ac163f80 con 0x7f16ac14a3a0 2020-11-20T12:14:19.225 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16a37fe700 1 -- 172.21.15.132:0/3431297390 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 484+0+0 (secure 0 0 0) 0x7f169c0129c0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.225 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.705+0000 7f16a37fe700 1 -- 172.21.15.132:0/3431297390 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1789+0+0 (secure 0 0 0) 0x7f169c01cda0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.225 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.706+0000 7f16a17fa700 1 -- 172.21.15.132:0/3431297390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f167c004fd0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.226 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.708+0000 7f16a37fe700 1 -- 172.21.15.132:0/3431297390 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f169c01c5f0 con 0x7f16ac14a3a0 2020-11-20T12:14:19.226 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.786+0000 7f16a17fa700 1 -- 172.21.15.132:0/3431297390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1", "id": 9} v 0) v1 -- 0x7f167c004070 con 0x7f16ac14a3a0 2020-11-20T12:14:19.226 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a37fe700 1 -- 172.21.15.132:0/3431297390 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1", "id": 9}]=0 v12) v1 ==== 112+0+2 (secure 0 0 0) 0x7f169c01c790 con 0x7f16ac14a3a0 2020-11-20T12:14:19.226 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 -- 172.21.15.132:0/3431297390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16ac14a3a0 msgr2=0x7f16ac1502a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.227 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16ac14a3a0 0x7f16ac1502a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f169c00ecd0 tx=0x7f169c006e30).stop 2020-11-20T12:14:19.227 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 -- 172.21.15.132:0/3431297390 shutdown_connections 2020-11-20T12:14:19.227 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f16ac14a3a0 0x7f16ac1502a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.227 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f16ac0c0680 0x7f16ac164420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.227 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 --2- 172.21.15.132:0/3431297390 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f16ac0c0a60 0x7f16ac14a7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.228 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 -- 172.21.15.132:0/3431297390 >> 172.21.15.132:0/3431297390 conn(0x7f16ac0670e0 msgr2=0x7f16ac0bbf10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.228 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.790+0000 7f16a17fa700 1 -- 172.21.15.132:0/3431297390 shutdown_connections 2020-11-20T12:14:19.228 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:18.791+0000 7f16a17fa700 1 -- 172.21.15.132:0/3431297390 wait complete. 2020-11-20T12:14:19.228 INFO:teuthology.orchestra.run.smithi132.stdout:9 2020-11-20T12:14:19.229 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904 10 2020-11-20T12:14:19.336 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.332+0000 7fa62359e700 1 Processor -- start 2020-11-20T12:14:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.332+0000 7fa62359e700 1 -- start start 2020-11-20T12:14:19.339 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.333+0000 7fa62359e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6240602f0 0x7fa6240606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.339 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.333+0000 7fa62359e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa624154870 con 0x7fa6240642b0 2020-11-20T12:14:19.339 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.333+0000 7fa62359e700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa624152230 con 0x7fa624151690 2020-11-20T12:14:19.340 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.333+0000 7fa62359e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa624154aa0 con 0x7fa6240602f0 2020-11-20T12:14:19.340 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa62259c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6240602f0 0x7fa6240606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.340 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa61bfff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fa6240642b0 0x7fa624064710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.132:40622/0 (socket says 172.21.15.132:40622) 2020-11-20T12:14:19.340 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa622d9d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa624151690 0x7fa624151b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.132:52014/0 (socket says 172.21.15.132:52014) 2020-11-20T12:14:19.340 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa61bfff700 1 -- 172.21.15.132:0/2977515967 learned_addr learned my addr 172.21.15.132:0/2977515967 (peer_addr_for_me v1:172.21.15.132:0/0) 2020-11-20T12:14:19.341 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa62259c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa6240602f0 0x7fa6240606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.132:56054/0 (socket says 172.21.15.132:56054) 2020-11-20T12:14:19.341 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa621d9b700 1 -- 172.21.15.132:0/2977515967 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2228767245 0 0) 0x7fa624152230 con 0x7fa624151690 2020-11-20T12:14:19.341 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa621d9b700 1 -- 172.21.15.132:0/2977515967 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa604003280 con 0x7fa624151690 2020-11-20T12:14:19.341 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa62259c700 1 -- 172.21.15.132:0/2977515967 >> v1:172.21.15.93:6789/0 conn(0x7fa624151690 legacy=0x7fa624151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.341 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa621d9b700 1 -- 172.21.15.132:0/2977515967 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958641725 0 0) 0x7fa624154870 con 0x7fa6240642b0 2020-11-20T12:14:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa62259c700 1 -- 172.21.15.132:0/2977515967 >> v1:172.21.15.66:6789/0 conn(0x7fa6240642b0 legacy=0x7fa624064710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa62259c700 1 -- 172.21.15.132:0/2977515967 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624154d40 con 0x7fa6240602f0 2020-11-20T12:14:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa62259c700 1 --2- 172.21.15.132:0/2977515967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6240602f0 0x7fa6240606d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa61400ba00 tx=0x7fa614006e30).ready entity=mon.0 client_cookie=ce6ceb4be7e74c33 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa621d9b700 1 -- 172.21.15.132:0/2977515967 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6140097a0 con 0x7fa6240602f0 2020-11-20T12:14:19.342 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa621d9b700 1 -- 172.21.15.132:0/2977515967 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614000e90 con 0x7fa6240602f0 2020-11-20T12:14:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.334+0000 7fa621d9b700 1 -- 172.21.15.132:0/2977515967 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614009b10 con 0x7fa6240602f0 2020-11-20T12:14:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.335+0000 7fa62359e700 1 -- 172.21.15.132:0/2977515967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6240602f0 msgr2=0x7fa6240606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.335+0000 7fa62359e700 1 --2- 172.21.15.132:0/2977515967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6240602f0 0x7fa6240606d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7fa61400ba00 tx=0x7fa614006e30).stop 2020-11-20T12:14:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.335+0000 7fa62359e700 1 -- 172.21.15.132:0/2977515967 shutdown_connections 2020-11-20T12:14:19.343 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.335+0000 7fa62359e700 1 --2- 172.21.15.132:0/2977515967 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa6240602f0 0x7fa6240606d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.344 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.335+0000 7fa62359e700 1 -- 172.21.15.132:0/2977515967 >> 172.21.15.132:0/2977515967 conn(0x7fa6240c5590 msgr2=0x7fa6240c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.344 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.335+0000 7fa62359e700 1 -- 172.21.15.132:0/2977515967 shutdown_connections 2020-11-20T12:14:19.344 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.335+0000 7fa62359e700 1 -- 172.21.15.132:0/2977515967 wait complete. 2020-11-20T12:14:19.346 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 Processor -- start 2020-11-20T12:14:19.346 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 -- start start 2020-11-20T12:14:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6240602f0 0x7fa6240bac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6240642b0 0x7fa624157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa624151690 0x7fa624158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.347 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6241526d0 con 0x7fa624151690 2020-11-20T12:14:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624152970 con 0x7fa6240642b0 2020-11-20T12:14:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.336+0000 7fa62359e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa624152c10 con 0x7fa6240602f0 2020-11-20T12:14:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6240602f0 0x7fa6240bac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6240602f0 0x7fa6240bac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33756/0 (socket says 172.21.15.132:33756) 2020-11-20T12:14:19.348 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 -- 172.21.15.132:0/3309376130 learned_addr learned my addr 172.21.15.132:0/3309376130 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa622d9d700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa624151690 0x7fa624158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa61bfff700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6240642b0 0x7fa624157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 -- 172.21.15.132:0/3309376130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6240642b0 msgr2=0x7fa624157e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6240642b0 0x7fa624157e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.349 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 -- 172.21.15.132:0/3309376130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa624151690 msgr2=0x7fa624158360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa624151690 0x7fa624158360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 -- 172.21.15.132:0/3309376130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624152eb0 con 0x7fa6240602f0 2020-11-20T12:14:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa61bfff700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6240642b0 0x7fa624157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62259c700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6240602f0 0x7fa6240bac30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa614009340 tx=0x7fa614015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.350 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa61a7fc700 1 -- 172.21.15.132:0/3309376130 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa614011ba0 con 0x7fa6240602f0 2020-11-20T12:14:19.351 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa61a7fc700 1 -- 172.21.15.132:0/3309376130 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa614011d00 con 0x7fa6240602f0 2020-11-20T12:14:19.351 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa61a7fc700 1 -- 172.21.15.132:0/3309376130 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61401d680 con 0x7fa6240602f0 2020-11-20T12:14:19.351 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa624153150 con 0x7fa6240602f0 2020-11-20T12:14:19.351 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.337+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa624149e10 con 0x7fa6240602f0 2020-11-20T12:14:19.351 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.338+0000 7fa61a7fc700 1 -- 172.21.15.132:0/3309376130 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7fa61400f070 con 0x7fa6240602f0 2020-11-20T12:14:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.338+0000 7fa61a7fc700 1 -- 172.21.15.132:0/3309376130 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 1904+0+0 (secure 0 0 0) 0x7fa61403da60 con 0x7fa6240602f0 2020-11-20T12:14:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.338+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62414a000 con 0x7fa6240602f0 2020-11-20T12:14:19.352 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.340+0000 7fa61a7fc700 1 -- 172.21.15.132:0/3309376130 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7fa614022070 con 0x7fa6240602f0 2020-11-20T12:14:19.417 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.414+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904", "id": 10} v 0) v1 -- 0x7fa624061960 con 0x7fa6240602f0 2020-11-20T12:14:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa61a7fc700 1 -- 172.21.15.132:0/3309376130 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904", "id": 10}]=0 v13) v1 ==== 113+0+3 (secure 0 0 0) 0x7fa614018330 con 0x7fa6240602f0 2020-11-20T12:14:19.423 INFO:teuthology.orchestra.run.smithi132.stdout:10 2020-11-20T12:14:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6240602f0 msgr2=0x7fa6240bac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6240602f0 0x7fa6240bac30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fa614009340 tx=0x7fa614015000).stop 2020-11-20T12:14:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 shutdown_connections 2020-11-20T12:14:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa624151690 0x7fa624158360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6240602f0 0x7fa6240bac30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 --2- 172.21.15.132:0/3309376130 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa6240642b0 0x7fa624157e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 >> 172.21.15.132:0/3309376130 conn(0x7fa6240c5590 msgr2=0x7fa6240c5970 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 shutdown_connections 2020-11-20T12:14:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.419+0000 7fa62359e700 1 -- 172.21.15.132:0/3309376130 wait complete. 2020-11-20T12:14:19.434 INFO:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd new 3432a17e-4237-43a6-b105-1d2839995444 11 2020-11-20T12:14:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.538+0000 7f9d3db3f700 1 Processor -- start 2020-11-20T12:14:19.541 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.538+0000 7f9d3db3f700 1 -- start start 2020-11-20T12:14:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9d380bd480 0x7f9d3814edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9d380bd860 0x7f9d380bf920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d380bfe10 0x7f9d38064f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3814f350 con 0x7f9d380bd860 2020-11-20T12:14:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3814f5f0 con 0x7f9d380bd480 2020-11-20T12:14:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d3814f890 con 0x7f9d380bfe10 2020-11-20T12:14:19.546 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d380bfe10 0x7f9d38064f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.546 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d380bfe10 0x7f9d38064f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33760/0 (socket says 172.21.15.132:33760) 2020-11-20T12:14:19.546 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 -- 172.21.15.132:0/3979044328 learned_addr learned my addr 172.21.15.132:0/3979044328 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:19.546 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3cb3d700 1 --2- 172.21.15.132:0/3979044328 >> v2:172.21.15.93:3300/0 conn(0x7f9d380bd480 0x7f9d3814edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d37fff700 1 --2- 172.21.15.132:0/3979044328 >> v2:172.21.15.66:3300/0 conn(0x7f9d380bd860 0x7f9d380bf920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 -- 172.21.15.132:0/3979044328 >> v2:172.21.15.93:3300/0 conn(0x7f9d380bd480 msgr2=0x7f9d3814edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 --2- 172.21.15.132:0/3979044328 >> v2:172.21.15.93:3300/0 conn(0x7f9d380bd480 0x7f9d3814edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 -- 172.21.15.132:0/3979044328 >> v2:172.21.15.66:3300/0 conn(0x7f9d380bd860 msgr2=0x7f9d380bf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 --2- 172.21.15.132:0/3979044328 >> v2:172.21.15.66:3300/0 conn(0x7f9d380bd860 0x7f9d380bf920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 -- 172.21.15.132:0/3979044328 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3814fb30 con 0x7f9d380bfe10 2020-11-20T12:14:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3d33e700 1 --2- 172.21.15.132:0/3979044328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bfe10 0x7f9d38064f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9d380c4ce0 tx=0x7f9d300092d0).ready entity=mon.2 client_cookie=98ec030cf9caf129 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d377fe700 1 -- 172.21.15.132:0/3979044328 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3000bba0 con 0x7f9d380bfe10 2020-11-20T12:14:19.549 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d377fe700 1 -- 172.21.15.132:0/3979044328 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3000bd00 con 0x7f9d380bfe10 2020-11-20T12:14:19.549 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d377fe700 1 -- 172.21.15.132:0/3979044328 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d30011610 con 0x7f9d380bfe10 2020-11-20T12:14:19.549 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3979044328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bfe10 msgr2=0x7f9d38064f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.550 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3979044328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bfe10 0x7f9d38064f90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f9d380c4ce0 tx=0x7f9d300092d0).stop 2020-11-20T12:14:19.550 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3979044328 shutdown_connections 2020-11-20T12:14:19.550 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3979044328 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bfe10 0x7f9d38064f90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.550 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3979044328 >> v2:172.21.15.93:3300/0 conn(0x7f9d380bd480 0x7f9d3814edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.550 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3979044328 >> v2:172.21.15.66:3300/0 conn(0x7f9d380bd860 0x7f9d380bf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.551 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3979044328 >> 172.21.15.132:0/3979044328 conn(0x7f9d380670e0 msgr2=0x7f9d38062220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.551 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3979044328 shutdown_connections 2020-11-20T12:14:19.551 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.539+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3979044328 wait complete. 2020-11-20T12:14:19.551 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.540+0000 7f9d3db3f700 1 Processor -- start 2020-11-20T12:14:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.540+0000 7f9d3db3f700 1 -- start start 2020-11-20T12:14:19.554 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3db3f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d380bd480 0x7f9d3814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.555 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3db3f700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bd860 0x7f9d381621a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.555 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3db3f700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d380bfe10 0x7f9d38162690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:19.555 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3db3f700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3810e730 con 0x7f9d380bfe10 2020-11-20T12:14:19.556 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3db3f700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3810e9d0 con 0x7f9d380bd480 2020-11-20T12:14:19.556 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3db3f700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d3810ec70 con 0x7f9d380bd860 2020-11-20T12:14:19.556 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bd860 0x7f9d381621a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.556 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bd860 0x7f9d381621a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33764/0 (socket says 172.21.15.132:33764) 2020-11-20T12:14:19.556 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 -- 172.21.15.132:0/3532278906 learned_addr learned my addr 172.21.15.132:0/3532278906 (peer_addr_for_me v2:172.21.15.132:0/0) 2020-11-20T12:14:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3cb3d700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d380bd480 0x7f9d3814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3d33e700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d380bfe10 0x7f9d38162690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 -- 172.21.15.132:0/3532278906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d380bd480 msgr2=0x7f9d3814de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d380bd480 0x7f9d3814de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 -- 172.21.15.132:0/3532278906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d380bfe10 msgr2=0x7f9d38162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d380bfe10 0x7f9d38162690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 -- 172.21.15.132:0/3532278906 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3810ef10 con 0x7f9d380bd860 2020-11-20T12:14:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d3d33e700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d380bfe10 0x7f9d38162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.541+0000 7f9d37fff700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bd860 0x7f9d381621a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9d2400eba0 tx=0x7f9d24006e30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d34ff9700 1 -- 172.21.15.132:0/3532278906 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400c920 con 0x7f9d380bd860 2020-11-20T12:14:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d34ff9700 1 -- 172.21.15.132:0/3532278906 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d2400ca80 con 0x7f9d380bd860 2020-11-20T12:14:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d34ff9700 1 -- 172.21.15.132:0/3532278906 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400ce00 con 0x7f9d380bd860 2020-11-20T12:14:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d38161d00 con 0x7f9d380bd860 2020-11-20T12:14:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d38150e50 con 0x7f9d380bd860 2020-11-20T12:14:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d34ff9700 1 -- 172.21.15.132:0/3532278906 <== mon.2 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 2) v1 ==== 33694+0+0 (secure 0 0 0) 0x7f9d24012600 con 0x7f9d380bd860 2020-11-20T12:14:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d34ff9700 1 -- 172.21.15.132:0/3532278906 <== mon.2 v2:172.21.15.132:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2395+0+0 (secure 0 0 0) 0x7f9d2403cfd0 con 0x7f9d380bd860 2020-11-20T12:14:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.542+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d380bf800 con 0x7f9d380bd860 2020-11-20T12:14:19.561 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.544+0000 7f9d34ff9700 1 -- 172.21.15.132:0/3532278906 <== mon.2 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71786 (secure 0 0 0) 0x7f9d24012cb0 con 0x7f9d380bd860 2020-11-20T12:14:19.622 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.618+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3432a17e-4237-43a6-b105-1d2839995444", "id": 11} v 0) v1 -- 0x7f9d380be310 con 0x7f9d380bd860 2020-11-20T12:14:19.626 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.622+0000 7f9d34ff9700 1 -- 172.21.15.132:0/3532278906 <== mon.2 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3432a17e-4237-43a6-b105-1d2839995444", "id": 11}]=0 v14) v1 ==== 113+0+3 (secure 0 0 0) 0x7f9d2402b0b0 con 0x7f9d380bd860 2020-11-20T12:14:19.626 INFO:teuthology.orchestra.run.smithi132.stdout:11 2020-11-20T12:14:19.627 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bd860 msgr2=0x7f9d381621a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:19.628 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bd860 0x7f9d381621a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f9d2400eba0 tx=0x7f9d24006e30).stop 2020-11-20T12:14:19.628 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 shutdown_connections 2020-11-20T12:14:19.628 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9d380bfe10 0x7f9d38162690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.628 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9d380bd480 0x7f9d3814de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.629 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 --2- 172.21.15.132:0/3532278906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d380bd860 0x7f9d381621a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:19.629 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 >> 172.21.15.132:0/3532278906 conn(0x7f9d380670e0 msgr2=0x7f9d38062220 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:19.629 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 shutdown_connections 2020-11-20T12:14:19.629 INFO:teuthology.orchestra.run.smithi132.stderr:2020-11-20T12:14:19.623+0000 7f9d3db3f700 1 -- 172.21.15.132:0/3532278906 wait complete. 2020-11-20T12:14:19.642 INFO:tasks.ceph.osd.0:Restarting daemon 2020-11-20T12:14:19.642 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-11-20T12:14:19.645 INFO:tasks.ceph.osd.0:Started 2020-11-20T12:14:19.645 INFO:tasks.ceph.osd.3:Restarting daemon 2020-11-20T12:14:19.646 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-11-20T12:14:19.647 INFO:tasks.ceph.osd.3:Started 2020-11-20T12:14:19.648 INFO:tasks.ceph.osd.6:Restarting daemon 2020-11-20T12:14:19.648 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-11-20T12:14:19.650 INFO:tasks.ceph.osd.6:Started 2020-11-20T12:14:19.651 INFO:tasks.ceph.osd.9:Restarting daemon 2020-11-20T12:14:19.651 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 9 2020-11-20T12:14:19.653 INFO:tasks.ceph.osd.9:Started 2020-11-20T12:14:19.654 INFO:tasks.ceph.osd.1:Restarting daemon 2020-11-20T12:14:19.654 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-11-20T12:14:19.656 INFO:tasks.ceph.osd.1:Started 2020-11-20T12:14:19.657 INFO:tasks.ceph.osd.4:Restarting daemon 2020-11-20T12:14:19.657 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-11-20T12:14:19.660 INFO:tasks.ceph.osd.4:Started 2020-11-20T12:14:19.660 INFO:tasks.ceph.osd.7:Restarting daemon 2020-11-20T12:14:19.660 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-11-20T12:14:19.663 INFO:tasks.ceph.osd.7:Started 2020-11-20T12:14:19.663 INFO:tasks.ceph.osd.10:Restarting daemon 2020-11-20T12:14:19.663 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 10 2020-11-20T12:14:19.666 INFO:tasks.ceph.osd.10:Started 2020-11-20T12:14:19.666 INFO:tasks.ceph.osd.2:Restarting daemon 2020-11-20T12:14:19.666 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-11-20T12:14:19.669 INFO:tasks.ceph.osd.2:Started 2020-11-20T12:14:19.669 INFO:tasks.ceph.osd.5:Restarting daemon 2020-11-20T12:14:19.670 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-11-20T12:14:19.671 INFO:tasks.ceph.osd.5:Started 2020-11-20T12:14:19.672 INFO:tasks.ceph.osd.8:Restarting daemon 2020-11-20T12:14:19.673 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 8 2020-11-20T12:14:19.675 INFO:tasks.ceph.osd.8:Started 2020-11-20T12:14:19.675 INFO:tasks.ceph.osd.11:Restarting daemon 2020-11-20T12:14:19.675 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 11 2020-11-20T12:14:19.677 INFO:tasks.ceph.osd.11:Started 2020-11-20T12:14:19.678 INFO:tasks.ceph:Waiting for OSDs to come up 2020-11-20T12:14:20.011 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:20.049 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:20.055 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:20.234 INFO:tasks.ceph.osd.0.smithi093.stderr:2020-11-20T12:14:20.231+0000 7fe9ffc0ef40 -1 Falling back to public interface 2020-11-20T12:14:20.235 INFO:tasks.ceph.osd.3.smithi093.stderr:2020-11-20T12:14:20.232+0000 7fcae385ef40 -1 Falling back to public interface 2020-11-20T12:14:20.247 INFO:tasks.ceph.osd.9.smithi093.stderr:2020-11-20T12:14:20.239+0000 7f5d42a6ff40 -1 Falling back to public interface 2020-11-20T12:14:20.250 INFO:tasks.ceph.osd.1.smithi066.stderr:2020-11-20T12:14:20.246+0000 7f8b9f10ff40 -1 Falling back to public interface 2020-11-20T12:14:20.259 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-11-20T12:14:20.255+0000 7f4913d01f40 -1 Falling back to public interface 2020-11-20T12:14:20.259 INFO:tasks.ceph.osd.5.smithi132.stderr:2020-11-20T12:14:20.256+0000 7fc1d6484f40 -1 Falling back to public interface 2020-11-20T12:14:20.260 INFO:tasks.ceph.osd.2.smithi132.stderr:2020-11-20T12:14:20.257+0000 7fa89d293f40 -1 Falling back to public interface 2020-11-20T12:14:20.266 INFO:tasks.ceph.osd.10.smithi066.stderr:2020-11-20T12:14:20.263+0000 7fa2d4a81f40 -1 Falling back to public interface 2020-11-20T12:14:20.271 INFO:tasks.ceph.osd.8.smithi132.stderr:2020-11-20T12:14:20.267+0000 7fc0ea702f40 -1 Falling back to public interface 2020-11-20T12:14:20.277 INFO:tasks.ceph.osd.11.smithi132.stderr:2020-11-20T12:14:20.272+0000 7f44c1293f40 -1 Falling back to public interface 2020-11-20T12:14:20.299 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-11-20T12:14:20.295+0000 7f9a8df91f40 -1 Falling back to public interface 2020-11-20T12:14:20.301 INFO:tasks.ceph.osd.6.smithi093.stderr:2020-11-20T12:14:20.297+0000 7ff034c11f40 -1 Falling back to public interface 2020-11-20T12:14:20.886 INFO:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:20.987 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.984+0000 7ff20bce8700 1 Processor -- start 2020-11-20T12:14:20.988 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.984+0000 7ff20bce8700 1 -- start start 2020-11-20T12:14:20.994 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff20bce8700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2040629b0 0x7ff204062d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.995 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff20bce8700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff2040c3030 0x7ff204065da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:20.995 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff20bce8700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff204066ee0 con 0x7ff204151550 2020-11-20T12:14:20.996 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff20bce8700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff204067980 con 0x7ff2040c3030 2020-11-20T12:14:20.996 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff20bce8700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff204066460 con 0x7ff2040629b0 2020-11-20T12:14:20.996 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff209283700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff2040c3030 0x7ff204065da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.996 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff209283700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff2040c3030 0x7ff204065da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38388/0 (socket says 172.21.15.93:38388) 2020-11-20T12:14:20.997 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.985+0000 7ff209283700 1 -- 172.21.15.93:0/126982809 learned_addr learned my addr 172.21.15.93:0/126982809 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:20.997 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff209a84700 1 --2- 172.21.15.93:0/126982809 >> v2:172.21.15.132:3300/0 conn(0x7ff2040629b0 0x7ff204062d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:20.998 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff209283700 1 -- 172.21.15.93:0/126982809 >> v2:172.21.15.132:3300/0 conn(0x7ff2040629b0 msgr2=0x7ff204062d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:20.998 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff209283700 1 --2- 172.21.15.93:0/126982809 >> v2:172.21.15.132:3300/0 conn(0x7ff2040629b0 0x7ff204062d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:20.998 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff209283700 1 -- 172.21.15.93:0/126982809 >> v1:172.21.15.66:6789/0 conn(0x7ff204151550 legacy=0x7ff20414e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:20.998 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff209283700 1 -- 172.21.15.93:0/126982809 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff204066700 con 0x7ff2040c3030 2020-11-20T12:14:20.999 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff209a84700 1 --2- 172.21.15.93:0/126982809 >> v2:172.21.15.132:3300/0 conn(0x7ff2040629b0 0x7ff204062d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:20.999 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff209283700 1 --2- 172.21.15.93:0/126982809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204065da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff204068230 tx=0x7ff1f4006ef0).ready entity=mon.1 client_cookie=5119d68e2a4408d5 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:20.999 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff208a82700 1 -- 172.21.15.93:0/126982809 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400b8f0 con 0x7ff2040c3030 2020-11-20T12:14:21.000 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff208a82700 1 -- 172.21.15.93:0/126982809 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f4000e90 con 0x7ff2040c3030 2020-11-20T12:14:21.000 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff208a82700 1 -- 172.21.15.93:0/126982809 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f400bc60 con 0x7ff2040c3030 2020-11-20T12:14:21.000 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 -- 172.21.15.93:0/126982809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 msgr2=0x7ff204065da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.001 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 --2- 172.21.15.93:0/126982809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204065da0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7ff204068230 tx=0x7ff1f4006ef0).stop 2020-11-20T12:14:21.001 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 -- 172.21.15.93:0/126982809 shutdown_connections 2020-11-20T12:14:21.001 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 --2- 172.21.15.93:0/126982809 >> v2:172.21.15.132:3300/0 conn(0x7ff2040629b0 0x7ff204062d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.002 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 --2- 172.21.15.93:0/126982809 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204065da0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.002 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 -- 172.21.15.93:0/126982809 >> 172.21.15.93:0/126982809 conn(0x7ff2040c6430 msgr2=0x7ff2040c2400 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.002 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 -- 172.21.15.93:0/126982809 shutdown_connections 2020-11-20T12:14:21.003 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.986+0000 7ff20bce8700 1 -- 172.21.15.93:0/126982809 wait complete. 2020-11-20T12:14:21.003 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.987+0000 7ff20bce8700 1 Processor -- start 2020-11-20T12:14:21.003 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20bce8700 1 -- start start 2020-11-20T12:14:21.004 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20bce8700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040629b0 0x7ff204160bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.004 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20bce8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204146d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.004 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20bce8700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff204151550 0x7ff204154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.004 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20bce8700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff20414c9f0 con 0x7ff2040629b0 2020-11-20T12:14:21.005 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20bce8700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204161290 con 0x7ff2040c3030 2020-11-20T12:14:21.005 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20bce8700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff204161530 con 0x7ff204151550 2020-11-20T12:14:21.005 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff209283700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204146d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.006 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff209283700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204146d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38392/0 (socket says 172.21.15.93:38392) 2020-11-20T12:14:21.006 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff209283700 1 -- 172.21.15.93:0/1089262689 learned_addr learned my addr 172.21.15.93:0/1089262689 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:21.006 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.988+0000 7ff20a285700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff204151550 0x7ff204154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.007 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209a84700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040629b0 0x7ff204160bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.007 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209283700 1 -- 172.21.15.93:0/1089262689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff204151550 msgr2=0x7ff204154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.007 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209283700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff204151550 0x7ff204154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.007 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209283700 1 -- 172.21.15.93:0/1089262689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040629b0 msgr2=0x7ff204160bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.008 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209283700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040629b0 0x7ff204160bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.008 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209283700 1 -- 172.21.15.93:0/1089262689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2041617d0 con 0x7ff2040c3030 2020-11-20T12:14:21.008 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209a84700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040629b0 0x7ff204160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:21.009 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff209283700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204146d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff204068790 tx=0x7ff1f4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.009 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff1f1ffb700 1 -- 172.21.15.93:0/1089262689 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f4011de0 con 0x7ff2040c3030 2020-11-20T12:14:21.009 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff1f1ffb700 1 -- 172.21.15.93:0/1089262689 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1f401d480 con 0x7ff2040c3030 2020-11-20T12:14:21.010 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff20414cc20 con 0x7ff2040c3030 2020-11-20T12:14:21.010 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff1f1ffb700 1 -- 172.21.15.93:0/1089262689 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1f401d800 con 0x7ff2040c3030 2020-11-20T12:14:21.010 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.989+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff204152a40 con 0x7ff2040c3030 2020-11-20T12:14:21.011 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.990+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff20405c700 con 0x7ff2040c3030 2020-11-20T12:14:21.011 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.990+0000 7ff1f1ffb700 1 -- 172.21.15.93:0/1089262689 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 3) v1 ==== 101030+0+0 (secure 0 0 0) 0x7ff1f4017070 con 0x7ff2040c3030 2020-11-20T12:14:21.011 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.991+0000 7ff1f1ffb700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff1dc080590 0x7ff1dc082a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:21.012 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.991+0000 7ff1f1ffb700 1 -- 172.21.15.93:0/1089262689 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2534+0+0 (secure 0 0 0) 0x7ff1f40a30c0 con 0x7ff2040c3030 2020-11-20T12:14:21.012 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.991+0000 7ff209a84700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff1dc080590 0x7ff1dc082a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:21.012 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.991+0000 7ff209a84700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff1dc080590 0x7ff1dc082a50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff20000b850 tx=0x7ff200008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:21.013 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:20.995+0000 7ff1f1ffb700 1 -- 172.21.15.93:0/1089262689 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff1f40792a0 con 0x7ff2040c3030 2020-11-20T12:14:21.143 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.140+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff20405ca60 con 0x7ff2040c3030 2020-11-20T12:14:21.144 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.140+0000 7ff1f1ffb700 1 -- 172.21.15.93:0/1089262689 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+11483 (secure 0 0 0) 0x7ff1f4015020 con 0x7ff2040c3030 2020-11-20T12:14:21.144 INFO:teuthology.misc.health.smithi093.stdout: 2020-11-20T12:14:21.145 INFO:teuthology.misc.health.smithi093.stdout:{"epoch":14,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:19.620941+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:21.146 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff1dc080590 msgr2=0x7ff1dc082a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.146 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff1dc080590 0x7ff1dc082a50 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7ff20000b850 tx=0x7ff200008040).stop 2020-11-20T12:14:21.146 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 msgr2=0x7ff204146d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:21.147 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204146d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7ff204068790 tx=0x7ff1f4016000).stop 2020-11-20T12:14:21.147 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 shutdown_connections 2020-11-20T12:14:21.147 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff204151550 0x7ff204154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.148 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff1dc080590 0x7ff1dc082a50 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.148 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff2040629b0 0x7ff204160bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.148 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 --2- 172.21.15.93:0/1089262689 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff2040c3030 0x7ff204146d80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:21.149 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 >> 172.21.15.93:0/1089262689 conn(0x7ff2040c6430 msgr2=0x7ff20414b770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:21.149 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 shutdown_connections 2020-11-20T12:14:21.149 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:21.142+0000 7ff20bce8700 1 -- 172.21.15.93:0/1089262689 wait complete. 2020-11-20T12:14:21.156 DEBUG:teuthology.misc:0 of 12 OSDs are up 2020-11-20T12:14:21.572 INFO:tasks.ceph.osd.0.smithi093.stderr:2020-11-20T12:14:21.569+0000 7fe9ffc0ef40 -1 osd.0 0 log_to_monitors {default=true} 2020-11-20T12:14:21.581 INFO:tasks.ceph.osd.1.smithi066.stderr:2020-11-20T12:14:21.577+0000 7f8b9f10ff40 -1 osd.1 0 log_to_monitors {default=true} 2020-11-20T12:14:21.582 INFO:tasks.ceph.osd.5.smithi132.stderr:2020-11-20T12:14:21.579+0000 7fc1d6484f40 -1 osd.5 0 log_to_monitors {default=true} 2020-11-20T12:14:21.586 INFO:tasks.ceph.osd.3.smithi093.stderr:2020-11-20T12:14:21.583+0000 7fcae385ef40 -1 osd.3 0 log_to_monitors {default=true} 2020-11-20T12:14:21.586 INFO:tasks.ceph.osd.9.smithi093.stderr:2020-11-20T12:14:21.583+0000 7f5d42a6ff40 -1 osd.9 0 log_to_monitors {default=true} 2020-11-20T12:14:21.589 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-11-20T12:14:21.585+0000 7f4913d01f40 -1 osd.4 0 log_to_monitors {default=true} 2020-11-20T12:14:21.597 INFO:tasks.ceph.osd.2.smithi132.stderr:2020-11-20T12:14:21.594+0000 7fa89d293f40 -1 osd.2 0 log_to_monitors {default=true} 2020-11-20T12:14:21.606 INFO:tasks.ceph.osd.10.smithi066.stderr:2020-11-20T12:14:21.603+0000 7fa2d4a81f40 -1 osd.10 0 log_to_monitors {default=true} 2020-11-20T12:14:21.614 INFO:tasks.ceph.osd.8.smithi132.stderr:2020-11-20T12:14:21.608+0000 7fc0ea702f40 -1 osd.8 0 log_to_monitors {default=true} 2020-11-20T12:14:21.617 INFO:tasks.ceph.osd.11.smithi132.stderr:2020-11-20T12:14:21.608+0000 7f44c1293f40 -1 osd.11 0 log_to_monitors {default=true} 2020-11-20T12:14:21.643 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-11-20T12:14:21.639+0000 7f9a8df91f40 -1 osd.7 0 log_to_monitors {default=true} 2020-11-20T12:14:21.647 INFO:tasks.ceph.osd.6.smithi093.stderr:2020-11-20T12:14:21.643+0000 7ff034c11f40 -1 osd.6 0 log_to_monitors {default=true} 2020-11-20T12:14:23.030 INFO:tasks.ceph.osd.10.smithi066.stderr:2020-11-20T12:14:23.027+0000 7fa2cb20a700 -1 osd.10 0 waiting for initial osdmap 2020-11-20T12:14:23.031 INFO:tasks.ceph.osd.8.smithi132.stderr:2020-11-20T12:14:23.028+0000 7fc0e0e8b700 -1 osd.8 0 waiting for initial osdmap 2020-11-20T12:14:23.032 INFO:tasks.ceph.osd.3.smithi093.stderr:2020-11-20T12:14:23.028+0000 7fcad9fe7700 -1 osd.3 0 waiting for initial osdmap 2020-11-20T12:14:23.034 INFO:tasks.ceph.osd.5.smithi132.stderr:2020-11-20T12:14:23.031+0000 7fc1ccc0d700 -1 osd.5 0 waiting for initial osdmap 2020-11-20T12:14:23.034 INFO:tasks.ceph.osd.9.smithi093.stderr:2020-11-20T12:14:23.031+0000 7f5d391f8700 -1 osd.9 0 waiting for initial osdmap 2020-11-20T12:14:23.035 INFO:tasks.ceph.osd.7.smithi066.stderr:2020-11-20T12:14:23.030+0000 7f9a85f1d700 -1 osd.7 0 waiting for initial osdmap 2020-11-20T12:14:23.035 INFO:tasks.ceph.osd.6.smithi093.stderr:2020-11-20T12:14:23.032+0000 7ff02b39a700 -1 osd.6 0 waiting for initial osdmap 2020-11-20T12:14:23.039 INFO:tasks.ceph.osd.4.smithi066.stderr:2020-11-20T12:14:23.035+0000 7f490a48a700 -1 osd.4 0 waiting for initial osdmap 2020-11-20T12:14:23.040 INFO:tasks.ceph.osd.2.smithi132.stderr:2020-11-20T12:14:23.037+0000 7fa893a1c700 -1 osd.2 0 waiting for initial osdmap 2020-11-20T12:14:23.040 INFO:tasks.ceph.osd.0.smithi093.stderr:2020-11-20T12:14:23.036+0000 7fe9f6397700 -1 osd.0 0 waiting for initial osdmap 2020-11-20T12:14:23.041 INFO:tasks.ceph.osd.11.smithi132.stderr:2020-11-20T12:14:23.038+0000 7f44b7a1c700 -1 osd.11 0 waiting for initial osdmap 2020-11-20T12:14:23.044 INFO:tasks.ceph.osd.1.smithi066.stderr:2020-11-20T12:14:23.041+0000 7f8b95898700 -1 osd.1 0 waiting for initial osdmap 2020-11-20T12:14:28.366 INFO:teuthology.orchestra.run.smithi093:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:28.475 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.471+0000 7f6f1ec97700 1 Processor -- start 2020-11-20T12:14:28.476 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.471+0000 7f6f1ec97700 1 -- start start 2020-11-20T12:14:28.479 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.472+0000 7f6f1ec97700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f18152500 con 0x7f6f180c0130 2020-11-20T12:14:28.479 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.472+0000 7f6f1ec97700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f180c08c0 con 0x7f6f180c17e0 2020-11-20T12:14:28.480 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.472+0000 7f6f1ec97700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f180c0b60 con 0x7f6f180bfd50 2020-11-20T12:14:28.480 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.472+0000 7f6f1d234700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6f180c17e0 0x7f6f1815bed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39402/0 (socket says 172.21.15.93:39402) 2020-11-20T12:14:28.480 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.472+0000 7f6f1d234700 1 -- 172.21.15.93:0/3624604738 learned_addr learned my addr 172.21.15.93:0/3624604738 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:28.480 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 33706951 0 0) 0x7f6f180c08c0 con 0x7f6f180c17e0 2020-11-20T12:14:28.480 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6efc003280 con 0x7f6f180c17e0 2020-11-20T12:14:28.481 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1851439041 0 0) 0x7f6efc003280 con 0x7f6f180c17e0 2020-11-20T12:14:28.481 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 >> v1:172.21.15.132:6789/0 conn(0x7f6f180bfd50 legacy=0x7f6f180c25a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.481 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 >> v1:172.21.15.66:6789/0 conn(0x7f6f180c0130 legacy=0x7f6f18150a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.481 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f180c0e00 con 0x7f6f180c17e0 2020-11-20T12:14:28.482 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f6f100018a0 con 0x7f6f180c17e0 2020-11-20T12:14:28.482 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 >> v1:172.21.15.93:6789/0 conn(0x7f6f180c17e0 legacy=0x7f6f1815bed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.482 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6efc003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.482 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6efc004520 0x7f6efc0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.483 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6efc004e90 0x7f6efc00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.483 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc005340 con 0x7f6efc004520 2020-11-20T12:14:28.483 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc00bc60 con 0x7f6efc0037f0 2020-11-20T12:14:28.483 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc00bda0 con 0x7f6efc004e90 2020-11-20T12:14:28.483 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f1ca33700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6efc003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.484 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f17fff700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6efc004520 0x7f6efc0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.484 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f1d234700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6efc004e90 0x7f6efc00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.484 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f1ca33700 1 -- 172.21.15.93:0/3624604738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6efc004e90 msgr2=0x7f6efc00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.485 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f1ca33700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6efc004e90 0x7f6efc00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.485 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f1ca33700 1 -- 172.21.15.93:0/3624604738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6efc004520 msgr2=0x7f6efc0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.485 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.473+0000 7f6f1ca33700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6efc004520 0x7f6efc0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.485 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ca33700 1 -- 172.21.15.93:0/3624604738 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc003280 con 0x7f6efc0037f0 2020-11-20T12:14:28.485 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1d234700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6efc004e90 0x7f6efc00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:28.486 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1d234700 1 -- 172.21.15.93:0/3624604738 reap_dead start 2020-11-20T12:14:28.486 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ca33700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6efc003c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6f0c001990 tx=0x7f6f0c007bd0).ready entity=mon.1 client_cookie=3d68025bf94684e1 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.486 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c007020 con 0x7f6efc0037f0 2020-11-20T12:14:28.486 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c007180 con 0x7f6efc0037f0 2020-11-20T12:14:28.487 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f177fe700 1 -- 172.21.15.93:0/3624604738 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c00c610 con 0x7f6efc0037f0 2020-11-20T12:14:28.487 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ec97700 1 -- 172.21.15.93:0/3624604738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 msgr2=0x7f6efc003c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.487 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6efc003c10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f6f0c001990 tx=0x7f6f0c007bd0).stop 2020-11-20T12:14:28.487 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ec97700 1 -- 172.21.15.93:0/3624604738 shutdown_connections 2020-11-20T12:14:28.487 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/3624604738 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6efc003c10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.488 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ec97700 1 -- 172.21.15.93:0/3624604738 >> 172.21.15.93:0/3624604738 conn(0x7f6f180c43f0 msgr2=0x7f6f180c4800 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.488 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ec97700 1 -- 172.21.15.93:0/3624604738 shutdown_connections 2020-11-20T12:14:28.488 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.474+0000 7f6f1ec97700 1 -- 172.21.15.93:0/3624604738 wait complete. 2020-11-20T12:14:28.488 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.475+0000 7f6f1ec97700 1 Processor -- start 2020-11-20T12:14:28.491 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ec97700 1 -- start start 2020-11-20T12:14:28.491 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ec97700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6f18161460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.491 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ec97700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f18157250 0x7f6f180bda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.491 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ec97700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f180bdf20 0x7f6f18161eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.492 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ec97700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c5850 con 0x7f6f18157250 2020-11-20T12:14:28.492 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ec97700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f18161950 con 0x7f6efc0037f0 2020-11-20T12:14:28.492 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ec97700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f180c3c60 con 0x7f6f180bdf20 2020-11-20T12:14:28.492 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ca33700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6f18161460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.493 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ca33700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6f18161460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38712/0 (socket says 172.21.15.93:38712) 2020-11-20T12:14:28.493 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.476+0000 7f6f1ca33700 1 -- 172.21.15.93:0/2112717737 learned_addr learned my addr 172.21.15.93:0/2112717737 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:28.493 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1d234700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f180bdf20 0x7f6f18161eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.493 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f17fff700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f18157250 0x7f6f180bda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.494 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ca33700 1 -- 172.21.15.93:0/2112717737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f180bdf20 msgr2=0x7f6f18161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.494 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ca33700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f180bdf20 0x7f6f18161eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.494 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ca33700 1 -- 172.21.15.93:0/2112717737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f18157250 msgr2=0x7f6f180bda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.494 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ca33700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f18157250 0x7f6f180bda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.494 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ca33700 1 -- 172.21.15.93:0/2112717737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f18157750 con 0x7f6efc0037f0 2020-11-20T12:14:28.495 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1d234700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f180bdf20 0x7f6f18161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:28.495 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ca33700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6f18161460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6f0c001010 tx=0x7f6f0c015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.495 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f14ff9700 1 -- 172.21.15.93:0/2112717737 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c007500 con 0x7f6efc0037f0 2020-11-20T12:14:28.495 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f14ff9700 1 -- 172.21.15.93:0/2112717737 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f0c0138c0 con 0x7f6efc0037f0 2020-11-20T12:14:28.495 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f181579f0 con 0x7f6efc0037f0 2020-11-20T12:14:28.496 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f14ff9700 1 -- 172.21.15.93:0/2112717737 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c013c80 con 0x7f6efc0037f0 2020-11-20T12:14:28.496 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.477+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f180c5d20 con 0x7f6efc0037f0 2020-11-20T12:14:28.496 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.478+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f18068f50 con 0x7f6efc0037f0 2020-11-20T12:14:28.496 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.479+0000 7f6f14ff9700 1 -- 172.21.15.93:0/2112717737 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6f0c025020 con 0x7f6efc0037f0 2020-11-20T12:14:28.496 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.479+0000 7f6f14ff9700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6ef00806a0 0x7f6ef0082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.497 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.479+0000 7f6f14ff9700 1 -- 172.21.15.93:0/2112717737 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f6f0c0a3510 con 0x7f6efc0037f0 2020-11-20T12:14:28.497 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.479+0000 7f6f17fff700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6ef00806a0 0x7f6ef0082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.497 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.480+0000 7f6f17fff700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6ef00806a0 0x7f6ef0082b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6f1814fbf0 tx=0x7f6f04009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.497 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.483+0000 7f6f14ff9700 1 -- 172.21.15.93:0/2112717737 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6f0c078580 con 0x7f6efc0037f0 2020-11-20T12:14:28.629 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.625+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6f1805c820 con 0x7f6efc0037f0 2020-11-20T12:14:28.629 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.625+0000 7f6f14ff9700 1 -- 172.21.15.93:0/2112717737 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16809 (secure 0 0 0) 0x7f6f0c07bba0 con 0x7f6efc0037f0 2020-11-20T12:14:28.630 INFO:teuthology.misc.health.smithi093.stdout: 2020-11-20T12:14:28.630 INFO:teuthology.misc.health.smithi093.stdout:{"epoch":19,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:26.553091+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:28.631 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6ef00806a0 msgr2=0x7f6ef0082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.631 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6ef00806a0 0x7f6ef0082b60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f6f1814fbf0 tx=0x7f6f04009040).stop 2020-11-20T12:14:28.632 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 msgr2=0x7f6f18161460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.632 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6f18161460 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6f0c001010 tx=0x7f6f0c015000).stop 2020-11-20T12:14:28.632 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 shutdown_connections 2020-11-20T12:14:28.632 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f180bdf20 0x7f6f18161eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.633 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6efc0037f0 0x7f6f18161460 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.633 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6ef00806a0 0x7f6ef0082b60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.633 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 --2- 172.21.15.93:0/2112717737 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f18157250 0x7f6f180bda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.633 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 >> 172.21.15.93:0/2112717737 conn(0x7f6f180c43f0 msgr2=0x7f6f1814ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.633 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 shutdown_connections 2020-11-20T12:14:28.634 INFO:teuthology.misc.health.smithi093.stderr:2020-11-20T12:14:28.627+0000 7f6f1ec97700 1 -- 172.21.15.93:0/2112717737 wait complete. 2020-11-20T12:14:28.641 DEBUG:teuthology.misc:12 of 12 OSDs are up 2020-11-20T12:14:28.642 INFO:tasks.ceph:Creating RBD pool 2020-11-20T12:14:28.642 INFO:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd pool create rbd 8 2020-11-20T12:14:28.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.745+0000 7f90f9d23700 1 Processor -- start 2020-11-20T12:14:28.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.745+0000 7f90f9d23700 1 -- start start 2020-11-20T12:14:28.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f9d23700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f90f40602f0 0x7f90f40606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f9d23700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f4067660 con 0x7f90f4068580 2020-11-20T12:14:28.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f9d23700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90f4067900 con 0x7f90f41506d0 2020-11-20T12:14:28.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f9d23700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90f4067ba0 con 0x7f90f40602f0 2020-11-20T12:14:28.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f3fff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f90f4068580 0x7f90f40c2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39418/0 (socket says 172.21.15.93:39418) 2020-11-20T12:14:28.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f3fff700 1 -- 172.21.15.93:0/3919425506 learned_addr learned my addr 172.21.15.93:0/3919425506 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:28.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f8d21700 1 --2- 172.21.15.93:0/3919425506 >> v2:172.21.15.66:3300/0 conn(0x7f90f40602f0 0x7f90f40606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3725101216 0 0) 0x7f90f4067660 con 0x7f90f4068580 2020-11-20T12:14:28.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.746+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f90d8003280 con 0x7f90f4068580 2020-11-20T12:14:28.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3772058890 0 0) 0x7f90d8003280 con 0x7f90f4068580 2020-11-20T12:14:28.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 >> v2:172.21.15.66:3300/0 conn(0x7f90f40602f0 msgr2=0x7f90f40606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 --2- 172.21.15.93:0/3919425506 >> v2:172.21.15.66:3300/0 conn(0x7f90f40602f0 0x7f90f40606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 >> v1:172.21.15.132:6789/0 conn(0x7f90f41506d0 legacy=0x7f90f4150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f4067e40 con 0x7f90f4068580 2020-11-20T12:14:28.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f90e00016a0 con 0x7f90f4068580 2020-11-20T12:14:28.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 >> v1:172.21.15.93:6789/0 conn(0x7f90f4068580 legacy=0x7f90f40c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8003770 0x7f90d8003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d8004520 0x7f90d80049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90d8004e90 0x7f90d800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f4067ba0 con 0x7f90d8003770 2020-11-20T12:14:28.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d8004260 con 0x7f90d8004e90 2020-11-20T12:14:28.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d800bc60 con 0x7f90d8004520 2020-11-20T12:14:28.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90d8004e90 0x7f90d800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f8d21700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8003770 0x7f90d8003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f3fff700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d8004520 0x7f90d80049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 -- 172.21.15.93:0/3919425506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d8004520 msgr2=0x7f90d80049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d8004520 0x7f90d80049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 -- 172.21.15.93:0/3919425506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8003770 msgr2=0x7f90d8003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:28.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8003770 0x7f90d8003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 -- 172.21.15.93:0/3919425506 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8003280 con 0x7f90d8004e90 2020-11-20T12:14:28.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 -- 172.21.15.93:0/3919425506 reap_dead start 2020-11-20T12:14:28.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f9522700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90d8004e90 0x7f90d800b770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f90ec001fe0 tx=0x7f90ec007f30).ready entity=mon.1 client_cookie=bf6fb64880949c03 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec00cb40 con 0x7f90d8004e90 2020-11-20T12:14:28.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90ec003030 con 0x7f90d8004e90 2020-11-20T12:14:28.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.747+0000 7f90f37fe700 1 -- 172.21.15.93:0/3919425506 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90ec013410 con 0x7f90d8004e90 2020-11-20T12:14:28.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.748+0000 7f90f9d23700 1 -- 172.21.15.93:0/3919425506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90d8004e90 msgr2=0x7f90d800b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.748+0000 7f90f9d23700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90d8004e90 0x7f90d800b770 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f90ec001fe0 tx=0x7f90ec007f30).stop 2020-11-20T12:14:28.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.748+0000 7f90f9d23700 1 -- 172.21.15.93:0/3919425506 shutdown_connections 2020-11-20T12:14:28.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.748+0000 7f90f9d23700 1 --2- 172.21.15.93:0/3919425506 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90d8004e90 0x7f90d800b770 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.748+0000 7f90f9d23700 1 -- 172.21.15.93:0/3919425506 >> 172.21.15.93:0/3919425506 conn(0x7f90f40c7790 msgr2=0x7f90f40c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:28.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.748+0000 7f90f9d23700 1 -- 172.21.15.93:0/3919425506 shutdown_connections 2020-11-20T12:14:28.762 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.748+0000 7f90f9d23700 1 -- 172.21.15.93:0/3919425506 wait complete. 2020-11-20T12:14:28.762 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.749+0000 7f90f9d23700 1 Processor -- start 2020-11-20T12:14:28.762 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.749+0000 7f90f9d23700 1 -- start start 2020-11-20T12:14:28.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f9d23700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8004e90 0x7f90f41426e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f9d23700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90f41613f0 0x7f90f4154eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f9d23700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90f41553a0 0x7f90f40bf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f9d23700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c0af0 con 0x7f90d8004e90 2020-11-20T12:14:28.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f9d23700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c0d90 con 0x7f90f41613f0 2020-11-20T12:14:28.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f9d23700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90f40c1030 con 0x7f90f41553a0 2020-11-20T12:14:28.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90f41613f0 0x7f90f4154eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90f41613f0 0x7f90f4154eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38734/0 (socket says 172.21.15.93:38734) 2020-11-20T12:14:28.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 -- 172.21.15.93:0/29517534 learned_addr learned my addr 172.21.15.93:0/29517534 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:28.767 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f8d21700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8004e90 0x7f90f41426e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.767 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 -- 172.21.15.93:0/29517534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90f41553a0 msgr2=0x7f90f40bf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.767 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90f41553a0 0x7f90f40bf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:28.767 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 -- 172.21.15.93:0/29517534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8004e90 msgr2=0x7f90f41426e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:28.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8004e90 0x7f90f41426e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:28.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 -- 172.21.15.93:0/29517534 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90f40c12d0 con 0x7f90f41613f0 2020-11-20T12:14:28.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f8d21700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8004e90 0x7f90f41426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:28.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f3fff700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90f41613f0 0x7f90f4154eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f90e00068a0 tx=0x7f90f40639f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.750+0000 7f90f0ff9700 1 -- 172.21.15.93:0/29517534 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000f6f0 con 0x7f90f41613f0 2020-11-20T12:14:28.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.751+0000 7f90f0ff9700 1 -- 172.21.15.93:0/29517534 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e000f890 con 0x7f90f41613f0 2020-11-20T12:14:28.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.751+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90f40c1570 con 0x7f90f41613f0 2020-11-20T12:14:28.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.751+0000 7f90f0ff9700 1 -- 172.21.15.93:0/29517534 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e000fc50 con 0x7f90f41613f0 2020-11-20T12:14:28.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.751+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90f4142bd0 con 0x7f90f41613f0 2020-11-20T12:14:28.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.752+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90f4061760 con 0x7f90f41613f0 2020-11-20T12:14:28.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.752+0000 7f90f0ff9700 1 -- 172.21.15.93:0/29517534 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f90e001a030 con 0x7f90f41613f0 2020-11-20T12:14:28.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.752+0000 7f90f0ff9700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f90cc080670 0x7f90cc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:28.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.753+0000 7f90f0ff9700 1 -- 172.21.15.93:0/29517534 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 6740+0+0 (secure 0 0 0) 0x7f90e00a1e10 con 0x7f90f41613f0 2020-11-20T12:14:28.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.753+0000 7f90f8d21700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f90cc080670 0x7f90cc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:28.771 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.753+0000 7f90f8d21700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f90cc080670 0x7f90cc082b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f90e8006d40 tx=0x7f90e8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:28.771 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.756+0000 7f90f0ff9700 1 -- 172.21.15.93:0/29517534 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f90e0044fd0 con 0x7f90f41613f0 2020-11-20T12:14:28.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:28.895+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f90f4152840 con 0x7f90f41613f0 2020-11-20T12:14:29.571 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.567+0000 7f90f0ff9700 1 -- 172.21.15.93:0/29517534 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v20) v1 ==== 109+0+0 (secure 0 0 0) 0x7f90e0076ea0 con 0x7f90f41613f0 2020-11-20T12:14:29.573 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.568+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f90cc080670 msgr2=0x7f90cc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.568+0000 7f90f9d23700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f90cc080670 0x7f90cc082b30 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f90e8006d40 tx=0x7f90e8008040).stop 2020-11-20T12:14:29.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90f41613f0 msgr2=0x7f90f4154eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90f41613f0 0x7f90f4154eb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f90e00068a0 tx=0x7f90f40639f0).stop 2020-11-20T12:14:29.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 shutdown_connections 2020-11-20T12:14:29.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90f41553a0 0x7f90f40bf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:29.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f90cc080670 0x7f90cc082b30 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f90d8004e90 0x7f90f41426e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 --2- 172.21.15.93:0/29517534 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f90f41613f0 0x7f90f4154eb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 >> 172.21.15.93:0/29517534 conn(0x7f90f40c7790 msgr2=0x7f90f414fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:29.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 shutdown_connections 2020-11-20T12:14:29.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.569+0000 7f90f9d23700 1 -- 172.21.15.93:0/29517534 wait complete. 2020-11-20T12:14:29.577 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'rbd' created 2020-11-20T12:14:29.586 INFO:teuthology.orchestra.run.smithi093:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-11-20T12:14:29.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.700+0000 7f7ef2540700 1 Processor -- start 2020-11-20T12:14:29.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.700+0000 7f7ef2540700 1 -- start start 2020-11-20T12:14:29.708 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7ef2540700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7eec068420 0x7f7eec0c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.709 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7ef2540700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec151d40 con 0x7f7eec0c4160 2020-11-20T12:14:29.709 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7ef2540700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eec151fe0 con 0x7f7eec0be990 2020-11-20T12:14:29.709 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7ef2540700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eec0677a0 con 0x7f7eec068420 2020-11-20T12:14:29.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7eeb7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7eec068420 0x7f7eec0c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7eebfff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f7eec0c4160 0x7f7eec064460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:38972/0 (socket says 172.21.15.93:38972) 2020-11-20T12:14:29.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7eeb7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7eec068420 0x7f7eec0c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.93:52920/0 (socket says 172.21.15.93:52920) 2020-11-20T12:14:29.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.701+0000 7f7eebfff700 1 -- 172.21.15.93:0/3758978206 learned_addr learned my addr 172.21.15.93:0/3758978206 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:29.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeaffd700 1 -- 172.21.15.93:0/3758978206 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222616871 0 0) 0x7f7eec151fe0 con 0x7f7eec0be990 2020-11-20T12:14:29.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeaffd700 1 -- 172.21.15.93:0/3758978206 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed8003280 con 0x7f7eec0be990 2020-11-20T12:14:29.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeb7fe700 1 -- 172.21.15.93:0/3758978206 >> v1:172.21.15.132:6789/0 conn(0x7f7eec0be990 legacy=0x7f7eec151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeb7fe700 1 -- 172.21.15.93:0/3758978206 >> v1:172.21.15.66:6789/0 conn(0x7f7eec0c4160 legacy=0x7f7eec064460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeaffd700 1 -- 172.21.15.93:0/3758978206 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245051502 0 0) 0x7f7eec151d40 con 0x7f7eec0c4160 2020-11-20T12:14:29.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeb7fe700 1 -- 172.21.15.93:0/3758978206 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec067a40 con 0x7f7eec068420 2020-11-20T12:14:29.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeb7fe700 1 --2- 172.21.15.93:0/3758978206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec068420 0x7f7eec0c4540 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7ee0006fd0 tx=0x7f7ee0006e30).ready entity=mon.0 client_cookie=262762a62ede206b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeaffd700 1 -- 172.21.15.93:0/3758978206 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee000bec0 con 0x7f7eec068420 2020-11-20T12:14:29.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeaffd700 1 -- 172.21.15.93:0/3758978206 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee0000e90 con 0x7f7eec068420 2020-11-20T12:14:29.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7eeaffd700 1 -- 172.21.15.93:0/3758978206 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee0009a80 con 0x7f7eec068420 2020-11-20T12:14:29.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7ef2540700 1 -- 172.21.15.93:0/3758978206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec068420 msgr2=0x7f7eec0c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.702+0000 7f7ef2540700 1 --2- 172.21.15.93:0/3758978206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec068420 0x7f7eec0c4540 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f7ee0006fd0 tx=0x7f7ee0006e30).stop 2020-11-20T12:14:29.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.703+0000 7f7ef2540700 1 -- 172.21.15.93:0/3758978206 shutdown_connections 2020-11-20T12:14:29.716 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.703+0000 7f7ef2540700 1 --2- 172.21.15.93:0/3758978206 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec068420 0x7f7eec0c4540 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.716 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.703+0000 7f7ef2540700 1 -- 172.21.15.93:0/3758978206 >> 172.21.15.93:0/3758978206 conn(0x7f7eec060130 msgr2=0x7f7eec060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:29.716 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.703+0000 7f7ef2540700 1 -- 172.21.15.93:0/3758978206 shutdown_connections 2020-11-20T12:14:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.703+0000 7f7ef2540700 1 -- 172.21.15.93:0/3758978206 wait complete. 2020-11-20T12:14:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.704+0000 7f7ef2540700 1 Processor -- start 2020-11-20T12:14:29.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.704+0000 7f7ef2540700 1 -- start start 2020-11-20T12:14:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec068420 0x7f7eec150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.721 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec0be990 0x7f7eec164250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7eec0c4160 0x7f7eec157140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec1567d0 con 0x7f7eec0be990 2020-11-20T12:14:29.722 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec164740 con 0x7f7eec0c4160 2020-11-20T12:14:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eec14f400 con 0x7f7eec068420 2020-11-20T12:14:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7eec0c4160 0x7f7eec157140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.723 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7eec0c4160 0x7f7eec157140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38750/0 (socket says 172.21.15.93:38750) 2020-11-20T12:14:29.724 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 -- 172.21.15.93:0/289176184 learned_addr learned my addr 172.21.15.93:0/289176184 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:29.724 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7eebfff700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec068420 0x7f7eec150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.724 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7eeb7fe700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec0be990 0x7f7eec164250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.725 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 -- 172.21.15.93:0/289176184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec068420 msgr2=0x7f7eec150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.725 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec068420 0x7f7eec150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.725 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 -- 172.21.15.93:0/289176184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec0be990 msgr2=0x7f7eec164250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:29.726 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec0be990 0x7f7eec164250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:29.726 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 -- 172.21.15.93:0/289176184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec14f660 con 0x7f7eec0c4160 2020-11-20T12:14:29.726 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef0add700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7eec0c4160 0x7f7eec157140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7ee400ca60 tx=0x7f7ee4007e10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.726 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ecbfff700 1 -- 172.21.15.93:0/289176184 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4002240 con 0x7f7eec0c4160 2020-11-20T12:14:29.727 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ecbfff700 1 -- 172.21.15.93:0/289176184 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40023a0 con 0x7f7eec0c4160 2020-11-20T12:14:29.727 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eec14f900 con 0x7f7eec0c4160 2020-11-20T12:14:29.728 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ecbfff700 1 -- 172.21.15.93:0/289176184 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4001650 con 0x7f7eec0c4160 2020-11-20T12:14:29.728 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.705+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eec156a00 con 0x7f7eec0c4160 2020-11-20T12:14:29.728 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.707+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eec060e80 con 0x7f7eec0c4160 2020-11-20T12:14:29.729 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.707+0000 7f7ecbfff700 1 -- 172.21.15.93:0/289176184 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7ee4019030 con 0x7f7eec0c4160 2020-11-20T12:14:29.729 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.707+0000 7f7ecbfff700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7ec4080670 0x7f7ec4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:29.729 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.708+0000 7f7ecbfff700 1 -- 172.21.15.93:0/289176184 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 7082+0+0 (secure 0 0 0) 0x7f7ee40a1b60 con 0x7f7eec0c4160 2020-11-20T12:14:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.708+0000 7f7eebfff700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7ec4080670 0x7f7ec4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.708+0000 7f7eebfff700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7ec4080670 0x7f7ec4082b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7edc0067c0 tx=0x7f7edc007c60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:29.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.711+0000 7f7ecbfff700 1 -- 172.21.15.93:0/289176184 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7ee4076aa0 con 0x7f7eec0c4160 2020-11-20T12:14:29.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:29.853+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7eec05cad0 con 0x7f7eec0c4160 2020-11-20T12:14:30.572 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.567+0000 7f7ecbfff700 1 -- 172.21.15.93:0/289176184 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v21) v1 ==== 173+0+0 (secure 0 0 0) 0x7f7ee407a0c0 con 0x7f7eec0c4160 2020-11-20T12:14:32.560 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7ec4080670 msgr2=0x7f7ec4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.560 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7ec4080670 0x7f7ec4082b30 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f7edc0067c0 tx=0x7f7edc007c60).stop 2020-11-20T12:14:32.560 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7eec0c4160 msgr2=0x7f7eec157140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.560 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7eec0c4160 0x7f7eec157140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7ee400ca60 tx=0x7f7ee4007e10).stop 2020-11-20T12:14:32.561 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 shutdown_connections 2020-11-20T12:14:32.561 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7eec0c4160 0x7f7eec157140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.561 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eec068420 0x7f7eec150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.561 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7ec4080670 0x7f7ec4082b30 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.561 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 --2- 172.21.15.93:0/289176184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7eec0be990 0x7f7eec164250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.562 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.569+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 >> 172.21.15.93:0/289176184 conn(0x7f7eec060130 msgr2=0x7f7eec0c12d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.562 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.570+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 shutdown_connections 2020-11-20T12:14:32.562 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:30.570+0000 7f7ef2540700 1 -- 172.21.15.93:0/289176184 wait complete. 2020-11-20T12:14:32.562 INFO:teuthology.orchestra.run.smithi093.stderr:enabled application 'rbd' on pool 'rbd' 2020-11-20T12:14:32.563 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-11-20T12:14:32.563 INFO:tasks.ceph.mds.a:Restarting daemon 2020-11-20T12:14:32.563 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-11-20T12:14:32.566 INFO:tasks.ceph.mds.a:Started 2020-11-20T12:14:32.566 INFO:tasks.ceph.mds.b:Restarting daemon 2020-11-20T12:14:32.567 INFO:teuthology.orchestra.run.smithi066:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-11-20T12:14:32.570 INFO:tasks.ceph.mds.b:Started 2020-11-20T12:14:32.570 INFO:tasks.ceph.mds.c:Restarting daemon 2020-11-20T12:14:32.570 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2020-11-20T12:14:32.573 INFO:tasks.ceph.mds.c:Started 2020-11-20T12:14:32.573 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-11-20T12:14:32.574 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:32.645 INFO:tasks.ceph.mds.a.smithi093.stdout:starting mds.a at 2020-11-20T12:14:32.650 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2020-11-20T12:14:32.653 INFO:tasks.ceph.mds.b.smithi066.stdout:starting mds.b at 2020-11-20T12:14:32.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.693+0000 7ff864899700 1 Processor -- start 2020-11-20T12:14:32.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.693+0000 7ff864899700 1 -- start start 2020-11-20T12:14:32.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.694+0000 7ff864899700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff8600bed70 0x7ff8600c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.694+0000 7ff864899700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7ff860155570 0x7ff860150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.694+0000 7ff864899700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff860151c40 con 0x7ff8600c2490 2020-11-20T12:14:32.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.694+0000 7ff864899700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860151ee0 con 0x7ff860155570 2020-11-20T12:14:32.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.694+0000 7ff864899700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff860152180 con 0x7ff8600bed70 2020-11-20T12:14:32.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.694+0000 7ff85e59c700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff8600c2490 0x7ff8600c47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39466/0 (socket says 172.21.15.93:39466) 2020-11-20T12:14:32.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.694+0000 7ff85e59c700 1 -- 172.21.15.93:0/1396690136 learned_addr learned my addr 172.21.15.93:0/1396690136 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:32.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85dd9b700 1 --2- 172.21.15.93:0/1396690136 >> v2:172.21.15.132:3300/0 conn(0x7ff8600bed70 0x7ff8600c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85ed9d700 1 --2- 172.21.15.93:0/1396690136 >> v2:172.21.15.66:3300/0 conn(0x7ff860155570 0x7ff860150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85d59a700 1 -- 172.21.15.93:0/1396690136 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3079490940 0 0) 0x7ff860151c40 con 0x7ff8600c2490 2020-11-20T12:14:32.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85d59a700 1 -- 172.21.15.93:0/1396690136 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff844003280 con 0x7ff8600c2490 2020-11-20T12:14:32.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85d59a700 1 -- 172.21.15.93:0/1396690136 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1789303014 0 0) 0x7ff844003280 con 0x7ff8600c2490 2020-11-20T12:14:32.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85dd9b700 1 -- 172.21.15.93:0/1396690136 >> v2:172.21.15.66:3300/0 conn(0x7ff860155570 msgr2=0x7ff860150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:32.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85dd9b700 1 --2- 172.21.15.93:0/1396690136 >> v2:172.21.15.66:3300/0 conn(0x7ff860155570 0x7ff860150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85dd9b700 1 -- 172.21.15.93:0/1396690136 >> v1:172.21.15.93:6789/0 conn(0x7ff8600c2490 legacy=0x7ff8600c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85dd9b700 1 -- 172.21.15.93:0/1396690136 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860152420 con 0x7ff8600bed70 2020-11-20T12:14:32.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85ed9d700 1 --2- 172.21.15.93:0/1396690136 >> v2:172.21.15.66:3300/0 conn(0x7ff860155570 0x7ff860150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:32.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85dd9b700 1 --2- 172.21.15.93:0/1396690136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600bed70 0x7ff8600c2870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8600be930 tx=0x7ff850006e30).ready entity=mon.2 client_cookie=addcfbc056b706ad server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85d59a700 1 -- 172.21.15.93:0/1396690136 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854001520 con 0x7ff8600bed70 2020-11-20T12:14:32.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85d59a700 1 -- 172.21.15.93:0/1396690136 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff850000e90 con 0x7ff8600bed70 2020-11-20T12:14:32.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.695+0000 7ff85d59a700 1 -- 172.21.15.93:0/1396690136 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff850011610 con 0x7ff8600bed70 2020-11-20T12:14:32.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 -- 172.21.15.93:0/1396690136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600bed70 msgr2=0x7ff8600c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 --2- 172.21.15.93:0/1396690136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600bed70 0x7ff8600c2870 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff8600be930 tx=0x7ff850006e30).stop 2020-11-20T12:14:32.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 -- 172.21.15.93:0/1396690136 shutdown_connections 2020-11-20T12:14:32.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 --2- 172.21.15.93:0/1396690136 >> v2:172.21.15.66:3300/0 conn(0x7ff860155570 0x7ff860150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 --2- 172.21.15.93:0/1396690136 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600bed70 0x7ff8600c2870 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.706 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 -- 172.21.15.93:0/1396690136 >> 172.21.15.93:0/1396690136 conn(0x7ff860060130 msgr2=0x7ff860060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.706 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 -- 172.21.15.93:0/1396690136 shutdown_connections 2020-11-20T12:14:32.706 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.696+0000 7ff864899700 1 -- 172.21.15.93:0/1396690136 wait complete. 2020-11-20T12:14:32.708 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.697+0000 7ff864899700 1 Processor -- start 2020-11-20T12:14:32.709 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.697+0000 7ff864899700 1 -- start start 2020-11-20T12:14:32.709 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8600bed70 0x7ff8600c6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.709 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600c2490 0x7ff8601536b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.709 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff860155570 0x7ff860157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8600c5830 con 0x7ff860155570 2020-11-20T12:14:32.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860152c20 con 0x7ff8600bed70 2020-11-20T12:14:32.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff860164970 con 0x7ff8600c2490 2020-11-20T12:14:32.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8600bed70 0x7ff8600c6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8600bed70 0x7ff8600c6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38774/0 (socket says 172.21.15.93:38774) 2020-11-20T12:14:32.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 -- 172.21.15.93:0/455293261 learned_addr learned my addr 172.21.15.93:0/455293261 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:32.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85dd9b700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600c2490 0x7ff8601536b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85ed9d700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff860155570 0x7ff860157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 -- 172.21.15.93:0/455293261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600c2490 msgr2=0x7ff8601536b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600c2490 0x7ff8601536b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 -- 172.21.15.93:0/455293261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff860155570 msgr2=0x7ff860157f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff860155570 0x7ff860157f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 -- 172.21.15.93:0/455293261 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860164c10 con 0x7ff8600bed70 2020-11-20T12:14:32.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff85e59c700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8600bed70 0x7ff8600c6440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff85400cb10 tx=0x7ff8540012f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff84e7fc700 1 -- 172.21.15.93:0/455293261 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff854007170 con 0x7ff8600bed70 2020-11-20T12:14:32.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff84e7fc700 1 -- 172.21.15.93:0/455293261 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8540072d0 con 0x7ff8600bed70 2020-11-20T12:14:32.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8600c5a60 con 0x7ff8600bed70 2020-11-20T12:14:32.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff84e7fc700 1 -- 172.21.15.93:0/455293261 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff85400aa70 con 0x7ff8600bed70 2020-11-20T12:14:32.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.698+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8600c5fa0 con 0x7ff8600bed70 2020-11-20T12:14:32.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.699+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff86005cd50 con 0x7ff8600bed70 2020-11-20T12:14:32.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.700+0000 7ff84e7fc700 1 -- 172.21.15.93:0/455293261 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff854010070 con 0x7ff8600bed70 2020-11-20T12:14:32.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.700+0000 7ff84e7fc700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff834080670 0x7ff834082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.701+0000 7ff85dd9b700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff834080670 0x7ff834082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.714 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.701+0000 7ff84e7fc700 1 -- 172.21.15.93:0/455293261 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7ff8540a2450 con 0x7ff8600bed70 2020-11-20T12:14:32.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.701+0000 7ff85dd9b700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff834080670 0x7ff834082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff8600be930 tx=0x7ff850015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.704+0000 7ff84e7fc700 1 -- 172.21.15.93:0/455293261 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff854077270 con 0x7ff8600bed70 2020-11-20T12:14:32.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.843+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8600c1710 con 0x7ff8600bed70 2020-11-20T12:14:32.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.844+0000 7ff84e7fc700 1 -- 172.21.15.93:0/455293261 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+18329 (secure 0 0 0) 0x7ff85407a890 con 0x7ff8600bed70 2020-11-20T12:14:32.848 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:32.849 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":22,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:31.571254+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:32.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff834080670 msgr2=0x7ff834082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff834080670 0x7ff834082b30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7ff8600be930 tx=0x7ff850015000).stop 2020-11-20T12:14:32.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8600bed70 msgr2=0x7ff8600c6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8600bed70 0x7ff8600c6440 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7ff85400cb10 tx=0x7ff8540012f0).stop 2020-11-20T12:14:32.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 shutdown_connections 2020-11-20T12:14:32.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff834080670 0x7ff834082b30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff860155570 0x7ff860157f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff8600bed70 0x7ff8600c6440 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 --2- 172.21.15.93:0/455293261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8600c2490 0x7ff8601536b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.845+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 >> 172.21.15.93:0/455293261 conn(0x7ff860060130 msgr2=0x7ff860154be0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.846+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 shutdown_connections 2020-11-20T12:14:32.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.846+0000 7ff864899700 1 -- 172.21.15.93:0/455293261 wait complete. 2020-11-20T12:14:32.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:14:19.052710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:28.933013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2020-11-20T12:14:32.861 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:32.972 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.967+0000 7fad73809700 1 Processor -- start 2020-11-20T12:14:32.972 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.968+0000 7fad73809700 1 -- start start 2020-11-20T12:14:32.975 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.968+0000 7fad73809700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad6c0679a0 0x7fad6c067d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.975 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.968+0000 7fad73809700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c0bc700 con 0x7fad6c0bc270 2020-11-20T12:14:32.976 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.968+0000 7fad73809700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad6c0bccb0 con 0x7fad6c0bbe10 2020-11-20T12:14:32.976 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.968+0000 7fad73809700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0bcf50 con 0x7fad6c0679a0 2020-11-20T12:14:32.976 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad715a5700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad6c0679a0 0x7fad6c067d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.977 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad71da6700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fad6c0bc270 0x7fad6c14d4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39016/0 (socket says 172.21.15.93:39016) 2020-11-20T12:14:32.977 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad70da4700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fad6c0bbe10 0x7fad6c063a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.93:36566/0 (socket says 172.21.15.93:36566) 2020-11-20T12:14:32.977 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad71da6700 1 -- 172.21.15.93:0/3218961854 learned_addr learned my addr 172.21.15.93:0/3218961854 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:32.978 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad5bfff700 1 -- 172.21.15.93:0/3218961854 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704296873 0 0) 0x7fad6c0bc700 con 0x7fad6c0bc270 2020-11-20T12:14:32.978 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad5bfff700 1 -- 172.21.15.93:0/3218961854 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad54003280 con 0x7fad6c0bc270 2020-11-20T12:14:32.978 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad5bfff700 1 -- 172.21.15.93:0/3218961854 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3067812947 0 0) 0x7fad6c0bccb0 con 0x7fad6c0bbe10 2020-11-20T12:14:32.978 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad5bfff700 1 -- 172.21.15.93:0/3218961854 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad6c0bc700 con 0x7fad6c0bbe10 2020-11-20T12:14:32.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad715a5700 1 -- 172.21.15.93:0/3218961854 >> v1:172.21.15.132:6789/0 conn(0x7fad6c0bbe10 legacy=0x7fad6c063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad715a5700 1 -- 172.21.15.93:0/3218961854 >> v1:172.21.15.66:6789/0 conn(0x7fad6c0bc270 legacy=0x7fad6c14d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad715a5700 1 -- 172.21.15.93:0/3218961854 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0bd1f0 con 0x7fad6c0679a0 2020-11-20T12:14:32.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad715a5700 1 --2- 172.21.15.93:0/3218961854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 0x7fad6c067d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fad68006fd0 tx=0x7fad68006e30).ready entity=mon.2 client_cookie=be05d9d26c2a7e74 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad5bfff700 1 -- 172.21.15.93:0/3218961854 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad68009630 con 0x7fad6c0679a0 2020-11-20T12:14:32.980 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.969+0000 7fad5bfff700 1 -- 172.21.15.93:0/3218961854 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad68000e90 con 0x7fad6c0679a0 2020-11-20T12:14:32.980 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad5bfff700 1 -- 172.21.15.93:0/3218961854 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad680099a0 con 0x7fad6c0679a0 2020-11-20T12:14:32.980 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad73809700 1 -- 172.21.15.93:0/3218961854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 msgr2=0x7fad6c067d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.980 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad73809700 1 --2- 172.21.15.93:0/3218961854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 0x7fad6c067d80 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fad68006fd0 tx=0x7fad68006e30).stop 2020-11-20T12:14:32.981 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad73809700 1 -- 172.21.15.93:0/3218961854 shutdown_connections 2020-11-20T12:14:32.981 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad73809700 1 --2- 172.21.15.93:0/3218961854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 0x7fad6c067d80 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.981 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad73809700 1 -- 172.21.15.93:0/3218961854 >> 172.21.15.93:0/3218961854 conn(0x7fad6c060130 msgr2=0x7fad6c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:32.981 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad73809700 1 -- 172.21.15.93:0/3218961854 shutdown_connections 2020-11-20T12:14:32.982 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.970+0000 7fad73809700 1 -- 172.21.15.93:0/3218961854 wait complete. 2020-11-20T12:14:32.982 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.971+0000 7fad73809700 1 Processor -- start 2020-11-20T12:14:32.982 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.971+0000 7fad73809700 1 -- start start 2020-11-20T12:14:32.985 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad73809700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 0x7fad6c14f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.986 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad73809700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c0bbe10 0x7fad6c1622f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.986 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad73809700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad6c0649b0 0x7fad6c1506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.986 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad73809700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0aea60 con 0x7fad6c0649b0 2020-11-20T12:14:32.987 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad73809700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c14fae0 con 0x7fad6c0bbe10 2020-11-20T12:14:32.987 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad73809700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c1627e0 con 0x7fad6c0679a0 2020-11-20T12:14:32.987 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c0bbe10 0x7fad6c1622f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.987 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c0bbe10 0x7fad6c1622f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38790/0 (socket says 172.21.15.93:38790) 2020-11-20T12:14:32.988 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 -- 172.21.15.93:0/3775120871 learned_addr learned my addr 172.21.15.93:0/3775120871 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:32.988 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad71da6700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad6c0649b0 0x7fad6c1506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.988 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad715a5700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 0x7fad6c14f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.988 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 -- 172.21.15.93:0/3775120871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 msgr2=0x7fad6c14f5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.988 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 0x7fad6c14f5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 -- 172.21.15.93:0/3775120871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad6c0649b0 msgr2=0x7fad6c1506b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:32.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad6c0649b0 0x7fad6c1506b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:32.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.972+0000 7fad70da4700 1 -- 172.21.15.93:0/3775120871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0ae520 con 0x7fad6c0bbe10 2020-11-20T12:14:32.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.973+0000 7fad70da4700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c0bbe10 0x7fad6c1622f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fad5c00c740 tx=0x7fad5c007aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.973+0000 7fad597fa700 1 -- 172.21.15.93:0/3775120871 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c0072e0 con 0x7fad6c0bbe10 2020-11-20T12:14:32.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.973+0000 7fad597fa700 1 -- 172.21.15.93:0/3775120871 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5c005570 con 0x7fad6c0bbe10 2020-11-20T12:14:32.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.973+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c0ae7c0 con 0x7fad6c0bbe10 2020-11-20T12:14:32.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.973+0000 7fad597fa700 1 -- 172.21.15.93:0/3775120871 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5c005910 con 0x7fad6c0bbe10 2020-11-20T12:14:32.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.973+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c14eeb0 con 0x7fad6c0bbe10 2020-11-20T12:14:32.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.974+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c05cad0 con 0x7fad6c0bbe10 2020-11-20T12:14:32.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.974+0000 7fad597fa700 1 -- 172.21.15.93:0/3775120871 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fad5c010070 con 0x7fad6c0bbe10 2020-11-20T12:14:32.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.975+0000 7fad597fa700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fad44080670 0x7fad44082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:32.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.975+0000 7fad597fa700 1 -- 172.21.15.93:0/3775120871 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7fad5c0a1b40 con 0x7fad6c0bbe10 2020-11-20T12:14:32.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.975+0000 7fad715a5700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fad44080670 0x7fad44082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:32.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.975+0000 7fad715a5700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fad44080670 0x7fad44082b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fad68006e70 tx=0x7fad68015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:32.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:32.978+0000 7fad597fa700 1 -- 172.21.15.93:0/3775120871 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fad5c076a70 con 0x7fad6c0bbe10 2020-11-20T12:14:33.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.118+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fad6c14f270 con 0x7fad6c0bbe10 2020-11-20T12:14:33.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.119+0000 7fad597fa700 1 -- 172.21.15.93:0/3775120871 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v22) v1 ==== 110+0+10 (secure 0 0 0) 0x7fad5c018020 con 0x7fad6c0bbe10 2020-11-20T12:14:33.123 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2020-11-20T12:14:33.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fad44080670 msgr2=0x7fad44082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fad44080670 0x7fad44082b30 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fad68006e70 tx=0x7fad68015000).stop 2020-11-20T12:14:33.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c0bbe10 msgr2=0x7fad6c1622f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c0bbe10 0x7fad6c1622f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fad5c00c740 tx=0x7fad5c007aa0).stop 2020-11-20T12:14:33.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 shutdown_connections 2020-11-20T12:14:33.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fad44080670 0x7fad44082b30 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fad6c0649b0 0x7fad6c1506b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad6c0679a0 0x7fad6c14f5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 --2- 172.21.15.93:0/3775120871 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fad6c0bbe10 0x7fad6c1622f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 >> 172.21.15.93:0/3775120871 conn(0x7fad6c060130 msgr2=0x7fad6c149190 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.127 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 shutdown_connections 2020-11-20T12:14:33.127 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.120+0000 7fad73809700 1 -- 172.21.15.93:0/3775120871 wait complete. 2020-11-20T12:14:33.135 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:33.245 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.241+0000 7f9eb2730700 1 Processor -- start 2020-11-20T12:14:33.246 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.241+0000 7f9eb2730700 1 -- start start 2020-11-20T12:14:33.248 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb2730700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9eac14ec00 0x7f9eac0beed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.248 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb2730700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9eac1524d0 0x7f9eac0bf3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.248 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb2730700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9eac151990 con 0x7f9eac14efe0 2020-11-20T12:14:33.249 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb2730700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0bf8b0 con 0x7f9eac14ec00 2020-11-20T12:14:33.249 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb2730700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9eac0c2620 con 0x7f9eac1524d0 2020-11-20T12:14:33.249 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb0ccd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9eac1524d0 0x7f9eac0bf3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.249 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb0ccd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f9eac1524d0 0x7f9eac0bf3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38796/0 (socket says 172.21.15.93:38796) 2020-11-20T12:14:33.250 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eb0ccd700 1 -- 172.21.15.93:0/3122209168 learned_addr learned my addr 172.21.15.93:0/3122209168 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:33.250 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.242+0000 7f9eabfff700 1 --2- 172.21.15.93:0/3122209168 >> v2:172.21.15.66:3300/0 conn(0x7f9eac14ec00 0x7f9eac0beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.250 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb0ccd700 1 -- 172.21.15.93:0/3122209168 >> v2:172.21.15.66:3300/0 conn(0x7f9eac14ec00 msgr2=0x7f9eac0beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:33.250 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb0ccd700 1 --2- 172.21.15.93:0/3122209168 >> v2:172.21.15.66:3300/0 conn(0x7f9eac14ec00 0x7f9eac0beed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.250 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb0ccd700 1 -- 172.21.15.93:0/3122209168 >> v1:172.21.15.66:6789/0 conn(0x7f9eac14efe0 legacy=0x7f9eac151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb0ccd700 1 -- 172.21.15.93:0/3122209168 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0c28c0 con 0x7f9eac1524d0 2020-11-20T12:14:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb0ccd700 1 --2- 172.21.15.93:0/3122209168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac1524d0 0x7f9eac0bf3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9eac0be9e0 tx=0x7f9ea40092d0).ready entity=mon.1 client_cookie=6a4c47c3c2c77e4a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eaaffd700 1 -- 172.21.15.93:0/3122209168 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea400bc80 con 0x7f9eac1524d0 2020-11-20T12:14:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eaaffd700 1 -- 172.21.15.93:0/3122209168 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea400bde0 con 0x7f9eac1524d0 2020-11-20T12:14:33.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eaaffd700 1 -- 172.21.15.93:0/3122209168 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea4011610 con 0x7f9eac1524d0 2020-11-20T12:14:33.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb2730700 1 -- 172.21.15.93:0/3122209168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac1524d0 msgr2=0x7f9eac0bf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb2730700 1 --2- 172.21.15.93:0/3122209168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac1524d0 0x7f9eac0bf3c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9eac0be9e0 tx=0x7f9ea40092d0).stop 2020-11-20T12:14:33.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb2730700 1 -- 172.21.15.93:0/3122209168 shutdown_connections 2020-11-20T12:14:33.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb2730700 1 --2- 172.21.15.93:0/3122209168 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac1524d0 0x7f9eac0bf3c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb2730700 1 --2- 172.21.15.93:0/3122209168 >> v2:172.21.15.66:3300/0 conn(0x7f9eac14ec00 0x7f9eac0beed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.253 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.243+0000 7f9eb2730700 1 -- 172.21.15.93:0/3122209168 >> 172.21.15.93:0/3122209168 conn(0x7f9eac060130 msgr2=0x7f9eac060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.253 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.244+0000 7f9eb2730700 1 -- 172.21.15.93:0/3122209168 shutdown_connections 2020-11-20T12:14:33.253 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.244+0000 7f9eb2730700 1 -- 172.21.15.93:0/3122209168 wait complete. 2020-11-20T12:14:33.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.245+0000 7f9eb2730700 1 Processor -- start 2020-11-20T12:14:33.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.245+0000 7f9eb2730700 1 -- start start 2020-11-20T12:14:33.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac14ec00 0x7f9eac0c1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac14efe0 0x7f9eac1617e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9eac1524d0 0x7f9eac157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.257 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c2090 con 0x7f9eac14ec00 2020-11-20T12:14:33.257 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c0e30 con 0x7f9eac14efe0 2020-11-20T12:14:33.257 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9eac0c10d0 con 0x7f9eac1524d0 2020-11-20T12:14:33.257 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac14efe0 0x7f9eac1617e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.257 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac14efe0 0x7f9eac1617e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38804/0 (socket says 172.21.15.93:38804) 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 -- 172.21.15.93:0/143449285 learned_addr learned my addr 172.21.15.93:0/143449285 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eabfff700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac14ec00 0x7f9eac0c1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb0ccd700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9eac1524d0 0x7f9eac157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 -- 172.21.15.93:0/143449285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9eac1524d0 msgr2=0x7f9eac157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.258 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9eac1524d0 0x7f9eac157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.259 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 -- 172.21.15.93:0/143449285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac14ec00 msgr2=0x7f9eac0c1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.259 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac14ec00 0x7f9eac0c1860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.259 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 -- 172.21.15.93:0/143449285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac0c1370 con 0x7f9eac14efe0 2020-11-20T12:14:33.259 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eab7fe700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac14efe0 0x7f9eac1617e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f9ea000c740 tx=0x7f9ea0007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.259 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9e8bfff700 1 -- 172.21.15.93:0/143449285 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0007020 con 0x7f9eac14efe0 2020-11-20T12:14:33.260 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9e8bfff700 1 -- 172.21.15.93:0/143449285 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ea0001e90 con 0x7f9eac14efe0 2020-11-20T12:14:33.260 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9eac156910 con 0x7f9eac14efe0 2020-11-20T12:14:33.260 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9e8bfff700 1 -- 172.21.15.93:0/143449285 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ea00073b0 con 0x7f9eac14efe0 2020-11-20T12:14:33.260 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.246+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9eac0c0b20 con 0x7f9eac14efe0 2020-11-20T12:14:33.260 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.247+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9eac061a40 con 0x7f9eac14efe0 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.248+0000 7f9e8bfff700 1 -- 172.21.15.93:0/143449285 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9ea0010030 con 0x7f9eac14efe0 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.248+0000 7f9e8bfff700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9e840806a0 0x7f9e84082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.248+0000 7f9eabfff700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9e840806a0 0x7f9e84082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.248+0000 7f9e8bfff700 1 -- 172.21.15.93:0/143449285 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f9ea00a21d0 con 0x7f9eac14efe0 2020-11-20T12:14:33.261 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.249+0000 7f9eabfff700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9e840806a0 0x7f9e84082b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9e9c006fd0 tx=0x7f9e9c006e30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.262 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.252+0000 7f9e8bfff700 1 -- 172.21.15.93:0/143449285 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f9ea0076ff0 con 0x7f9eac14efe0 2020-11-20T12:14:33.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.391+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f9eac156d70 con 0x7f9eac14efe0 2020-11-20T12:14:33.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.391+0000 7f9e8bfff700 1 -- 172.21.15.93:0/143449285 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f9ea007a610 con 0x7f9eac14efe0 2020-11-20T12:14:33.395 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:33.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.392+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9e840806a0 msgr2=0x7f9e84082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.392+0000 7f9eb2730700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9e840806a0 0x7f9e84082b60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f9e9c006fd0 tx=0x7f9e9c006e30).stop 2020-11-20T12:14:33.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.392+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac14efe0 msgr2=0x7f9eac1617e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.392+0000 7f9eb2730700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac14efe0 0x7f9eac1617e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f9ea000c740 tx=0x7f9ea0007c90).stop 2020-11-20T12:14:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 shutdown_connections 2020-11-20T12:14:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9eac1524d0 0x7f9eac157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9e840806a0 0x7f9e84082b60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9eac14ec00 0x7f9eac0c1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 --2- 172.21.15.93:0/143449285 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9eac14efe0 0x7f9eac1617e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 >> 172.21.15.93:0/143449285 conn(0x7f9eac060130 msgr2=0x7f9eac151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 shutdown_connections 2020-11-20T12:14:33.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.393+0000 7f9eb2730700 1 -- 172.21.15.93:0/143449285 wait complete. 2020-11-20T12:14:33.408 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2020-11-20T12:14:33.516 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94f0ed2700 1 Processor -- start 2020-11-20T12:14:33.516 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94f0ed2700 1 -- start start 2020-11-20T12:14:33.519 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94f0ed2700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94ec154a50 0x7f94ec0640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.519 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94f0ed2700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec0c8140 con 0x7f94ec0c8310 2020-11-20T12:14:33.520 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94f0ed2700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94ec064780 con 0x7f94ec14e580 2020-11-20T12:14:33.520 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94f0ed2700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94ec064a20 con 0x7f94ec154a50 2020-11-20T12:14:33.520 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94eaffd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f94ec0c8310 0x7f94ec154e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39042/0 (socket says 172.21.15.93:39042) 2020-11-20T12:14:33.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94eaffd700 1 -- 172.21.15.93:0/1473128336 learned_addr learned my addr 172.21.15.93:0/1473128336 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:33.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94eb7fe700 1 --2- 172.21.15.93:0/1473128336 >> v2:172.21.15.132:3300/0 conn(0x7f94ec154a50 0x7f94ec0640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94ea7fc700 1 -- 172.21.15.93:0/1473128336 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432581988 0 0) 0x7f94ec0c8140 con 0x7f94ec0c8310 2020-11-20T12:14:33.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94ea7fc700 1 -- 172.21.15.93:0/1473128336 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94d8003280 con 0x7f94ec0c8310 2020-11-20T12:14:33.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94ea7fc700 1 -- 172.21.15.93:0/1473128336 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 935819450 0 0) 0x7f94ec064780 con 0x7f94ec14e580 2020-11-20T12:14:33.522 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94ea7fc700 1 -- 172.21.15.93:0/1473128336 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94ec0c8140 con 0x7f94ec14e580 2020-11-20T12:14:33.522 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94eb7fe700 1 -- 172.21.15.93:0/1473128336 >> v1:172.21.15.132:6789/0 conn(0x7f94ec14e580 legacy=0x7f94ec14e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.522 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94eb7fe700 1 -- 172.21.15.93:0/1473128336 >> v1:172.21.15.66:6789/0 conn(0x7f94ec0c8310 legacy=0x7f94ec154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.522 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.513+0000 7f94eb7fe700 1 -- 172.21.15.93:0/1473128336 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec064cc0 con 0x7f94ec154a50 2020-11-20T12:14:33.523 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94eb7fe700 1 --2- 172.21.15.93:0/1473128336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec154a50 0x7f94ec0640c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f94e0006fd0 tx=0x7f94e0006e30).ready entity=mon.2 client_cookie=8e0e34d15524d651 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.523 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94ea7fc700 1 -- 172.21.15.93:0/1473128336 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e0009630 con 0x7f94ec154a50 2020-11-20T12:14:33.523 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94ea7fc700 1 -- 172.21.15.93:0/1473128336 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94e0000e90 con 0x7f94ec154a50 2020-11-20T12:14:33.523 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94ea7fc700 1 -- 172.21.15.93:0/1473128336 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94e00099a0 con 0x7f94ec154a50 2020-11-20T12:14:33.524 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94f0ed2700 1 -- 172.21.15.93:0/1473128336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec154a50 msgr2=0x7f94ec0640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.524 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/1473128336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec154a50 0x7f94ec0640c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f94e0006fd0 tx=0x7f94e0006e30).stop 2020-11-20T12:14:33.524 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94f0ed2700 1 -- 172.21.15.93:0/1473128336 shutdown_connections 2020-11-20T12:14:33.524 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/1473128336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec154a50 0x7f94ec0640c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.524 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94f0ed2700 1 -- 172.21.15.93:0/1473128336 >> 172.21.15.93:0/1473128336 conn(0x7f94ec060c00 msgr2=0x7f94ec0c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94f0ed2700 1 -- 172.21.15.93:0/1473128336 shutdown_connections 2020-11-20T12:14:33.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.514+0000 7f94f0ed2700 1 -- 172.21.15.93:0/1473128336 wait complete. 2020-11-20T12:14:33.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.515+0000 7f94f0ed2700 1 Processor -- start 2020-11-20T12:14:33.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94f0ed2700 1 -- start start 2020-11-20T12:14:33.528 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94f0ed2700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0c8310 0x7f94ec164890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.528 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94f0ed2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94ec14e580 0x7f94ec1486e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94f0ed2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec154a50 0x7f94ec153c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94f0ed2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec164d80 con 0x7f94ec154a50 2020-11-20T12:14:33.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94f0ed2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec160a70 con 0x7f94ec14e580 2020-11-20T12:14:33.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94f0ed2700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94ec160cd0 con 0x7f94ec0c8310 2020-11-20T12:14:33.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94eaffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94ec14e580 0x7f94ec1486e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94eaffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94ec14e580 0x7f94ec1486e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38816/0 (socket says 172.21.15.93:38816) 2020-11-20T12:14:33.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94eaffd700 1 -- 172.21.15.93:0/3487155539 learned_addr learned my addr 172.21.15.93:0/3487155539 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:33.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.516+0000 7f94eb7fe700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0c8310 0x7f94ec164890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94ebfff700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec154a50 0x7f94ec153c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.531 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94eaffd700 1 -- 172.21.15.93:0/3487155539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0c8310 msgr2=0x7f94ec164890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.531 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94eaffd700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0c8310 0x7f94ec164890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.532 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94eaffd700 1 -- 172.21.15.93:0/3487155539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec154a50 msgr2=0x7f94ec153c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.532 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94eaffd700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec154a50 0x7f94ec153c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.532 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94eaffd700 1 -- 172.21.15.93:0/3487155539 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94ec160f70 con 0x7f94ec14e580 2020-11-20T12:14:33.532 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94ebfff700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec154a50 0x7f94ec153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:33.533 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94eaffd700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94ec14e580 0x7f94ec1486e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f94dc00c6e0 tx=0x7f94dc007b60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.533 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94d37fe700 1 -- 172.21.15.93:0/3487155539 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc0072e0 con 0x7f94ec14e580 2020-11-20T12:14:33.533 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94d37fe700 1 -- 172.21.15.93:0/3487155539 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94dc007440 con 0x7f94ec14e580 2020-11-20T12:14:33.533 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94ec161210 con 0x7f94ec14e580 2020-11-20T12:14:33.534 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94d37fe700 1 -- 172.21.15.93:0/3487155539 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94dc005840 con 0x7f94ec14e580 2020-11-20T12:14:33.534 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.517+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94ec161750 con 0x7f94ec14e580 2020-11-20T12:14:33.534 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.518+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94ec066280 con 0x7f94ec14e580 2020-11-20T12:14:33.534 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.518+0000 7f94d37fe700 1 -- 172.21.15.93:0/3487155539 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f94dc010070 con 0x7f94ec14e580 2020-11-20T12:14:33.534 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.519+0000 7f94d37fe700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f94c8080670 0x7f94c8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.535 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.519+0000 7f94d37fe700 1 -- 172.21.15.93:0/3487155539 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f94dc0a1ab0 con 0x7f94ec14e580 2020-11-20T12:14:33.535 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.519+0000 7f94eb7fe700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f94c8080670 0x7f94c8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.535 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.519+0000 7f94eb7fe700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f94c8080670 0x7f94c8082b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f94e0006ba0 tx=0x7f94e0015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.535 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.523+0000 7f94d37fe700 1 -- 172.21.15.93:0/3487155539 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f94dc0769e0 con 0x7f94ec14e580 2020-11-20T12:14:33.669 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.665+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f94ec061680 con 0x7f94ec14e580 2020-11-20T12:14:33.670 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.666+0000 7f94d37fe700 1 -- 172.21.15.93:0/3487155539 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v22) v1 ==== 84+0+143 (secure 0 0 0) 0x7f94dc07a000 con 0x7f94ec14e580 2020-11-20T12:14:33.670 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:33.670 INFO:teuthology.orchestra.run.smithi093.stdout:[ 2020-11-20T12:14:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: { 2020-11-20T12:14:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 1, 2020-11-20T12:14:33.671 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "device_health_metrics" 2020-11-20T12:14:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: }, 2020-11-20T12:14:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: { 2020-11-20T12:14:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "poolnum": 2, 2020-11-20T12:14:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: "poolname": "rbd" 2020-11-20T12:14:33.672 INFO:teuthology.orchestra.run.smithi093.stdout: } 2020-11-20T12:14:33.673 INFO:teuthology.orchestra.run.smithi093.stdout:] 2020-11-20T12:14:33.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f94c8080670 msgr2=0x7f94c8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f94c8080670 0x7f94c8082b30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f94e0006ba0 tx=0x7f94e0015000).stop 2020-11-20T12:14:33.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94ec14e580 msgr2=0x7f94ec1486e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94ec14e580 0x7f94ec1486e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f94dc00c6e0 tx=0x7f94dc007b60).stop 2020-11-20T12:14:33.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 shutdown_connections 2020-11-20T12:14:33.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f94c8080670 0x7f94c8082b30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f94ec154a50 0x7f94ec153c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94ec0c8310 0x7f94ec164890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 --2- 172.21.15.93:0/3487155539 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f94ec14e580 0x7f94ec1486e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 >> 172.21.15.93:0/3487155539 conn(0x7f94ec060c00 msgr2=0x7f94ec0c77f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 shutdown_connections 2020-11-20T12:14:33.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.668+0000 7f94f0ed2700 1 -- 172.21.15.93:0/3487155539 wait complete. 2020-11-20T12:14:33.683 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-11-20T12:14:33.684 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata 8 2020-11-20T12:14:33.795 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.791+0000 7f01e732e700 1 Processor -- start 2020-11-20T12:14:33.795 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.791+0000 7f01e732e700 1 -- start start 2020-11-20T12:14:33.797 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e732e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01e0064820 0x7f01e00c46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.797 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e732e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01e0151150 0x7f01e01515e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e732e700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01e00c29e0 con 0x7f01e00c42d0 2020-11-20T12:14:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e732e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e0151ad0 con 0x7f01e0151150 2020-11-20T12:14:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e732e700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01e0151cf0 con 0x7f01e0064820 2020-11-20T12:14:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01e0151150 0x7f01e01515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f01e0151150 0x7f01e01515e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38824/0 (socket says 172.21.15.93:38824) 2020-11-20T12:14:33.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 -- 172.21.15.93:0/3816458282 learned_addr learned my addr 172.21.15.93:0/3816458282 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:33.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 -- 172.21.15.93:0/3816458282 >> v2:172.21.15.132:3300/0 conn(0x7f01e0064820 msgr2=0x7f01e00c46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:33.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e48c9700 1 --2- 172.21.15.93:0/3816458282 >> v2:172.21.15.132:3300/0 conn(0x7f01e0064820 0x7f01e00c46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 --2- 172.21.15.93:0/3816458282 >> v2:172.21.15.132:3300/0 conn(0x7f01e0064820 0x7f01e00c46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 -- 172.21.15.93:0/3816458282 >> v1:172.21.15.132:6789/0 conn(0x7f01e00c42d0 legacy=0x7f01e00c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:33.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 -- 172.21.15.93:0/3816458282 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0151f90 con 0x7f01e0151150 2020-11-20T12:14:33.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01e58cb700 1 --2- 172.21.15.93:0/3816458282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e01515e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f01e0066950 tx=0x7f01d80092d0).ready entity=mon.1 client_cookie=9b0d62f1ab82da8b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01d3fff700 1 -- 172.21.15.93:0/3816458282 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d800bbb0 con 0x7f01e0151150 2020-11-20T12:14:33.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01d3fff700 1 -- 172.21.15.93:0/3816458282 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d800bd10 con 0x7f01e0151150 2020-11-20T12:14:33.801 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.792+0000 7f01d3fff700 1 -- 172.21.15.93:0/3816458282 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8011610 con 0x7f01e0151150 2020-11-20T12:14:33.801 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 -- 172.21.15.93:0/3816458282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 msgr2=0x7f01e01515e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.801 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 --2- 172.21.15.93:0/3816458282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e01515e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f01e0066950 tx=0x7f01d80092d0).stop 2020-11-20T12:14:33.801 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 -- 172.21.15.93:0/3816458282 shutdown_connections 2020-11-20T12:14:33.801 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 --2- 172.21.15.93:0/3816458282 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e01515e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.802 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 --2- 172.21.15.93:0/3816458282 >> v2:172.21.15.132:3300/0 conn(0x7f01e0064820 0x7f01e00c46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.802 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 -- 172.21.15.93:0/3816458282 >> 172.21.15.93:0/3816458282 conn(0x7f01e0060130 msgr2=0x7f01e0060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:33.802 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 -- 172.21.15.93:0/3816458282 shutdown_connections 2020-11-20T12:14:33.802 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.793+0000 7f01e732e700 1 -- 172.21.15.93:0/3816458282 wait complete. 2020-11-20T12:14:33.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.794+0000 7f01e732e700 1 Processor -- start 2020-11-20T12:14:33.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.794+0000 7f01e732e700 1 -- start start 2020-11-20T12:14:33.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e732e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01e0064820 0x7f01e00c14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e732e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e00c42d0 0x7f01e00c6240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e732e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e00c2d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e732e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e00c6b00 con 0x7f01e0064820 2020-11-20T12:14:33.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e732e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e0163cc0 con 0x7f01e0151150 2020-11-20T12:14:33.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e732e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01e0163f60 con 0x7f01e00c42d0 2020-11-20T12:14:33.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e00c2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e00c2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38830/0 (socket says 172.21.15.93:38830) 2020-11-20T12:14:33.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 -- 172.21.15.93:0/3275504684 learned_addr learned my addr 172.21.15.93:0/3275504684 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:33.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e50ca700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01e0064820 0x7f01e00c14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e48c9700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e00c42d0 0x7f01e00c6240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 -- 172.21.15.93:0/3275504684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e00c42d0 msgr2=0x7f01e00c6240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e00c42d0 0x7f01e00c6240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 -- 172.21.15.93:0/3275504684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01e0064820 msgr2=0x7f01e00c14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:33.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01e0064820 0x7f01e00c14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:33.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 -- 172.21.15.93:0/3275504684 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01e0164200 con 0x7f01e0151150 2020-11-20T12:14:33.809 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e58cb700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e00c2d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f01d8006dd0 tx=0x7f01d8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.809 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01d17fa700 1 -- 172.21.15.93:0/3275504684 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8011e30 con 0x7f01e0151150 2020-11-20T12:14:33.809 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01d17fa700 1 -- 172.21.15.93:0/3275504684 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01d8010a60 con 0x7f01e0151150 2020-11-20T12:14:33.809 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.795+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e01644a0 con 0x7f01e0151150 2020-11-20T12:14:33.809 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.796+0000 7f01d17fa700 1 -- 172.21.15.93:0/3275504684 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01d8010de0 con 0x7f01e0151150 2020-11-20T12:14:33.810 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.796+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01e00c6730 con 0x7f01e0151150 2020-11-20T12:14:33.810 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.796+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01e005cad0 con 0x7f01e0151150 2020-11-20T12:14:33.810 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.797+0000 7f01d17fa700 1 -- 172.21.15.93:0/3275504684 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f01d8017070 con 0x7f01e0151150 2020-11-20T12:14:33.810 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.797+0000 7f01d17fa700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f01bc080670 0x7f01bc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:33.810 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.798+0000 7f01d17fa700 1 -- 172.21.15.93:0/3275504684 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 7093+0+0 (secure 0 0 0) 0x7f01d80a48f0 con 0x7f01e0151150 2020-11-20T12:14:33.811 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.798+0000 7f01e50ca700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f01bc080670 0x7f01bc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:33.811 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.798+0000 7f01e50ca700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f01bc080670 0x7f01bc082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f01dc003750 tx=0x7f01dc007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:33.811 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.801+0000 7f01d17fa700 1 -- 172.21.15.93:0/3275504684 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f01d8079710 con 0x7f01e0151150 2020-11-20T12:14:33.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:33.938+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7f01e00615b0 con 0x7f01e0151150 2020-11-20T12:14:34.684 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.681+0000 7f01d17fa700 1 -- 172.21.15.93:0/3275504684 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v23) v1 ==== 133+0+0 (secure 0 0 0) 0x7f01d80150a0 con 0x7f01e0151150 2020-11-20T12:14:34.688 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.683+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f01bc080670 msgr2=0x7f01bc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:34.689 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.683+0000 7f01e732e700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f01bc080670 0x7f01bc082b30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f01dc003750 tx=0x7f01dc007bb0).stop 2020-11-20T12:14:34.689 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.683+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 msgr2=0x7f01e00c2d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:34.690 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.683+0000 7f01e732e700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e00c2d50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f01d8006dd0 tx=0x7f01d8016000).stop 2020-11-20T12:14:34.691 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 shutdown_connections 2020-11-20T12:14:34.691 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f01e0151150 0x7f01e00c2d50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.692 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f01bc080670 0x7f01bc082b30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.692 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f01e0064820 0x7f01e00c14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.692 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 --2- 172.21.15.93:0/3275504684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01e00c42d0 0x7f01e00c6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.693 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 >> 172.21.15.93:0/3275504684 conn(0x7f01e0060130 msgr2=0x7f01e0150a10 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:34.693 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 shutdown_connections 2020-11-20T12:14:34.695 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.684+0000 7f01e732e700 1 -- 172.21.15.93:0/3275504684 wait complete. 2020-11-20T12:14:34.697 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_metadata' created 2020-11-20T12:14:34.701 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-11-20T12:14:34.702 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-11-20T12:14:34.827 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.824+0000 7fa42419b700 1 Processor -- start 2020-11-20T12:14:34.827 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.824+0000 7fa42419b700 1 -- start start 2020-11-20T12:14:34.829 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa42419b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa41c154880 0x7fa41c154c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:34.830 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa42419b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa41c0c1810 0x7fa41c0be990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:34.830 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa42419b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa41c0c4240 con 0x7fa41c0bee80 2020-11-20T12:14:34.830 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa42419b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0c44e0 con 0x7fa41c154880 2020-11-20T12:14:34.830 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa42419b700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa41c0c4780 con 0x7fa41c0c1810 2020-11-20T12:14:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa421f37700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa41c154880 0x7fa41c154c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa422738700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa41c0bee80 0x7fa41c067aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39534/0 (socket says 172.21.15.93:39534) 2020-11-20T12:14:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa422738700 1 -- 172.21.15.93:0/1105978269 learned_addr learned my addr 172.21.15.93:0/1105978269 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa421f37700 1 -- 172.21.15.93:0/1105978269 >> v2:172.21.15.132:3300/0 conn(0x7fa41c0c1810 msgr2=0x7fa41c0be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:34.831 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa421736700 1 --2- 172.21.15.93:0/1105978269 >> v2:172.21.15.132:3300/0 conn(0x7fa41c0c1810 0x7fa41c0be990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:34.832 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa420f35700 1 -- 172.21.15.93:0/1105978269 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2837476589 0 0) 0x7fa41c0c4240 con 0x7fa41c0bee80 2020-11-20T12:14:34.832 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa421f37700 1 --2- 172.21.15.93:0/1105978269 >> v2:172.21.15.132:3300/0 conn(0x7fa41c0c1810 0x7fa41c0be990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.832 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa421f37700 1 -- 172.21.15.93:0/1105978269 >> v1:172.21.15.93:6789/0 conn(0x7fa41c0bee80 legacy=0x7fa41c067aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:34.832 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.825+0000 7fa421f37700 1 -- 172.21.15.93:0/1105978269 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c0c4a20 con 0x7fa41c154880 2020-11-20T12:14:34.832 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa421f37700 1 --2- 172.21.15.93:0/1105978269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c154c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa418006fd0 tx=0x7fa418006e30).ready entity=mon.1 client_cookie=38d8f6df7510518 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:34.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa420f35700 1 -- 172.21.15.93:0/1105978269 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418009830 con 0x7fa41c154880 2020-11-20T12:14:34.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa420f35700 1 -- 172.21.15.93:0/1105978269 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa418000e90 con 0x7fa41c154880 2020-11-20T12:14:34.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa420f35700 1 -- 172.21.15.93:0/1105978269 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa418009ba0 con 0x7fa41c154880 2020-11-20T12:14:34.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 -- 172.21.15.93:0/1105978269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 msgr2=0x7fa41c154c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:34.833 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 --2- 172.21.15.93:0/1105978269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c154c60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fa418006fd0 tx=0x7fa418006e30).stop 2020-11-20T12:14:34.834 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 -- 172.21.15.93:0/1105978269 shutdown_connections 2020-11-20T12:14:34.834 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 --2- 172.21.15.93:0/1105978269 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c154c60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.834 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 --2- 172.21.15.93:0/1105978269 >> v2:172.21.15.132:3300/0 conn(0x7fa41c0c1810 0x7fa41c0be990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.834 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 -- 172.21.15.93:0/1105978269 >> 172.21.15.93:0/1105978269 conn(0x7fa41c060130 msgr2=0x7fa41c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:34.834 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 -- 172.21.15.93:0/1105978269 shutdown_connections 2020-11-20T12:14:34.835 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.826+0000 7fa42419b700 1 -- 172.21.15.93:0/1105978269 wait complete. 2020-11-20T12:14:34.837 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.827+0000 7fa42419b700 1 Processor -- start 2020-11-20T12:14:34.838 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.827+0000 7fa42419b700 1 -- start start 2020-11-20T12:14:34.838 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa42419b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa41c0bee80 0x7fa41c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:34.838 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa42419b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0c1810 0x7fa41c150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:34.838 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa42419b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c14c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:34.838 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa42419b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c0c80c0 con 0x7fa41c0c1810 2020-11-20T12:14:34.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa42419b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c1606f0 con 0x7fa41c154880 2020-11-20T12:14:34.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa42419b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa41c160990 con 0x7fa41c0bee80 2020-11-20T12:14:34.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa422738700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c14c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:34.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa422738700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c14c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38842/0 (socket says 172.21.15.93:38842) 2020-11-20T12:14:34.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa422738700 1 -- 172.21.15.93:0/999827459 learned_addr learned my addr 172.21.15.93:0/999827459 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:34.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa421f37700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa41c0bee80 0x7fa41c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:34.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.828+0000 7fa421736700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0c1810 0x7fa41c150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:34.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa422738700 1 -- 172.21.15.93:0/999827459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa41c0bee80 msgr2=0x7fa41c0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:34.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa422738700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa41c0bee80 0x7fa41c0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa422738700 1 -- 172.21.15.93:0/999827459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0c1810 msgr2=0x7fa41c150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:34.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa422738700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0c1810 0x7fa41c150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:34.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa422738700 1 -- 172.21.15.93:0/999827459 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa41c160c30 con 0x7fa41c154880 2020-11-20T12:14:34.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa422738700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c14c400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa41400cab0 tx=0x7fa414007e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:34.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa409ffb700 1 -- 172.21.15.93:0/999827459 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414005bc0 con 0x7fa41c154880 2020-11-20T12:14:34.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa409ffb700 1 -- 172.21.15.93:0/999827459 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa414005d20 con 0x7fa41c154880 2020-11-20T12:14:34.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa41c160ed0 con 0x7fa41c154880 2020-11-20T12:14:34.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa409ffb700 1 -- 172.21.15.93:0/999827459 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa414007320 con 0x7fa41c154880 2020-11-20T12:14:34.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.829+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa41c0c6100 con 0x7fa41c154880 2020-11-20T12:14:34.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.830+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa41c161330 con 0x7fa41c154880 2020-11-20T12:14:34.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.830+0000 7fa409ffb700 1 -- 172.21.15.93:0/999827459 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa414010030 con 0x7fa41c154880 2020-11-20T12:14:34.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.831+0000 7fa409ffb700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa3f4080670 0x7fa3f4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:34.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.831+0000 7fa409ffb700 1 -- 172.21.15.93:0/999827459 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 7447+0+0 (secure 0 0 0) 0x7fa4140a27b0 con 0x7fa41c154880 2020-11-20T12:14:34.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.831+0000 7fa421f37700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa3f4080670 0x7fa3f4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:34.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.831+0000 7fa421f37700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa3f4080670 0x7fa3f4082b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa418006e70 tx=0x7fa418015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:34.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.834+0000 7fa409ffb700 1 -- 172.21.15.93:0/999827459 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa414077580 con 0x7fa41c154880 2020-11-20T12:14:34.986 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:34.983+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7fa41c0c4c00 con 0x7fa41c154880 2020-11-20T12:14:35.692 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.690+0000 7fa409ffb700 1 -- 172.21.15.93:0/999827459 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v24) v1 ==== 154+0+0 (secure 0 0 0) 0x7fa41407aba0 con 0x7fa41c154880 2020-11-20T12:14:35.696 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa3f4080670 msgr2=0x7fa3f4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:35.696 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa3f4080670 0x7fa3f4082b30 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa418006e70 tx=0x7fa418015000).stop 2020-11-20T12:14:35.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 msgr2=0x7fa41c14c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:35.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c14c400 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fa41400cab0 tx=0x7fa414007e20).stop 2020-11-20T12:14:35.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 shutdown_connections 2020-11-20T12:14:35.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa41c154880 0x7fa41c14c400 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa41c0bee80 0x7fa41c0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa3f4080670 0x7fa3f4082b30 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 --2- 172.21.15.93:0/999827459 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa41c0c1810 0x7fa41c150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 >> 172.21.15.93:0/999827459 conn(0x7fa41c060130 msgr2=0x7fa41c061bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:35.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 shutdown_connections 2020-11-20T12:14:35.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.693+0000 7fa42419b700 1 -- 172.21.15.93:0/999827459 wait complete. 2020-11-20T12:14:35.709 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 8 erasure cephfs_data 2020-11-20T12:14:35.824 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.821+0000 7f6a75c2a700 1 Processor -- start 2020-11-20T12:14:35.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.821+0000 7f6a75c2a700 1 -- start start 2020-11-20T12:14:35.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a75c2a700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6a700c4160 0x7f6a700c4540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:35.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a75c2a700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a700be990 0x7f6a70151160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:35.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a75c2a700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a70151d40 con 0x7f6a70068420 2020-11-20T12:14:35.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a75c2a700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a70151fe0 con 0x7f6a700c4160 2020-11-20T12:14:35.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a75c2a700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a700677a0 con 0x7f6a700be990 2020-11-20T12:14:35.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a6f7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6a700c4160 0x7f6a700c4540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:35.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a6f7fe700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6a700c4160 0x7f6a700c4540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.93:53026/0 (socket says 172.21.15.93:53026) 2020-11-20T12:14:35.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/432993370 learned_addr learned my addr 172.21.15.93:0/432993370 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:35.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a6ffff700 1 --2- 172.21.15.93:0/432993370 >> v2:172.21.15.132:3300/0 conn(0x7f6a700be990 0x7f6a70151160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:35.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.822+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/432993370 >> v2:172.21.15.132:3300/0 conn(0x7f6a700be990 msgr2=0x7f6a70151160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:35.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a6f7fe700 1 --2- 172.21.15.93:0/432993370 >> v2:172.21.15.132:3300/0 conn(0x7f6a700be990 0x7f6a70151160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/432993370 >> v1:172.21.15.132:6789/0 conn(0x7f6a70068420 legacy=0x7f6a70064460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:35.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/432993370 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a70067a40 con 0x7f6a700c4160 2020-11-20T12:14:35.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a6f7fe700 1 --2- 172.21.15.93:0/432993370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700c4160 0x7f6a700c4540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6a700c1e60 tx=0x7f6a68006ef0).ready entity=mon.0 client_cookie=3fcf9dab2fb31ad4 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:35.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a6e7fc700 1 -- 172.21.15.93:0/432993370 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800b8f0 con 0x7f6a700c4160 2020-11-20T12:14:35.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a6e7fc700 1 -- 172.21.15.93:0/432993370 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a68000e90 con 0x7f6a700c4160 2020-11-20T12:14:35.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a6e7fc700 1 -- 172.21.15.93:0/432993370 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6800bc60 con 0x7f6a700c4160 2020-11-20T12:14:35.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 -- 172.21.15.93:0/432993370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700c4160 msgr2=0x7f6a700c4540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:35.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/432993370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700c4160 0x7f6a700c4540 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f6a700c1e60 tx=0x7f6a68006ef0).stop 2020-11-20T12:14:35.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 -- 172.21.15.93:0/432993370 shutdown_connections 2020-11-20T12:14:35.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/432993370 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a700c4160 0x7f6a700c4540 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/432993370 >> v2:172.21.15.132:3300/0 conn(0x7f6a700be990 0x7f6a70151160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 -- 172.21.15.93:0/432993370 >> 172.21.15.93:0/432993370 conn(0x7f6a70060130 msgr2=0x7f6a70060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:35.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 -- 172.21.15.93:0/432993370 shutdown_connections 2020-11-20T12:14:35.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.823+0000 7f6a75c2a700 1 -- 172.21.15.93:0/432993370 wait complete. 2020-11-20T12:14:35.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.825+0000 7f6a75c2a700 1 Processor -- start 2020-11-20T12:14:35.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.825+0000 7f6a75c2a700 1 -- start start 2020-11-20T12:14:35.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.825+0000 7f6a75c2a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a70068420 0x7f6a701526b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:35.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a75c2a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a700be990 0x7f6a70147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:35.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a75c2a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700c4160 0x7f6a70147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:35.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a75c2a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70163e10 con 0x7f6a70068420 2020-11-20T12:14:35.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a75c2a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a701640b0 con 0x7f6a700be990 2020-11-20T12:14:35.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a75c2a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a70164350 con 0x7f6a700c4160 2020-11-20T12:14:35.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a70068420 0x7f6a701526b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:35.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a70068420 0x7f6a701526b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.93:53032/0 (socket says 172.21.15.93:53032) 2020-11-20T12:14:35.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/201743015 learned_addr learned my addr 172.21.15.93:0/201743015 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:35.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6effd700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a700be990 0x7f6a70147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:35.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6ffff700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700c4160 0x7f6a70147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:35.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/201743015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700c4160 msgr2=0x7f6a70147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:35.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700c4160 0x7f6a70147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a700be990 msgr2=0x7f6a70147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:35.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a700be990 0x7f6a70147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:35.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 -- 172.21.15.93:0/201743015 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a701645f0 con 0x7f6a70068420 2020-11-20T12:14:35.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6ffff700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700c4160 0x7f6a70147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:35.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a6f7fe700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a70068420 0x7f6a701526b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6a6800b3c0 tx=0x7f6a68016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:35.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a4f7fe700 1 -- 172.21.15.93:0/201743015 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a68011df0 con 0x7f6a70068420 2020-11-20T12:14:35.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a4f7fe700 1 -- 172.21.15.93:0/201743015 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a6801d480 con 0x7f6a70068420 2020-11-20T12:14:35.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a70164890 con 0x7f6a70068420 2020-11-20T12:14:35.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a4f7fe700 1 -- 172.21.15.93:0/201743015 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a6801d820 con 0x7f6a70068420 2020-11-20T12:14:35.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.826+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a70147a60 con 0x7f6a70068420 2020-11-20T12:14:35.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.827+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a70060e80 con 0x7f6a70068420 2020-11-20T12:14:35.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.828+0000 7f6a4f7fe700 1 -- 172.21.15.93:0/201743015 <== mon.0 v2:172.21.15.66:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6a68017070 con 0x7f6a70068420 2020-11-20T12:14:35.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.829+0000 7f6a4f7fe700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6a48080670 0x7f6a48082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:35.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.829+0000 7f6a4f7fe700 1 -- 172.21.15.93:0/201743015 <== mon.0 v2:172.21.15.66:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 7703+0+0 (secure 0 0 0) 0x7f6a680a50c0 con 0x7f6a70068420 2020-11-20T12:14:35.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.829+0000 7f6a6effd700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6a48080670 0x7f6a48082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:35.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.829+0000 7f6a6effd700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6a48080670 0x7f6a48082b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6a700c6320 tx=0x7f6a64009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:35.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.833+0000 7f6a4f7fe700 1 -- 172.21.15.93:0/201743015 <== mon.0 v2:172.21.15.66:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f6a68079c80 con 0x7f6a70068420 2020-11-20T12:14:35.973 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:35.970+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f6a7005cad0 con 0x7f6a70068420 2020-11-20T12:14:37.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.697+0000 7f6a4f7fe700 1 -- 172.21.15.93:0/201743015 <== mon.0 v2:172.21.15.66:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v26) v1 ==== 188+0+0 (secure 0 0 0) 0x7f6a680a4030 con 0x7f6a70068420 2020-11-20T12:14:37.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6a48080670 msgr2=0x7f6a48082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6a48080670 0x7f6a48082b30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f6a700c6320 tx=0x7f6a64009040).stop 2020-11-20T12:14:37.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a70068420 msgr2=0x7f6a701526b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a70068420 0x7f6a701526b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f6a6800b3c0 tx=0x7f6a68016000).stop 2020-11-20T12:14:37.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 shutdown_connections 2020-11-20T12:14:37.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a700c4160 0x7f6a70147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.704 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6a48080670 0x7f6a48082b30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6a70068420 0x7f6a701526b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 --2- 172.21.15.93:0/201743015 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6a700be990 0x7f6a70147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.705 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.700+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 >> 172.21.15.93:0/201743015 conn(0x7f6a70060130 msgr2=0x7f6a700c6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:37.706 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.701+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 shutdown_connections 2020-11-20T12:14:37.706 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.701+0000 7f6a75c2a700 1 -- 172.21.15.93:0/201743015 wait complete. 2020-11-20T12:14:37.707 INFO:teuthology.orchestra.run.smithi093.stderr:pool 'cephfs_data' created 2020-11-20T12:14:37.720 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data allow_ec_overwrites true 2020-11-20T12:14:37.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.839+0000 7f24564d2700 1 Processor -- start 2020-11-20T12:14:37.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.839+0000 7f24564d2700 1 -- start start 2020-11-20T12:14:37.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f24564d2700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2450154c60 0x7f24500c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f24564d2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f24501514c0 0x7f2450151930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f24564d2700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24500bf0a0 con 0x7f2450154880 2020-11-20T12:14:37.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f24564d2700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24500c1d00 con 0x7f24501514c0 2020-11-20T12:14:37.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f24564d2700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24500c4240 con 0x7f2450154c60 2020-11-20T12:14:37.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f244f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2450154c60 0x7f24500c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f244f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2450154c60 0x7f24500c1810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38868/0 (socket says 172.21.15.93:38868) 2020-11-20T12:14:37.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f244f7fe700 1 -- 172.21.15.93:0/896980446 learned_addr learned my addr 172.21.15.93:0/896980446 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:37.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f2454a6f700 1 --2- 172.21.15.93:0/896980446 >> v2:172.21.15.66:3300/0 conn(0x7f24501514c0 0x7f2450151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f244f7fe700 1 -- 172.21.15.93:0/896980446 >> v2:172.21.15.66:3300/0 conn(0x7f24501514c0 msgr2=0x7f2450151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:37.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f244f7fe700 1 --2- 172.21.15.93:0/896980446 >> v2:172.21.15.66:3300/0 conn(0x7f24501514c0 0x7f2450151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f244f7fe700 1 -- 172.21.15.93:0/896980446 >> v1:172.21.15.132:6789/0 conn(0x7f2450154880 legacy=0x7f24500be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.840+0000 7f244f7fe700 1 -- 172.21.15.93:0/896980446 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500c44e0 con 0x7f2450154c60 2020-11-20T12:14:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f244f7fe700 1 --2- 172.21.15.93:0/896980446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2450154c60 0x7f24500c1810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2450061960 tx=0x7f2444006e90).ready entity=mon.1 client_cookie=be27c0ffcf439a3e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f244effd700 1 -- 172.21.15.93:0/896980446 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444006030 con 0x7f2450154c60 2020-11-20T12:14:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f244effd700 1 -- 172.21.15.93:0/896980446 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2444006190 con 0x7f2450154c60 2020-11-20T12:14:37.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f244effd700 1 -- 172.21.15.93:0/896980446 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2444006510 con 0x7f2450154c60 2020-11-20T12:14:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 -- 172.21.15.93:0/896980446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2450154c60 msgr2=0x7f24500c1810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 --2- 172.21.15.93:0/896980446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2450154c60 0x7f24500c1810 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2450061960 tx=0x7f2444006e90).stop 2020-11-20T12:14:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 -- 172.21.15.93:0/896980446 shutdown_connections 2020-11-20T12:14:37.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 --2- 172.21.15.93:0/896980446 >> v2:172.21.15.66:3300/0 conn(0x7f24501514c0 0x7f2450151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 --2- 172.21.15.93:0/896980446 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2450154c60 0x7f24500c1810 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 -- 172.21.15.93:0/896980446 >> 172.21.15.93:0/896980446 conn(0x7f2450060130 msgr2=0x7f2450060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 -- 172.21.15.93:0/896980446 shutdown_connections 2020-11-20T12:14:37.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.841+0000 7f24564d2700 1 -- 172.21.15.93:0/896980446 wait complete. 2020-11-20T12:14:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.842+0000 7f24564d2700 1 Processor -- start 2020-11-20T12:14:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f24564d2700 1 -- start start 2020-11-20T12:14:37.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f24564d2700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24501514c0 0x7f24500c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f24564d2700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2450154880 0x7f2450064570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f24564d2700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450154c60 0x7f245014b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f24564d2700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24501612d0 con 0x7f2450154c60 2020-11-20T12:14:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f24564d2700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2450160420 con 0x7f24501514c0 2020-11-20T12:14:37.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f24564d2700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24500c86c0 con 0x7f2450154880 2020-11-20T12:14:37.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f244ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24501514c0 0x7f24500c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f244ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24501514c0 0x7f24500c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38872/0 (socket says 172.21.15.93:38872) 2020-11-20T12:14:37.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f244ffff700 1 -- 172.21.15.93:0/1316917185 learned_addr learned my addr 172.21.15.93:0/1316917185 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:37.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.843+0000 7f244f7fe700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2450154880 0x7f2450064570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f244ffff700 1 -- 172.21.15.93:0/1316917185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2450154880 msgr2=0x7f2450064570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f2454a6f700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450154c60 0x7f245014b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f244ffff700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2450154880 0x7f2450064570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f244ffff700 1 -- 172.21.15.93:0/1316917185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450154c60 msgr2=0x7f245014b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:37.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f244ffff700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450154c60 0x7f245014b750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:37.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f244ffff700 1 -- 172.21.15.93:0/1316917185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24500c7f10 con 0x7f24501514c0 2020-11-20T12:14:37.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f244ffff700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24501514c0 0x7f24500c7770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f244000c6e0 tx=0x7f2440007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f242ffff700 1 -- 172.21.15.93:0/1316917185 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000e4a0 con 0x7f24501514c0 2020-11-20T12:14:37.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f242ffff700 1 -- 172.21.15.93:0/1316917185 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244000e600 con 0x7f24501514c0 2020-11-20T12:14:37.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2450160650 con 0x7f24501514c0 2020-11-20T12:14:37.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f242ffff700 1 -- 172.21.15.93:0/1316917185 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244000e9a0 con 0x7f24501514c0 2020-11-20T12:14:37.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.844+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2450160b90 con 0x7f24501514c0 2020-11-20T12:14:37.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.845+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24500c7c60 con 0x7f24501514c0 2020-11-20T12:14:37.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.845+0000 7f242ffff700 1 -- 172.21.15.93:0/1316917185 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2440019030 con 0x7f24501514c0 2020-11-20T12:14:37.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.846+0000 7f242ffff700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f24280806a0 0x7f2428082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:37.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.846+0000 7f244f7fe700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f24280806a0 0x7f2428082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:37.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.846+0000 7f242ffff700 1 -- 172.21.15.93:0/1316917185 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 8155+0+0 (secure 0 0 0) 0x7f24400a1d10 con 0x7f24501514c0 2020-11-20T12:14:37.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.846+0000 7f244f7fe700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f24280806a0 0x7f2428082b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2444006ed0 tx=0x7f2444015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:37.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.850+0000 7f242ffff700 1 -- 172.21.15.93:0/1316917185 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2440076820 con 0x7f24501514c0 2020-11-20T12:14:37.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:37.988+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f245005cad0 con 0x7f24501514c0 2020-11-20T12:14:38.707 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.704+0000 7f242ffff700 1 -- 172.21.15.93:0/1316917185 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v27) v1 ==== 166+0+0 (secure 0 0 0) 0x7f2440017070 con 0x7f24501514c0 2020-11-20T12:14:38.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f24280806a0 msgr2=0x7f2428082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f24280806a0 0x7f2428082b60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f2444006ed0 tx=0x7f2444015000).stop 2020-11-20T12:14:38.710 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24501514c0 msgr2=0x7f24500c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24501514c0 0x7f24500c7770 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f244000c6e0 tx=0x7f2440007c50).stop 2020-11-20T12:14:38.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 shutdown_connections 2020-11-20T12:14:38.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f24280806a0 0x7f2428082b60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2450154c60 0x7f245014b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.711 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f24501514c0 0x7f24500c7770 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 --2- 172.21.15.93:0/1316917185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2450154880 0x7f2450064570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 >> 172.21.15.93:0/1316917185 conn(0x7f2450060130 msgr2=0x7f24500c2290 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:38.712 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 shutdown_connections 2020-11-20T12:14:38.713 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.707+0000 7f24564d2700 1 -- 172.21.15.93:0/1316917185 wait complete. 2020-11-20T12:14:38.713 INFO:teuthology.orchestra.run.smithi093.stderr:set pool 4 allow_ec_overwrites to true 2020-11-20T12:14:38.724 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data --force 2020-11-20T12:14:38.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.840+0000 7fbf61580700 1 Processor -- start 2020-11-20T12:14:38.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.840+0000 7fbf61580700 1 -- start start 2020-11-20T12:14:38.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.840+0000 7fbf61580700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbf5c151bd0 0x7fbf5c0c1810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.840+0000 7fbf61580700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0bf0a0 con 0x7fbf5c154c60 2020-11-20T12:14:38.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf61580700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf5c0c1d00 con 0x7fbf5c154880 2020-11-20T12:14:38.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf61580700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf5c0c4240 con 0x7fbf5c151bd0 2020-11-20T12:14:38.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf5a7fc700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbf5c154c60 0x7fbf5c1514c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39580/0 (socket says 172.21.15.93:39580) 2020-11-20T12:14:38.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf5a7fc700 1 -- 172.21.15.93:0/3843199731 learned_addr learned my addr 172.21.15.93:0/3843199731 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:38.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2066881618 0 0) 0x7fbf5c0bf0a0 con 0x7fbf5c154c60 2020-11-20T12:14:38.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf5b7fe700 1 --2- 172.21.15.93:0/3843199731 >> v2:172.21.15.132:3300/0 conn(0x7fbf5c151bd0 0x7fbf5c0c1810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf48003280 con 0x7fbf5c154c60 2020-11-20T12:14:38.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2964733072 0 0) 0x7fbf48003280 con 0x7fbf5c154c60 2020-11-20T12:14:38.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 >> v2:172.21.15.132:3300/0 conn(0x7fbf5c151bd0 msgr2=0x7fbf5c0c1810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:38.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 --2- 172.21.15.93:0/3843199731 >> v2:172.21.15.132:3300/0 conn(0x7fbf5c151bd0 0x7fbf5c0c1810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 >> v1:172.21.15.132:6789/0 conn(0x7fbf5c154880 legacy=0x7fbf5c0be990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0c44e0 con 0x7fbf5c154c60 2020-11-20T12:14:38.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7fbf500016a0 con 0x7fbf5c154c60 2020-11-20T12:14:38.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 >> v1:172.21.15.93:6789/0 conn(0x7fbf5c154c60 legacy=0x7fbf5c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf480037c0 0x7fbf48003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf48004520 0x7fbf480049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004e90 0x7fbf4800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0c4240 con 0x7fbf480037c0 2020-11-20T12:14:38.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf48005340 con 0x7fbf48004520 2020-11-20T12:14:38.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf4800bc60 con 0x7fbf48004e90 2020-11-20T12:14:38.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf5a7fc700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf48004520 0x7fbf480049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.841+0000 7fbf5b7fe700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004e90 0x7fbf4800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5a7fc700 1 -- 172.21.15.93:0/3843199731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004e90 msgr2=0x7fbf4800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:38.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5a7fc700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004e90 0x7fbf4800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5a7fc700 1 -- 172.21.15.93:0/3843199731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf480037c0 msgr2=0x7fbf48003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:38.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5affd700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf480037c0 0x7fbf48003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5a7fc700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf480037c0 0x7fbf48003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5b7fe700 1 -- 172.21.15.93:0/3843199731 reap_dead start 2020-11-20T12:14:38.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5a7fc700 1 -- 172.21.15.93:0/3843199731 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf48003280 con 0x7fbf48004520 2020-11-20T12:14:38.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5affd700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf480037c0 0x7fbf48003be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:38.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf5a7fc700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf48004520 0x7fbf480049a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbf5000c440 tx=0x7fbf5c0c4670).ready entity=mon.1 client_cookie=1eec128b3dbb2032 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500070d0 con 0x7fbf48004520 2020-11-20T12:14:38.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50007230 con 0x7fbf48004520 2020-11-20T12:14:38.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf59ffb700 1 -- 172.21.15.93:0/3843199731 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50005730 con 0x7fbf48004520 2020-11-20T12:14:38.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf61580700 1 -- 172.21.15.93:0/3843199731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf48004520 msgr2=0x7fbf480049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf61580700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf48004520 0x7fbf480049a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbf5000c440 tx=0x7fbf5c0c4670).stop 2020-11-20T12:14:38.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf61580700 1 -- 172.21.15.93:0/3843199731 shutdown_connections 2020-11-20T12:14:38.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf61580700 1 --2- 172.21.15.93:0/3843199731 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf48004520 0x7fbf480049a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf61580700 1 -- 172.21.15.93:0/3843199731 >> 172.21.15.93:0/3843199731 conn(0x7fbf5c060130 msgr2=0x7fbf5c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:38.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf61580700 1 -- 172.21.15.93:0/3843199731 shutdown_connections 2020-11-20T12:14:38.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.842+0000 7fbf61580700 1 -- 172.21.15.93:0/3843199731 wait complete. 2020-11-20T12:14:38.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 Processor -- start 2020-11-20T12:14:38.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 -- start start 2020-11-20T12:14:38.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004520 0x7fbf5c0c8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c1616d0 0x7fbf5c148e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5c149310 0x7fbf5c152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c150c50 con 0x7fbf5c1616d0 2020-11-20T12:14:38.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c161b60 con 0x7fbf5c149310 2020-11-20T12:14:38.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf61580700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf5c0c6150 con 0x7fbf48004520 2020-11-20T12:14:38.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf5b7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5c149310 0x7fbf5c152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.860 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf5b7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5c149310 0x7fbf5c152ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38894/0 (socket says 172.21.15.93:38894) 2020-11-20T12:14:38.860 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.844+0000 7fbf5b7fe700 1 -- 172.21.15.93:0/3678387754 learned_addr learned my addr 172.21.15.93:0/3678387754 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:38.860 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5affd700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004520 0x7fbf5c0c8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.860 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5a7fc700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c1616d0 0x7fbf5c148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.860 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5b7fe700 1 -- 172.21.15.93:0/3678387754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004520 msgr2=0x7fbf5c0c8380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.861 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5b7fe700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004520 0x7fbf5c0c8380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.861 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5b7fe700 1 -- 172.21.15.93:0/3678387754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c1616d0 msgr2=0x7fbf5c148e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:38.861 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5b7fe700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c1616d0 0x7fbf5c148e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:38.861 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5b7fe700 1 -- 172.21.15.93:0/3678387754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf5c0c63f0 con 0x7fbf5c149310 2020-11-20T12:14:38.861 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5a7fc700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c1616d0 0x7fbf5c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:38.862 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf5b7fe700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5c149310 0x7fbf5c152ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fbf54009160 tx=0x7fbf54009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.862 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf42ffd700 1 -- 172.21.15.93:0/3678387754 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf5400faf0 con 0x7fbf5c149310 2020-11-20T12:14:38.862 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf42ffd700 1 -- 172.21.15.93:0/3678387754 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf5400fc50 con 0x7fbf5c149310 2020-11-20T12:14:38.862 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf42ffd700 1 -- 172.21.15.93:0/3678387754 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf54014440 con 0x7fbf5c149310 2020-11-20T12:14:38.862 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf5c0c6690 con 0x7fbf5c149310 2020-11-20T12:14:38.863 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.845+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf5c149790 con 0x7fbf5c149310 2020-11-20T12:14:38.863 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.846+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf5c152c10 con 0x7fbf5c149310 2020-11-20T12:14:38.863 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.847+0000 7fbf42ffd700 1 -- 172.21.15.93:0/3678387754 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbf54014830 con 0x7fbf5c149310 2020-11-20T12:14:38.863 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.847+0000 7fbf42ffd700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbf380806a0 0x7fbf38082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:38.863 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.847+0000 7fbf5affd700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbf380806a0 0x7fbf38082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:38.864 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.847+0000 7fbf42ffd700 1 -- 172.21.15.93:0/3678387754 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 8155+0+0 (secure 0 0 0) 0x7fbf540a40a0 con 0x7fbf5c149310 2020-11-20T12:14:38.864 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.848+0000 7fbf5affd700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbf380806a0 0x7fbf38082b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fbf4c000c00 tx=0x7fbf4c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:38.864 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:38.850+0000 7fbf42ffd700 1 -- 172.21.15.93:0/3678387754 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbf54078bb0 con 0x7fbf5c149310 2020-11-20T12:14:39.044 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.041+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7fbf5c05cad0 con 0x7fbf5c149310 2020-11-20T12:14:39.051 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.048+0000 7fbf42ffd700 1 -- 172.21.15.93:0/3678387754 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 187+0+0 (secure 0 0 0) 0x7fbf54012330 con 0x7fbf5c149310 2020-11-20T12:14:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbf380806a0 msgr2=0x7fbf38082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbf380806a0 0x7fbf38082b60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fbf4c000c00 tx=0x7fbf4c009040).stop 2020-11-20T12:14:39.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5c149310 msgr2=0x7fbf5c152ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5c149310 0x7fbf5c152ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fbf54009160 tx=0x7fbf54009220).stop 2020-11-20T12:14:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 shutdown_connections 2020-11-20T12:14:39.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbf5c149310 0x7fbf5c152ef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbf48004520 0x7fbf5c0c8380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbf380806a0 0x7fbf38082b60 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 --2- 172.21.15.93:0/3678387754 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbf5c1616d0 0x7fbf5c148e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 >> 172.21.15.93:0/3678387754 conn(0x7fbf5c060130 msgr2=0x7fbf5c14d640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 shutdown_connections 2020-11-20T12:14:39.057 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.051+0000 7fbf61580700 1 -- 172.21.15.93:0/3678387754 wait complete. 2020-11-20T12:14:39.057 INFO:teuthology.orchestra.run.smithi093.stderr:new fs with metadata pool 3 and data pool 4 2020-11-20T12:14:39.068 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:39.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.174+0000 7fd1ae803700 1 Processor -- start 2020-11-20T12:14:39.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.175+0000 7fd1ae803700 1 -- start start 2020-11-20T12:14:39.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.175+0000 7fd1ae803700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd1a80c8310 0x7fd1a80640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.175+0000 7fd1ae803700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd1a814e580 0x7fd1a814e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.175+0000 7fd1ae803700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1a80c8140 con 0x7fd1a8154a50 2020-11-20T12:14:39.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.175+0000 7fd1ae803700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a8064780 con 0x7fd1a814e580 2020-11-20T12:14:39.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.175+0000 7fd1ae803700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1a8064a20 con 0x7fd1a80c8310 2020-11-20T12:14:39.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd1a80c8310 0x7fd1a80640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd1a80c8310 0x7fd1a80640c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38900/0 (socket says 172.21.15.93:38900) 2020-11-20T12:14:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 -- 172.21.15.93:0/1343931613 learned_addr learned my addr 172.21.15.93:0/1343931613 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ae002700 1 --2- 172.21.15.93:0/1343931613 >> v2:172.21.15.66:3300/0 conn(0x7fd1a814e580 0x7fd1a814e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 -- 172.21.15.93:0/1343931613 >> v2:172.21.15.66:3300/0 conn(0x7fd1a814e580 msgr2=0x7fd1a814e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:39.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 --2- 172.21.15.93:0/1343931613 >> v2:172.21.15.66:3300/0 conn(0x7fd1a814e580 0x7fd1a814e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 -- 172.21.15.93:0/1343931613 >> v1:172.21.15.66:6789/0 conn(0x7fd1a8154a50 legacy=0x7fd1a8154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 -- 172.21.15.93:0/1343931613 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a8064cc0 con 0x7fd1a80c8310 2020-11-20T12:14:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd1ad000700 1 --2- 172.21.15.93:0/1343931613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a80c8310 0x7fd1a80640c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd1a80c41a0 tx=0x7fd198006ef0).ready entity=mon.1 client_cookie=d8c568a22d9ed551 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd197fff700 1 -- 172.21.15.93:0/1343931613 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800b860 con 0x7fd1a80c8310 2020-11-20T12:14:39.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd197fff700 1 -- 172.21.15.93:0/1343931613 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198000e90 con 0x7fd1a80c8310 2020-11-20T12:14:39.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.176+0000 7fd197fff700 1 -- 172.21.15.93:0/1343931613 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19800bbd0 con 0x7fd1a80c8310 2020-11-20T12:14:39.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 -- 172.21.15.93:0/1343931613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a80c8310 msgr2=0x7fd1a80640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 --2- 172.21.15.93:0/1343931613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a80c8310 0x7fd1a80640c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fd1a80c41a0 tx=0x7fd198006ef0).stop 2020-11-20T12:14:39.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 -- 172.21.15.93:0/1343931613 shutdown_connections 2020-11-20T12:14:39.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 --2- 172.21.15.93:0/1343931613 >> v2:172.21.15.66:3300/0 conn(0x7fd1a814e580 0x7fd1a814e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 --2- 172.21.15.93:0/1343931613 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a80c8310 0x7fd1a80640c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 -- 172.21.15.93:0/1343931613 >> 172.21.15.93:0/1343931613 conn(0x7fd1a8060c00 msgr2=0x7fd1a80c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 -- 172.21.15.93:0/1343931613 shutdown_connections 2020-11-20T12:14:39.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.177+0000 7fd1ae803700 1 -- 172.21.15.93:0/1343931613 wait complete. 2020-11-20T12:14:39.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.178+0000 7fd1ae803700 1 Processor -- start 2020-11-20T12:14:39.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.178+0000 7fd1ae803700 1 -- start start 2020-11-20T12:14:39.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ae803700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1a80c8310 0x7fd1a8146f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ae803700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a814e580 0x7fd1a8062010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ae803700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1a8154a50 0x7fd1a81442b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ae803700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8145210 con 0x7fd1a8154a50 2020-11-20T12:14:39.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ae803700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8147400 con 0x7fd1a814e580 2020-11-20T12:14:39.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ae803700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1a8145440 con 0x7fd1a80c8310 2020-11-20T12:14:39.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a814e580 0x7fd1a8062010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a814e580 0x7fd1a8062010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38908/0 (socket says 172.21.15.93:38908) 2020-11-20T12:14:39.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 -- 172.21.15.93:0/2490476421 learned_addr learned my addr 172.21.15.93:0/2490476421 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:39.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 -- 172.21.15.93:0/2490476421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1a80c8310 msgr2=0x7fd1a8146f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1a80c8310 0x7fd1a8146f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:39.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 -- 172.21.15.93:0/2490476421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1a8154a50 msgr2=0x7fd1a81442b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1a8154a50 0x7fd1a81442b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:39.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.179+0000 7fd1ad000700 1 -- 172.21.15.93:0/2490476421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1a81456e0 con 0x7fd1a814e580 2020-11-20T12:14:39.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.180+0000 7fd1ad000700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a814e580 0x7fd1a8062010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd19800c010 tx=0x7fd198016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.180+0000 7fd1957fa700 1 -- 172.21.15.93:0/2490476421 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd198011c90 con 0x7fd1a814e580 2020-11-20T12:14:39.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.180+0000 7fd1957fa700 1 -- 172.21.15.93:0/2490476421 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd198011df0 con 0x7fd1a814e580 2020-11-20T12:14:39.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.180+0000 7fd1957fa700 1 -- 172.21.15.93:0/2490476421 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd19801d6d0 con 0x7fd1a814e580 2020-11-20T12:14:39.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.180+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1a81536e0 con 0x7fd1a814e580 2020-11-20T12:14:39.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.180+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1a8153c20 con 0x7fd1a814e580 2020-11-20T12:14:39.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.181+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1a8061680 con 0x7fd1a814e580 2020-11-20T12:14:39.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.181+0000 7fd1957fa700 1 -- 172.21.15.93:0/2490476421 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd198017070 con 0x7fd1a814e580 2020-11-20T12:14:39.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.182+0000 7fd1957fa700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd180080670 0x7fd180082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.182+0000 7fd1957fa700 1 -- 172.21.15.93:0/2490476421 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd1980a4810 con 0x7fd1a814e580 2020-11-20T12:14:39.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.182+0000 7fd1ad801700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd180080670 0x7fd180082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.195 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.182+0000 7fd1ad801700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd180080670 0x7fd180082b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd1a4001370 tx=0x7fd1a4007810).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.195 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.185+0000 7fd1957fa700 1 -- 172.21.15.93:0/2490476421 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd198079220 con 0x7fd1a814e580 2020-11-20T12:14:39.328 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.325+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1a805ca60 con 0x7fd1a814e580 2020-11-20T12:14:39.329 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.326+0000 7fd1957fa700 1 -- 172.21.15.93:0/2490476421 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7fd198015020 con 0x7fd1a814e580 2020-11-20T12:14:39.330 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:39.330 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:39.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd180080670 msgr2=0x7fd180082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd180080670 0x7fd180082b30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fd1a4001370 tx=0x7fd1a4007810).stop 2020-11-20T12:14:39.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a814e580 msgr2=0x7fd1a8062010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a814e580 0x7fd1a8062010 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fd19800c010 tx=0x7fd198016000).stop 2020-11-20T12:14:39.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 shutdown_connections 2020-11-20T12:14:39.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd180080670 0x7fd180082b30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1a8154a50 0x7fd1a81442b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:39.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1a80c8310 0x7fd1a8146f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:39.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 --2- 172.21.15.93:0/2490476421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1a814e580 0x7fd1a8062010 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 >> 172.21.15.93:0/2490476421 conn(0x7fd1a8060c00 msgr2=0x7fd1a8154e30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 shutdown_connections 2020-11-20T12:14:39.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.328+0000 7fd1ae803700 1 -- 172.21.15.93:0/2490476421 wait complete. 2020-11-20T12:14:39.343 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:39.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.447+0000 7fc93c481700 1 Processor -- start 2020-11-20T12:14:39.451 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.447+0000 7fc93c481700 1 -- start start 2020-11-20T12:14:39.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc93c481700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc934065580 0x7fc934065960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc93c481700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc934151240 0x7fc9341552a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc93c481700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9340c0860 con 0x7fc9340befa0 2020-11-20T12:14:39.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc93c481700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc934063500 con 0x7fc934065580 2020-11-20T12:14:39.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc93c481700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc934151820 con 0x7fc934151240 2020-11-20T12:14:39.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc939a1c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc934151240 0x7fc9341552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc939a1c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fc934151240 0x7fc9341552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38918/0 (socket says 172.21.15.93:38918) 2020-11-20T12:14:39.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.448+0000 7fc939a1c700 1 -- 172.21.15.93:0/3094130759 learned_addr learned my addr 172.21.15.93:0/3094130759 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:39.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93a21d700 1 --2- 172.21.15.93:0/3094130759 >> v2:172.21.15.66:3300/0 conn(0x7fc934065580 0x7fc934065960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc939a1c700 1 -- 172.21.15.93:0/3094130759 >> v2:172.21.15.66:3300/0 conn(0x7fc934065580 msgr2=0x7fc934065960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:39.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc939a1c700 1 --2- 172.21.15.93:0/3094130759 >> v2:172.21.15.66:3300/0 conn(0x7fc934065580 0x7fc934065960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc939a1c700 1 -- 172.21.15.93:0/3094130759 >> v1:172.21.15.132:6789/0 conn(0x7fc9340befa0 legacy=0x7fc93414e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc939a1c700 1 -- 172.21.15.93:0/3094130759 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934151ac0 con 0x7fc934151240 2020-11-20T12:14:39.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc939a1c700 1 --2- 172.21.15.93:0/3094130759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc934151240 0x7fc9341552a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc934065e50 tx=0x7fc924006ef0).ready entity=mon.1 client_cookie=d7a722045cbb907f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93921b700 1 -- 172.21.15.93:0/3094130759 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400b8f0 con 0x7fc934151240 2020-11-20T12:14:39.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93921b700 1 -- 172.21.15.93:0/3094130759 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc924000e90 con 0x7fc934151240 2020-11-20T12:14:39.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93921b700 1 -- 172.21.15.93:0/3094130759 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92400bc60 con 0x7fc934151240 2020-11-20T12:14:39.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 -- 172.21.15.93:0/3094130759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc934151240 msgr2=0x7fc9341552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 --2- 172.21.15.93:0/3094130759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc934151240 0x7fc9341552a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc934065e50 tx=0x7fc924006ef0).stop 2020-11-20T12:14:39.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 -- 172.21.15.93:0/3094130759 shutdown_connections 2020-11-20T12:14:39.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 --2- 172.21.15.93:0/3094130759 >> v2:172.21.15.66:3300/0 conn(0x7fc934065580 0x7fc934065960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 --2- 172.21.15.93:0/3094130759 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc934151240 0x7fc9341552a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 -- 172.21.15.93:0/3094130759 >> 172.21.15.93:0/3094130759 conn(0x7fc934061240 msgr2=0x7fc934061650 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 -- 172.21.15.93:0/3094130759 shutdown_connections 2020-11-20T12:14:39.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.449+0000 7fc93c481700 1 -- 172.21.15.93:0/3094130759 wait complete. 2020-11-20T12:14:39.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 Processor -- start 2020-11-20T12:14:39.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 -- start start 2020-11-20T12:14:39.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc934065580 0x7fc934150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9340befa0 0x7fc9340c4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc934151240 0x7fc934161040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc934163b50 con 0x7fc934065580 2020-11-20T12:14:39.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc934161530 con 0x7fc9340befa0 2020-11-20T12:14:39.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93c481700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9341649c0 con 0x7fc934151240 2020-11-20T12:14:39.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc939a1c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9340befa0 0x7fc9340c4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc939a1c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9340befa0 0x7fc9340c4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38922/0 (socket says 172.21.15.93:38922) 2020-11-20T12:14:39.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc939a1c700 1 -- 172.21.15.93:0/1671859949 learned_addr learned my addr 172.21.15.93:0/1671859949 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:39.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.451+0000 7fc93aa1e700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc934151240 0x7fc934161040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc93a21d700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc934065580 0x7fc934150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc939a1c700 1 -- 172.21.15.93:0/1671859949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc934151240 msgr2=0x7fc934161040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc939a1c700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc934151240 0x7fc934161040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc939a1c700 1 -- 172.21.15.93:0/1671859949 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc934065580 msgr2=0x7fc934150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc939a1c700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc934065580 0x7fc934150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc939a1c700 1 -- 172.21.15.93:0/1671859949 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc934150bc0 con 0x7fc9340befa0 2020-11-20T12:14:39.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc93aa1e700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc934151240 0x7fc934161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:39.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc93a21d700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc934065580 0x7fc934150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:39.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc939a1c700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9340befa0 0x7fc9340c4f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc92400b3c0 tx=0x7fc924016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc9227fc700 1 -- 172.21.15.93:0/1671859949 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc924011e70 con 0x7fc9340befa0 2020-11-20T12:14:39.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc9227fc700 1 -- 172.21.15.93:0/1671859949 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92401d450 con 0x7fc9340befa0 2020-11-20T12:14:39.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc934163d40 con 0x7fc9340befa0 2020-11-20T12:14:39.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc9227fc700 1 -- 172.21.15.93:0/1671859949 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc92401d7f0 con 0x7fc9340befa0 2020-11-20T12:14:39.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.452+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc934164280 con 0x7fc9340befa0 2020-11-20T12:14:39.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.453+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc93405cd50 con 0x7fc9340befa0 2020-11-20T12:14:39.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.453+0000 7fc9227fc700 1 -- 172.21.15.93:0/1671859949 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc924025030 con 0x7fc9340befa0 2020-11-20T12:14:39.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.454+0000 7fc9227fc700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc90c0806a0 0x7fc90c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.454+0000 7fc9227fc700 1 -- 172.21.15.93:0/1671859949 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc9240a4100 con 0x7fc9340befa0 2020-11-20T12:14:39.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.454+0000 7fc93a21d700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc90c0806a0 0x7fc90c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.454+0000 7fc93a21d700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc90c0806a0 0x7fc90c082b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc93000c820 tx=0x7fc930008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.457+0000 7fc9227fc700 1 -- 172.21.15.93:0/1671859949 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc924078b10 con 0x7fc9340befa0 2020-11-20T12:14:39.602 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.599+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc93405c670 con 0x7fc9340befa0 2020-11-20T12:14:39.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.600+0000 7fc9227fc700 1 -- 172.21.15.93:0/1671859949 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7fc924023030 con 0x7fc9340befa0 2020-11-20T12:14:39.604 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:39.604 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:39.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc90c0806a0 msgr2=0x7fc90c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc90c0806a0 0x7fc90c082b60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc93000c820 tx=0x7fc930008040).stop 2020-11-20T12:14:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9340befa0 msgr2=0x7fc9340c4f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9340befa0 0x7fc9340c4f90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fc92400b3c0 tx=0x7fc924016000).stop 2020-11-20T12:14:39.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 shutdown_connections 2020-11-20T12:14:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc934151240 0x7fc934161040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc90c0806a0 0x7fc90c082b60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc934065580 0x7fc934150610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 --2- 172.21.15.93:0/1671859949 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc9340befa0 0x7fc9340c4f90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 >> 172.21.15.93:0/1671859949 conn(0x7fc934061240 msgr2=0x7fc9340be1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 shutdown_connections 2020-11-20T12:14:39.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.602+0000 7fc93c481700 1 -- 172.21.15.93:0/1671859949 wait complete. 2020-11-20T12:14:39.617 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2020-11-20T12:14:39.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.727+0000 7fecd4610700 1 Processor -- start 2020-11-20T12:14:39.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.727+0000 7fecd4610700 1 -- start start 2020-11-20T12:14:39.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd4610700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feccc14efe0 0x7feccc151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd4610700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc151990 con 0x7feccc0bf5e0 2020-11-20T12:14:39.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd4610700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feccc0c2620 con 0x7feccc14ec00 2020-11-20T12:14:39.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd4610700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feccc0c28c0 con 0x7feccc14efe0 2020-11-20T12:14:39.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd23ac700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7feccc14ec00 0x7feccc0beed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39626/0 (socket says 172.21.15.93:39626) 2020-11-20T12:14:39.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd23ac700 1 -- 172.21.15.93:0/2982750271 learned_addr learned my addr 172.21.15.93:0/2982750271 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:39.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 761246009 0 0) 0x7feccc0c2620 con 0x7feccc14ec00 2020-11-20T12:14:39.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd1bab700 1 --2- 172.21.15.93:0/2982750271 >> v2:172.21.15.132:3300/0 conn(0x7feccc14efe0 0x7feccc151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.728+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fecb4003280 con 0x7feccc14ec00 2020-11-20T12:14:39.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4090540611 0 0) 0x7fecb4003280 con 0x7feccc14ec00 2020-11-20T12:14:39.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 >> v2:172.21.15.132:3300/0 conn(0x7feccc14efe0 msgr2=0x7feccc151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:39.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 --2- 172.21.15.93:0/2982750271 >> v2:172.21.15.132:3300/0 conn(0x7feccc14efe0 0x7feccc151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 >> v1:172.21.15.66:6789/0 conn(0x7feccc0bf5e0 legacy=0x7feccc0c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0c2b60 con 0x7feccc14ec00 2020-11-20T12:14:39.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7fecbc001520 con 0x7feccc14ec00 2020-11-20T12:14:39.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 >> v1:172.21.15.93:6789/0 conn(0x7feccc14ec00 legacy=0x7feccc0beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb40037c0 0x7fecb4003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecb4004520 0x7fecb40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb4004e90 0x7fecb400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0c28c0 con 0x7fecb4004520 2020-11-20T12:14:39.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb4005340 con 0x7fecb4004e90 2020-11-20T12:14:39.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb400bc60 con 0x7fecb40037c0 2020-11-20T12:14:39.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb4004e90 0x7fecb400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd1bab700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecb4004520 0x7fecb40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd23ac700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb40037c0 0x7fecb4003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 -- 172.21.15.93:0/2982750271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb40037c0 msgr2=0x7fecb4003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:39.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb40037c0 0x7fecb4003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 -- 172.21.15.93:0/2982750271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecb4004520 msgr2=0x7fecb40049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:39.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fecb4004520 0x7fecb40049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 -- 172.21.15.93:0/2982750271 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb4003280 con 0x7fecb4004e90 2020-11-20T12:14:39.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 -- 172.21.15.93:0/2982750271 reap_dead start 2020-11-20T12:14:39.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd2bad700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb4004e90 0x7fecb400b770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fecc4001ef0 tx=0x7fecc4007f50).ready entity=mon.1 client_cookie=e0e3fa67ab0d113c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400c930 con 0x7fecb4004e90 2020-11-20T12:14:39.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc400ca90 con 0x7fecb4004e90 2020-11-20T12:14:39.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.729+0000 7fecd13aa700 1 -- 172.21.15.93:0/2982750271 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc400ce50 con 0x7fecb4004e90 2020-11-20T12:14:39.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.730+0000 7fecd4610700 1 -- 172.21.15.93:0/2982750271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb4004e90 msgr2=0x7fecb400b770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.730+0000 7fecd4610700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb4004e90 0x7fecb400b770 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fecc4001ef0 tx=0x7fecc4007f50).stop 2020-11-20T12:14:39.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.730+0000 7fecd4610700 1 -- 172.21.15.93:0/2982750271 shutdown_connections 2020-11-20T12:14:39.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.730+0000 7fecd4610700 1 --2- 172.21.15.93:0/2982750271 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fecb4004e90 0x7fecb400b770 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.730+0000 7fecd4610700 1 -- 172.21.15.93:0/2982750271 >> 172.21.15.93:0/2982750271 conn(0x7feccc060130 msgr2=0x7feccc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:39.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.730+0000 7fecd4610700 1 -- 172.21.15.93:0/2982750271 shutdown_connections 2020-11-20T12:14:39.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.730+0000 7fecd4610700 1 -- 172.21.15.93:0/2982750271 wait complete. 2020-11-20T12:14:39.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.731+0000 7fecd4610700 1 Processor -- start 2020-11-20T12:14:39.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.731+0000 7fecd4610700 1 -- start start 2020-11-20T12:14:39.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd4610700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4004e90 0x7feccc0c57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd4610700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feccc161ed0 0x7feccc149360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd4610700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feccc148410 0x7feccc0679c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd4610700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc149850 con 0x7feccc148410 2020-11-20T12:14:39.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd4610700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc1612c0 con 0x7feccc161ed0 2020-11-20T12:14:39.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd4610700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feccc0c5e20 con 0x7fecb4004e90 2020-11-20T12:14:39.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feccc161ed0 0x7feccc149360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feccc161ed0 0x7feccc149360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38942/0 (socket says 172.21.15.93:38942) 2020-11-20T12:14:39.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 -- 172.21.15.93:0/1092921394 learned_addr learned my addr 172.21.15.93:0/1092921394 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:39.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd23ac700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4004e90 0x7feccc0c57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd2bad700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feccc148410 0x7feccc0679c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 -- 172.21.15.93:0/1092921394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4004e90 msgr2=0x7feccc0c57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4004e90 0x7feccc0c57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 -- 172.21.15.93:0/1092921394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feccc148410 msgr2=0x7feccc0679c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:39.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feccc148410 0x7feccc0679c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:39.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 -- 172.21.15.93:0/1092921394 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feccc0c60c0 con 0x7feccc161ed0 2020-11-20T12:14:39.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd23ac700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4004e90 0x7feccc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:39.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd1bab700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feccc161ed0 0x7feccc149360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fecc8011c90 tx=0x7fecc8006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecba7fc700 1 -- 172.21.15.93:0/1092921394 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc8018070 con 0x7feccc161ed0 2020-11-20T12:14:39.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecba7fc700 1 -- 172.21.15.93:0/1092921394 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc8000e90 con 0x7feccc161ed0 2020-11-20T12:14:39.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecba7fc700 1 -- 172.21.15.93:0/1092921394 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc800fcd0 con 0x7feccc161ed0 2020-11-20T12:14:39.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.732+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feccc1614f0 con 0x7feccc161ed0 2020-11-20T12:14:39.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.733+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feccc161a30 con 0x7feccc161ed0 2020-11-20T12:14:39.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.734+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feccc061a40 con 0x7feccc161ed0 2020-11-20T12:14:39.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.734+0000 7fecba7fc700 1 -- 172.21.15.93:0/1092921394 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fecc8014650 con 0x7feccc161ed0 2020-11-20T12:14:39.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.735+0000 7fecba7fc700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7feca4080670 0x7feca4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:39.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.735+0000 7fecba7fc700 1 -- 172.21.15.93:0/1092921394 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fecc80a3010 con 0x7feccc161ed0 2020-11-20T12:14:39.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.735+0000 7fecd23ac700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7feca4080670 0x7feca4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:39.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.735+0000 7fecd23ac700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7feca4080670 0x7feca4082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fecbc0077e0 tx=0x7fecbc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:39.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.738+0000 7fecba7fc700 1 -- 172.21.15.93:0/1092921394 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fecc8077a20 con 0x7feccc161ed0 2020-11-20T12:14:39.927 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:39.924+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feccc067590 con 0x7feccc161ed0 2020-11-20T12:14:40.050 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.047+0000 7fecba7fc700 1 -- 172.21.15.93:0/1092921394 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7fecc807b040 con 0x7feccc161ed0 2020-11-20T12:14:40.052 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.048+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7feca4080670 msgr2=0x7feca4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:40.053 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.048+0000 7fecd4610700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7feca4080670 0x7feca4082b30 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fecbc0077e0 tx=0x7fecbc009040).stop 2020-11-20T12:14:40.053 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feccc161ed0 msgr2=0x7feccc149360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:40.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feccc161ed0 0x7feccc149360 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fecc8011c90 tx=0x7fecc8006e30).stop 2020-11-20T12:14:40.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 shutdown_connections 2020-11-20T12:14:40.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7feca4080670 0x7feca4082b30 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7feccc148410 0x7feccc0679c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb4004e90 0x7feccc0c57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 --2- 172.21.15.93:0/1092921394 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7feccc161ed0 0x7feccc149360 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 >> 172.21.15.93:0/1092921394 conn(0x7feccc060130 msgr2=0x7feccc150da0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:40.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 shutdown_connections 2020-11-20T12:14:40.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.049+0000 7fecd4610700 1 -- 172.21.15.93:0/1092921394 wait complete. 2020-11-20T12:14:40.065 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2020-11-20T12:14:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.178+0000 7fbeb0b69700 1 Processor -- start 2020-11-20T12:14:40.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.178+0000 7fbeb0b69700 1 -- start start 2020-11-20T12:14:40.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeb0b69700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbeac0602f0 0x7fbeac0606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:40.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeb0b69700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbeac068580 0x7fbeac0c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:40.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeb0b69700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeac067660 con 0x7fbeac0c2620 2020-11-20T12:14:40.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeb0b69700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac067900 con 0x7fbeac068580 2020-11-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeb0b69700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeac067ba0 con 0x7fbeac0602f0 2020-11-20T12:14:40.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeab7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbeac0602f0 0x7fbeac0606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:40.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeab7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbeac0602f0 0x7fbeac0606d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38948/0 (socket says 172.21.15.93:38948) 2020-11-20T12:14:40.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeab7fe700 1 -- 172.21.15.93:0/2732052800 learned_addr learned my addr 172.21.15.93:0/2732052800 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:40.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.179+0000 7fbeaaffd700 1 --2- 172.21.15.93:0/2732052800 >> v2:172.21.15.66:3300/0 conn(0x7fbeac068580 0x7fbeac0c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:40.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeab7fe700 1 -- 172.21.15.93:0/2732052800 >> v2:172.21.15.66:3300/0 conn(0x7fbeac068580 msgr2=0x7fbeac0c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:40.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeab7fe700 1 --2- 172.21.15.93:0/2732052800 >> v2:172.21.15.66:3300/0 conn(0x7fbeac068580 0x7fbeac0c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeab7fe700 1 -- 172.21.15.93:0/2732052800 >> v1:172.21.15.66:6789/0 conn(0x7fbeac0c2620 legacy=0x7fbeac064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:40.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeab7fe700 1 -- 172.21.15.93:0/2732052800 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac067e40 con 0x7fbeac0602f0 2020-11-20T12:14:40.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeab7fe700 1 --2- 172.21.15.93:0/2732052800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac0602f0 0x7fbeac0606d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbeac044cc0 tx=0x7fbe9c006ef0).ready entity=mon.1 client_cookie=68020cee1d3739ba server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:40.195 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeaa7fc700 1 -- 172.21.15.93:0/2732052800 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00b860 con 0x7fbeac0602f0 2020-11-20T12:14:40.195 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeaa7fc700 1 -- 172.21.15.93:0/2732052800 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe9c000e90 con 0x7fbeac0602f0 2020-11-20T12:14:40.195 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeaa7fc700 1 -- 172.21.15.93:0/2732052800 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00bbd0 con 0x7fbeac0602f0 2020-11-20T12:14:40.196 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 -- 172.21.15.93:0/2732052800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac0602f0 msgr2=0x7fbeac0606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:40.196 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/2732052800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac0602f0 0x7fbeac0606d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fbeac044cc0 tx=0x7fbe9c006ef0).stop 2020-11-20T12:14:40.196 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 -- 172.21.15.93:0/2732052800 shutdown_connections 2020-11-20T12:14:40.197 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/2732052800 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac0602f0 0x7fbeac0606d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.198 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/2732052800 >> v2:172.21.15.66:3300/0 conn(0x7fbeac068580 0x7fbeac0c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.199 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 -- 172.21.15.93:0/2732052800 >> 172.21.15.93:0/2732052800 conn(0x7fbeac0c7790 msgr2=0x7fbeac0c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:40.201 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 -- 172.21.15.93:0/2732052800 shutdown_connections 2020-11-20T12:14:40.201 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.180+0000 7fbeb0b69700 1 -- 172.21.15.93:0/2732052800 wait complete. 2020-11-20T12:14:40.202 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 Processor -- start 2020-11-20T12:14:40.202 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 -- start start 2020-11-20T12:14:40.202 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeac0602f0 0x7fbeac158990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:40.203 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac068580 0x7fbeac0b0680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:40.203 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbeac0c2620 0x7fbeac1517e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:40.203 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac164120 con 0x7fbeac0c2620 2020-11-20T12:14:40.204 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac1643c0 con 0x7fbeac068580 2020-11-20T12:14:40.204 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeb0b69700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeac164660 con 0x7fbeac0602f0 2020-11-20T12:14:40.204 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeaaffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac068580 0x7fbeac0b0680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:40.205 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeaaffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac068580 0x7fbeac0b0680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38956/0 (socket says 172.21.15.93:38956) 2020-11-20T12:14:40.205 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.182+0000 7fbeaaffd700 1 -- 172.21.15.93:0/4050549587 learned_addr learned my addr 172.21.15.93:0/4050549587 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:40.206 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeabfff700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbeac0c2620 0x7fbeac1517e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:40.206 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeaaffd700 1 -- 172.21.15.93:0/4050549587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeac0602f0 msgr2=0x7fbeac158990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeaaffd700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeac0602f0 0x7fbeac158990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeaaffd700 1 -- 172.21.15.93:0/4050549587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbeac0c2620 msgr2=0x7fbeac1517e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeaaffd700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbeac0c2620 0x7fbeac1517e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:40.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeaaffd700 1 -- 172.21.15.93:0/4050549587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeac164900 con 0x7fbeac068580 2020-11-20T12:14:40.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeaaffd700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac068580 0x7fbeac0b0680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbea000eba0 tx=0x7fbea0006dd0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:40.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbe8b7fe700 1 -- 172.21.15.93:0/4050549587 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea000c8c0 con 0x7fbeac068580 2020-11-20T12:14:40.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbe8b7fe700 1 -- 172.21.15.93:0/4050549587 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea000ca20 con 0x7fbeac068580 2020-11-20T12:14:40.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeac164ba0 con 0x7fbeac068580 2020-11-20T12:14:40.210 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbe8b7fe700 1 -- 172.21.15.93:0/4050549587 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea000cda0 con 0x7fbeac068580 2020-11-20T12:14:40.210 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.183+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeac0bf5c0 con 0x7fbeac068580 2020-11-20T12:14:40.210 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.184+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeac061760 con 0x7fbeac068580 2020-11-20T12:14:40.210 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.184+0000 7fbe8b7fe700 1 -- 172.21.15.93:0/4050549587 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbea0012600 con 0x7fbeac068580 2020-11-20T12:14:40.210 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.185+0000 7fbe8b7fe700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbe84080670 0x7fbe84082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:40.211 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.185+0000 7fbe8b7fe700 1 -- 172.21.15.93:0/4050549587 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbea00a2dd0 con 0x7fbeac068580 2020-11-20T12:14:40.211 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.185+0000 7fbeab7fe700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbe84080670 0x7fbe84082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:40.211 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.185+0000 7fbeab7fe700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbe84080670 0x7fbe84082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fbeac044cc0 tx=0x7fbe9c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:40.212 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.188+0000 7fbe8b7fe700 1 -- 172.21.15.93:0/4050549587 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbea00777e0 con 0x7fbeac068580 2020-11-20T12:14:40.377 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:40.374+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) v1 -- 0x7fbeac150130 con 0x7fbeac068580 2020-11-20T12:14:41.053 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.050+0000 7fbe8b7fe700 1 -- 172.21.15.93:0/4050549587 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v6) v1 ==== 115+0+0 (secure 0 0 0) 0x7fbea007ae00 con 0x7fbeac068580 2020-11-20T12:14:41.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbe84080670 msgr2=0x7fbe84082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbe84080670 0x7fbe84082b30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fbeac044cc0 tx=0x7fbe9c016000).stop 2020-11-20T12:14:41.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac068580 msgr2=0x7fbeac0b0680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac068580 0x7fbeac0b0680 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fbea000eba0 tx=0x7fbea0006dd0).stop 2020-11-20T12:14:41.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 shutdown_connections 2020-11-20T12:14:41.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbe84080670 0x7fbe84082b30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbeac0c2620 0x7fbeac1517e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.057 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbeac0602f0 0x7fbeac158990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:41.057 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 --2- 172.21.15.93:0/4050549587 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbeac068580 0x7fbeac0b0680 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.057 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 >> 172.21.15.93:0/4050549587 conn(0x7fbeac0c7790 msgr2=0x7fbeac064130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:41.057 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 shutdown_connections 2020-11-20T12:14:41.057 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.052+0000 7fbeb0b69700 1 -- 172.21.15.93:0/4050549587 wait complete. 2020-11-20T12:14:41.067 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T12:14:41.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.174+0000 7fc0164bf700 1 Processor -- start 2020-11-20T12:14:41.583 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.174+0000 7fc0164bf700 1 -- start start 2020-11-20T12:14:41.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.174+0000 7fc0164bf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc0100c2490 0x7fc0100c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.174+0000 7fc0164bf700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0100bed70 0x7fc010155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.174+0000 7fc0164bf700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc010155a60 con 0x7fc0100c47d0 2020-11-20T12:14:41.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.174+0000 7fc0164bf700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc010151c40 con 0x7fc0100c2490 2020-11-20T12:14:41.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.174+0000 7fc0164bf700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc010151ee0 con 0x7fc0100bed70 2020-11-20T12:14:41.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc0100c2490 0x7fc0100c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc0100c2490 0x7fc0100c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.93:53138/0 (socket says 172.21.15.93:53138) 2020-11-20T12:14:41.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00f7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0100bed70 0x7fc010155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.590 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 -- 172.21.15.93:0/791337432 learned_addr learned my addr 172.21.15.93:0/791337432 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:41.590 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc014a5c700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fc0100c47d0 0x7fc0100676b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39194/0 (socket says 172.21.15.93:39194) 2020-11-20T12:14:41.591 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 -- 172.21.15.93:0/791337432 >> v2:172.21.15.132:3300/0 conn(0x7fc0100bed70 msgr2=0x7fc010155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:41.595 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 --2- 172.21.15.93:0/791337432 >> v2:172.21.15.132:3300/0 conn(0x7fc0100bed70 0x7fc010155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 -- 172.21.15.93:0/791337432 >> v1:172.21.15.66:6789/0 conn(0x7fc0100c47d0 legacy=0x7fc0100676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 -- 172.21.15.93:0/791337432 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010152180 con 0x7fc0100c2490 2020-11-20T12:14:41.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00ffff700 1 --2- 172.21.15.93:0/791337432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 0x7fc0100c2870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc0100be930 tx=0x7fc004006ef0).ready entity=mon.0 client_cookie=d0e8d0e186332c76 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:41.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00effd700 1 -- 172.21.15.93:0/791337432 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400b860 con 0x7fc0100c2490 2020-11-20T12:14:41.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00effd700 1 -- 172.21.15.93:0/791337432 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004000e90 con 0x7fc0100c2490 2020-11-20T12:14:41.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.175+0000 7fc00effd700 1 -- 172.21.15.93:0/791337432 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00400bbd0 con 0x7fc0100c2490 2020-11-20T12:14:41.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 -- 172.21.15.93:0/791337432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 msgr2=0x7fc0100c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 --2- 172.21.15.93:0/791337432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 0x7fc0100c2870 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fc0100be930 tx=0x7fc004006ef0).stop 2020-11-20T12:14:41.598 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 -- 172.21.15.93:0/791337432 shutdown_connections 2020-11-20T12:14:41.599 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 --2- 172.21.15.93:0/791337432 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 0x7fc0100c2870 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.599 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 --2- 172.21.15.93:0/791337432 >> v2:172.21.15.132:3300/0 conn(0x7fc0100bed70 0x7fc010155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.600 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 -- 172.21.15.93:0/791337432 >> 172.21.15.93:0/791337432 conn(0x7fc010060130 msgr2=0x7fc010060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:41.600 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 -- 172.21.15.93:0/791337432 shutdown_connections 2020-11-20T12:14:41.601 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.176+0000 7fc0164bf700 1 -- 172.21.15.93:0/791337432 wait complete. 2020-11-20T12:14:41.601 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.177+0000 7fc0164bf700 1 Processor -- start 2020-11-20T12:14:41.601 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.177+0000 7fc0164bf700 1 -- start start 2020-11-20T12:14:41.601 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc0164bf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0100bed70 0x7fc01014b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.601 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc0164bf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 0x7fc010157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.602 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc0164bf700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0100c47d0 0x7fc0101583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.602 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc0164bf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010160c70 con 0x7fc0100c2490 2020-11-20T12:14:41.602 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc0164bf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc010160f10 con 0x7fc0100bed70 2020-11-20T12:14:41.602 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc0164bf700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0101611b0 con 0x7fc0100c47d0 2020-11-20T12:14:41.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0100bed70 0x7fc01014b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0100bed70 0x7fc01014b150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38966/0 (socket says 172.21.15.93:38966) 2020-11-20T12:14:41.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 -- 172.21.15.93:0/3677727209 learned_addr learned my addr 172.21.15.93:0/3677727209 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:41.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00f7fe700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 0x7fc010157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 -- 172.21.15.93:0/3677727209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0100c47d0 msgr2=0x7fc0101583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.604 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0100c47d0 0x7fc0101583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:41.604 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 -- 172.21.15.93:0/3677727209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 msgr2=0x7fc010157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.604 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 0x7fc010157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.604 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 -- 172.21.15.93:0/3677727209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc010161450 con 0x7fc0100bed70 2020-11-20T12:14:41.604 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fc00ffff700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0100bed70 0x7fc01014b150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc010066310 tx=0x7fc004016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:41.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.178+0000 7fbff7fff700 1 -- 172.21.15.93:0/3677727209 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc004011ae0 con 0x7fc0100bed70 2020-11-20T12:14:41.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.179+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0101616f0 con 0x7fc0100bed70 2020-11-20T12:14:41.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.179+0000 7fbff7fff700 1 -- 172.21.15.93:0/3677727209 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc004011c40 con 0x7fc0100bed70 2020-11-20T12:14:41.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.179+0000 7fbff7fff700 1 -- 172.21.15.93:0/3677727209 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc00401c440 con 0x7fc0100bed70 2020-11-20T12:14:41.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.179+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc01014b640 con 0x7fc0100bed70 2020-11-20T12:14:41.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.179+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc010161b50 con 0x7fc0100bed70 2020-11-20T12:14:41.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.180+0000 7fbff7fff700 1 -- 172.21.15.93:0/3677727209 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc00402c070 con 0x7fc0100bed70 2020-11-20T12:14:41.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.181+0000 7fbff7fff700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbfec080670 0x7fbfec082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.181+0000 7fc00f7fe700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbfec080670 0x7fbfec082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.181+0000 7fbff7fff700 1 -- 172.21.15.93:0/3677727209 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc0040a46f0 con 0x7fc0100bed70 2020-11-20T12:14:41.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.181+0000 7fc00f7fe700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbfec080670 0x7fbfec082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc010158af0 tx=0x7fc000006e30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:41.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.184+0000 7fbff7fff700 1 -- 172.21.15.93:0/3677727209 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc004079180 con 0x7fc0100bed70 2020-11-20T12:14:41.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.368+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc01005cd50 con 0x7fc0100bed70 2020-11-20T12:14:41.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.369+0000 7fbff7fff700 1 -- 172.21.15.93:0/3677727209 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2480 (secure 0 0 0) 0x7fc004020070 con 0x7fc0100bed70 2020-11-20T12:14:41.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbfec080670 msgr2=0x7fbfec082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbfec080670 0x7fbfec082b30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fc010158af0 tx=0x7fc000006e30).stop 2020-11-20T12:14:41.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0100bed70 msgr2=0x7fc01014b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0100bed70 0x7fc01014b150 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fc010066310 tx=0x7fc004016000).stop 2020-11-20T12:14:41.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 shutdown_connections 2020-11-20T12:14:41.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0100c47d0 0x7fc0101583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:41.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc0100bed70 0x7fc01014b150 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbfec080670 0x7fbfec082b30 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 --2- 172.21.15.93:0/3677727209 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc0100c2490 0x7fc010157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 >> 172.21.15.93:0/3677727209 conn(0x7fc010060130 msgr2=0x7fc0100c0fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:41.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 shutdown_connections 2020-11-20T12:14:41.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.370+0000 7fc0164bf700 1 -- 172.21.15.93:0/3677727209 wait complete. 2020-11-20T12:14:41.611 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 6 2020-11-20T12:14:41.611 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:41.611 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3224210757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3224210757},{"type":"v1","addr":"172.21.15.93:6835","nonce":3224210757}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/354762617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":354762617},{"type":"v1","addr":"172.21.15.66:6833","nonce":354762617}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T12:14:39.043063+0000","modified":"2020-11-20T12:14:41.045929+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4307":{"gid":4307,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/208815911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":208815911},{"type":"v1","addr":"172.21.15.132:6833","nonce":208815911}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T12:14:41.612 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:41.728 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.725+0000 7f03e4574700 1 Processor -- start 2020-11-20T12:14:41.729 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.725+0000 7f03e4574700 1 -- start start 2020-11-20T12:14:41.732 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.726+0000 7f03e4574700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03dc064120 0x7f03dc0c0640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.726+0000 7f03e4574700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc0babf0 con 0x7f03dc151240 2020-11-20T12:14:41.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.726+0000 7f03e4574700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03dc0c1220 con 0x7f03dc064500 2020-11-20T12:14:41.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.726+0000 7f03e4574700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03dc0c14c0 con 0x7f03dc064120 2020-11-20T12:14:41.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.726+0000 7f03e1b0f700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f03dc064500 0x7f03dc14e120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39676/0 (socket says 172.21.15.93:39676) 2020-11-20T12:14:41.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2019724631 learned_addr learned my addr 172.21.15.93:0/2019724631 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:41.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 523388958 0 0) 0x7f03dc0c1220 con 0x7f03dc064500 2020-11-20T12:14:41.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e2310700 1 --2- 172.21.15.93:0/2019724631 >> v2:172.21.15.132:3300/0 conn(0x7f03dc064120 0x7f03dc0c0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03c4003280 con 0x7f03dc064500 2020-11-20T12:14:41.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2855102537 0 0) 0x7f03dc0babf0 con 0x7f03dc151240 2020-11-20T12:14:41.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03dc0c1220 con 0x7f03dc151240 2020-11-20T12:14:41.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 97601272 0 0) 0x7f03c4003280 con 0x7f03dc064500 2020-11-20T12:14:41.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 >> v2:172.21.15.132:3300/0 conn(0x7f03dc064120 msgr2=0x7f03dc0c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:41.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 --2- 172.21.15.93:0/2019724631 >> v2:172.21.15.132:3300/0 conn(0x7f03dc064120 0x7f03dc0c0640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 >> v1:172.21.15.66:6789/0 conn(0x7f03dc151240 legacy=0x7f03dc0bb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc0c1760 con 0x7f03dc064500 2020-11-20T12:14:41.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f03cc001520 con 0x7f03dc064500 2020-11-20T12:14:41.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 >> v1:172.21.15.93:6789/0 conn(0x7f03dc064500 legacy=0x7f03dc14e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c4003950 0x7f03c4003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4004520 0x7f03c40049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004e90 0x7f03c400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc0c14c0 con 0x7f03c4004e90 2020-11-20T12:14:41.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c400bc60 con 0x7f03c4004520 2020-11-20T12:14:41.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03c400bda0 con 0x7f03c4003950 2020-11-20T12:14:41.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e1b0f700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4004520 0x7f03c40049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e2b11700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004e90 0x7f03c400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e2310700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c4003950 0x7f03c4003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2019724631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c4003950 msgr2=0x7f03c4003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:41.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e1b0f700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c4003950 0x7f03c4003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2019724631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004e90 msgr2=0x7f03c400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:41.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e1b0f700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004e90 0x7f03c400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e2b11700 1 -- 172.21.15.93:0/2019724631 reap_dead start 2020-11-20T12:14:41.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2019724631 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03c4003280 con 0x7f03c4004520 2020-11-20T12:14:41.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.727+0000 7f03e2310700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03c4003950 0x7f03c4003d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:41.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e1b0f700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4004520 0x7f03c40049a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f03cc00c420 tx=0x7f03dc0c18f0).ready entity=mon.1 client_cookie=15c36f114c546789 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:41.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0070d0 con 0x7f03c4004520 2020-11-20T12:14:41.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc007230 con 0x7f03c4004520 2020-11-20T12:14:41.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e130e700 1 -- 172.21.15.93:0/2019724631 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc005630 con 0x7f03c4004520 2020-11-20T12:14:41.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e4574700 1 -- 172.21.15.93:0/2019724631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4004520 msgr2=0x7f03c40049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e4574700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4004520 0x7f03c40049a0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f03cc00c420 tx=0x7f03dc0c18f0).stop 2020-11-20T12:14:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e4574700 1 -- 172.21.15.93:0/2019724631 shutdown_connections 2020-11-20T12:14:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e4574700 1 --2- 172.21.15.93:0/2019724631 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03c4004520 0x7f03c40049a0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e4574700 1 -- 172.21.15.93:0/2019724631 >> 172.21.15.93:0/2019724631 conn(0x7f03dc060c00 msgr2=0x7f03dc0c5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:41.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e4574700 1 -- 172.21.15.93:0/2019724631 shutdown_connections 2020-11-20T12:14:41.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.728+0000 7f03e4574700 1 -- 172.21.15.93:0/2019724631 wait complete. 2020-11-20T12:14:41.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.729+0000 7f03e4574700 1 Processor -- start 2020-11-20T12:14:41.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.729+0000 7f03e4574700 1 -- start start 2020-11-20T12:14:41.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e4574700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004520 0x7f03dc154aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e4574700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03dc1550c0 0x7f03dc164740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e4574700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03dc152e60 0x7f03dc161c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e4574700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc164c30 con 0x7f03c4004520 2020-11-20T12:14:41.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e4574700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc153b90 con 0x7f03dc1550c0 2020-11-20T12:14:41.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e4574700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03dc153600 con 0x7f03dc152e60 2020-11-20T12:14:41.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03dc1550c0 0x7f03dc164740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03dc1550c0 0x7f03dc164740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38988/0 (socket says 172.21.15.93:38988) 2020-11-20T12:14:41.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2711761480 learned_addr learned my addr 172.21.15.93:0/2711761480 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:41.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e2310700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004520 0x7f03dc154aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e2b11700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03dc152e60 0x7f03dc161c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2711761480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03dc152e60 msgr2=0x7f03dc161c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03dc152e60 0x7f03dc161c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2711761480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004520 msgr2=0x7f03dc154aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004520 0x7f03dc154aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e1b0f700 1 -- 172.21.15.93:0/2711761480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03dc153e20 con 0x7f03dc1550c0 2020-11-20T12:14:41.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.730+0000 7f03e2310700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004520 0x7f03dc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:41.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.731+0000 7f03e1b0f700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03dc1550c0 0x7f03dc164740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f03c4005490 tx=0x7f03cc013000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:41.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.731+0000 7f03ca7fc700 1 -- 172.21.15.93:0/2711761480 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc01b070 con 0x7f03dc1550c0 2020-11-20T12:14:41.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.731+0000 7f03ca7fc700 1 -- 172.21.15.93:0/2711761480 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03cc0073a0 con 0x7f03dc1550c0 2020-11-20T12:14:41.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.731+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03dc1540c0 con 0x7f03dc1550c0 2020-11-20T12:14:41.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.731+0000 7f03ca7fc700 1 -- 172.21.15.93:0/2711761480 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03cc0136a0 con 0x7f03dc1550c0 2020-11-20T12:14:41.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.731+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03dc154600 con 0x7f03dc1550c0 2020-11-20T12:14:41.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.732+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03dc154790 con 0x7f03dc1550c0 2020-11-20T12:14:41.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.732+0000 7f03ca7fc700 1 -- 172.21.15.93:0/2711761480 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f03cc027070 con 0x7f03dc1550c0 2020-11-20T12:14:41.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.733+0000 7f03ca7fc700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03b4080670 0x7f03b4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:41.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.733+0000 7f03e2310700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03b4080670 0x7f03b4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:41.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.733+0000 7f03ca7fc700 1 -- 172.21.15.93:0/2711761480 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f03cc0a31c0 con 0x7f03dc1550c0 2020-11-20T12:14:41.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.733+0000 7f03e2310700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03b4080670 0x7f03b4082b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f03d8006ad0 tx=0x7f03d8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:41.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.737+0000 7f03ca7fc700 1 -- 172.21.15.93:0/2711761480 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f03cc077bd0 con 0x7f03dc1550c0 2020-11-20T12:14:41.880 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.877+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03dc05cd50 con 0x7f03dc1550c0 2020-11-20T12:14:41.882 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.878+0000 7f03ca7fc700 1 -- 172.21.15.93:0/2711761480 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7f03cc001ca0 con 0x7f03dc1550c0 2020-11-20T12:14:41.882 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:41.882 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:41.883 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03b4080670 msgr2=0x7f03b4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.883 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03b4080670 0x7f03b4082b30 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f03d8006ad0 tx=0x7f03d8008040).stop 2020-11-20T12:14:41.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03dc1550c0 msgr2=0x7f03dc164740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:41.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03dc1550c0 0x7f03dc164740 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f03c4005490 tx=0x7f03cc013000).stop 2020-11-20T12:14:41.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 shutdown_connections 2020-11-20T12:14:41.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03dc152e60 0x7f03dc161c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03b4080670 0x7f03b4082b30 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03c4004520 0x7f03dc154aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 --2- 172.21.15.93:0/2711761480 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03dc1550c0 0x7f03dc164740 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:41.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 >> 172.21.15.93:0/2711761480 conn(0x7f03dc060c00 msgr2=0x7f03dc14b300 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:41.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 shutdown_connections 2020-11-20T12:14:41.886 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:41.880+0000 7f03e4574700 1 -- 172.21.15.93:0/2711761480 wait complete. 2020-11-20T12:14:41.895 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:41.896 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-11-20T12:14:42.006 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.003+0000 7f151d5e5700 1 Processor -- start 2020-11-20T12:14:42.007 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.003+0000 7f151d5e5700 1 -- start start 2020-11-20T12:14:42.015 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.003+0000 7f151d5e5700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f15180bed70 0x7f15180c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.015 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.003+0000 7f151d5e5700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1518155570 0x7f1518150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.016 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.003+0000 7f151d5e5700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1518151c40 con 0x7f15180c2490 2020-11-20T12:14:42.016 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.003+0000 7f151d5e5700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1518151ee0 con 0x7f15180bed70 2020-11-20T12:14:42.016 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.003+0000 7f151d5e5700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1518152180 con 0x7f1518155570 2020-11-20T12:14:42.017 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f15180bed70 0x7f15180c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.018 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f15180bed70 0x7f15180c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:38994/0 (socket says 172.21.15.93:38994) 2020-11-20T12:14:42.018 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 -- 172.21.15.93:0/3007782584 learned_addr learned my addr 172.21.15.93:0/3007782584 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:42.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f1516ffd700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f15180c2490 0x7f15180c47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39692/0 (socket says 172.21.15.93:39692) 2020-11-20T12:14:42.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f15177fe700 1 --2- 172.21.15.93:0/3007782584 >> v2:172.21.15.132:3300/0 conn(0x7f1518155570 0x7f1518150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 -- 172.21.15.93:0/3007782584 >> v2:172.21.15.132:3300/0 conn(0x7f1518155570 msgr2=0x7f1518150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 --2- 172.21.15.93:0/3007782584 >> v2:172.21.15.132:3300/0 conn(0x7f1518155570 0x7f1518150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 -- 172.21.15.93:0/3007782584 >> v1:172.21.15.93:6789/0 conn(0x7f15180c2490 legacy=0x7f15180c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 -- 172.21.15.93:0/3007782584 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518152420 con 0x7f15180bed70 2020-11-20T12:14:42.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f15167fc700 1 -- 172.21.15.93:0/3007782584 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4103041949 0 0) 0x7f1518151c40 con 0x7f15180c2490 2020-11-20T12:14:42.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f150ffff700 1 --2- 172.21.15.93:0/3007782584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180bed70 0x7f15180c2870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f15180c1b60 tx=0x7f1500006ef0).ready entity=mon.1 client_cookie=187453701852c91c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f15167fc700 1 -- 172.21.15.93:0/3007782584 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000b860 con 0x7f15180bed70 2020-11-20T12:14:42.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f15167fc700 1 -- 172.21.15.93:0/3007782584 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1500000e90 con 0x7f15180bed70 2020-11-20T12:14:42.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.004+0000 7f15167fc700 1 -- 172.21.15.93:0/3007782584 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150000bbd0 con 0x7f15180bed70 2020-11-20T12:14:42.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 -- 172.21.15.93:0/3007782584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180bed70 msgr2=0x7f15180c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3007782584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180bed70 0x7f15180c2870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f15180c1b60 tx=0x7f1500006ef0).stop 2020-11-20T12:14:42.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 -- 172.21.15.93:0/3007782584 shutdown_connections 2020-11-20T12:14:42.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3007782584 >> v2:172.21.15.132:3300/0 conn(0x7f1518155570 0x7f1518150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3007782584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180bed70 0x7f15180c2870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 -- 172.21.15.93:0/3007782584 >> 172.21.15.93:0/3007782584 conn(0x7f1518060130 msgr2=0x7f1518060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 -- 172.21.15.93:0/3007782584 shutdown_connections 2020-11-20T12:14:42.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.005+0000 7f151d5e5700 1 -- 172.21.15.93:0/3007782584 wait complete. 2020-11-20T12:14:42.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 Processor -- start 2020-11-20T12:14:42.026 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 -- start start 2020-11-20T12:14:42.026 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15180bed70 0x7f15180c8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.026 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180c2490 0x7f15180c6010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.026 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1518155570 0x7f1518149a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518156910 con 0x7f1518155570 2020-11-20T12:14:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518154780 con 0x7f15180c2490 2020-11-20T12:14:42.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.006+0000 7f151d5e5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1518154a20 con 0x7f15180bed70 2020-11-20T12:14:42.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180c2490 0x7f15180c6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180c2490 0x7f15180c6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39002/0 (socket says 172.21.15.93:39002) 2020-11-20T12:14:42.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 -- 172.21.15.93:0/3340141288 learned_addr learned my addr 172.21.15.93:0/3340141288 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:42.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f1516ffd700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15180bed70 0x7f15180c8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 -- 172.21.15.93:0/3340141288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15180bed70 msgr2=0x7f15180c8400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15180bed70 0x7f15180c8400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 -- 172.21.15.93:0/3340141288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1518155570 msgr2=0x7f1518149a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1518155570 0x7f1518149a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:42.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 -- 172.21.15.93:0/3340141288 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1518154cc0 con 0x7f15180c2490 2020-11-20T12:14:42.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f1516ffd700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15180bed70 0x7f15180c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:42.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150ffff700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180c2490 0x7f15180c6010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1500009260 tx=0x7f1500016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150effd700 1 -- 172.21.15.93:0/3340141288 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15000068d0 con 0x7f15180c2490 2020-11-20T12:14:42.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150effd700 1 -- 172.21.15.93:0/3340141288 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1500011cf0 con 0x7f15180c2490 2020-11-20T12:14:42.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1518154f60 con 0x7f15180c2490 2020-11-20T12:14:42.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f150effd700 1 -- 172.21.15.93:0/3340141288 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f150001d6b0 con 0x7f15180c2490 2020-11-20T12:14:42.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.007+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15180c6500 con 0x7f15180c2490 2020-11-20T12:14:42.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.008+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f151805cd50 con 0x7f15180c2490 2020-11-20T12:14:42.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.009+0000 7f150effd700 1 -- 172.21.15.93:0/3340141288 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1500017070 con 0x7f15180c2490 2020-11-20T12:14:42.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.009+0000 7f150effd700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f14f4080670 0x7f14f4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.009+0000 7f150effd700 1 -- 172.21.15.93:0/3340141288 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f15000a4710 con 0x7f15180c2490 2020-11-20T12:14:42.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.009+0000 7f1516ffd700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f14f4080670 0x7f14f4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.035 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.009+0000 7f1516ffd700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f14f4080670 0x7f14f4082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f15180c7d50 tx=0x7f1508007140).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.036 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.012+0000 7f150effd700 1 -- 172.21.15.93:0/3340141288 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1500079120 con 0x7f15180c2490 2020-11-20T12:14:42.156 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.153+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f15181553c0 con 0x7f15180c2490 2020-11-20T12:14:42.157 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.154+0000 7f150effd700 1 -- 172.21.15.93:0/3340141288 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7f1500015070 con 0x7f15180c2490 2020-11-20T12:14:42.158 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:42.158 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:42.161 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f14f4080670 msgr2=0x7f14f4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f14f4080670 0x7f14f4082b30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f15180c7d50 tx=0x7f1508007140).stop 2020-11-20T12:14:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180c2490 msgr2=0x7f15180c6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180c2490 0x7f15180c6010 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f1500009260 tx=0x7f1500016000).stop 2020-11-20T12:14:42.162 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 shutdown_connections 2020-11-20T12:14:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f14f4080670 0x7f14f4082b30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1518155570 0x7f1518149a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f15180bed70 0x7f15180c8400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 --2- 172.21.15.93:0/3340141288 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f15180c2490 0x7f15180c6010 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.163 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 >> 172.21.15.93:0/3340141288 conn(0x7f1518060130 msgr2=0x7f151814e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 shutdown_connections 2020-11-20T12:14:42.164 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.155+0000 7f151d5e5700 1 -- 172.21.15.93:0/3340141288 wait complete. 2020-11-20T12:14:42.170 INFO:tasks.ceph.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:14:19.052710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:28.933013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T12:14:33.975801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T12:14:36.724824+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T12:14:42.171 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:42.285 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.282+0000 7fc5a15cd700 1 Processor -- start 2020-11-20T12:14:42.286 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.282+0000 7fc5a15cd700 1 -- start start 2020-11-20T12:14:42.289 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc5a15cd700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc59c0c2510 0x7fc59c0c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.289 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc5a15cd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fc59c0a0140 0x7fc59c0bedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.290 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc5a15cd700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc59c061d90 con 0x7fc59c151be0 2020-11-20T12:14:42.290 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc5a15cd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c0bf2e0 con 0x7fc59c0a0140 2020-11-20T12:14:42.290 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc5a15cd700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc59c154fb0 con 0x7fc59c0c2510 2020-11-20T12:14:42.290 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc59b7fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fc59c151be0 0x7fc59c152070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39710/0 (socket says 172.21.15.93:39710) 2020-11-20T12:14:42.290 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc59b7fe700 1 -- 172.21.15.93:0/925403608 learned_addr learned my addr 172.21.15.93:0/925403608 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:42.291 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc593fff700 1 --2- 172.21.15.93:0/925403608 >> v2:172.21.15.66:3300/0 conn(0x7fc59c0a0140 0x7fc59c0bedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.291 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1960639142 0 0) 0x7fc59c061d90 con 0x7fc59c151be0 2020-11-20T12:14:42.291 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.283+0000 7fc59affd700 1 --2- 172.21.15.93:0/925403608 >> v2:172.21.15.132:3300/0 conn(0x7fc59c0c2510 0x7fc59c0c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.291 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc57c003280 con 0x7fc59c151be0 2020-11-20T12:14:42.291 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 359008349 0 0) 0x7fc57c003280 con 0x7fc59c151be0 2020-11-20T12:14:42.292 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 >> v2:172.21.15.132:3300/0 conn(0x7fc59c0c2510 msgr2=0x7fc59c0c28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.292 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 --2- 172.21.15.93:0/925403608 >> v2:172.21.15.132:3300/0 conn(0x7fc59c0c2510 0x7fc59c0c28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.292 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 >> v2:172.21.15.66:3300/0 conn(0x7fc59c0a0140 msgr2=0x7fc59c0bedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.292 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 --2- 172.21.15.93:0/925403608 >> v2:172.21.15.66:3300/0 conn(0x7fc59c0a0140 0x7fc59c0bedf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.292 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c155250 con 0x7fc59c151be0 2020-11-20T12:14:42.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7fc5940018a0 con 0x7fc59c151be0 2020-11-20T12:14:42.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 >> v1:172.21.15.93:6789/0 conn(0x7fc59c151be0 legacy=0x7fc59c152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0037c0 0x7fc57c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc57c004520 0x7fc57c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c004e90 0x7fc57c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c0bf2e0 con 0x7fc57c004e90 2020-11-20T12:14:42.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c154fb0 con 0x7fc57c004520 2020-11-20T12:14:42.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57c005340 con 0x7fc57c0037c0 2020-11-20T12:14:42.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc593fff700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc57c004520 0x7fc57c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59affd700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0037c0 0x7fc57c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59b7fe700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c004e90 0x7fc57c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc593fff700 1 -- 172.21.15.93:0/925403608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0037c0 msgr2=0x7fc57c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc593fff700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c0037c0 0x7fc57c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc593fff700 1 -- 172.21.15.93:0/925403608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c004e90 msgr2=0x7fc57c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc593fff700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c004e90 0x7fc57c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc593fff700 1 -- 172.21.15.93:0/925403608 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc57c003280 con 0x7fc57c004520 2020-11-20T12:14:42.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59b7fe700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc57c004e90 0x7fc57c00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:42.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59b7fe700 1 -- 172.21.15.93:0/925403608 reap_dead start 2020-11-20T12:14:42.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc593fff700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc57c004520 0x7fc57c0049a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc584006fd0 tx=0x7fc584006e30).ready entity=mon.1 client_cookie=965d3640a9b75792 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584016070 con 0x7fc57c004520 2020-11-20T12:14:42.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58400b370 con 0x7fc57c004520 2020-11-20T12:14:42.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.284+0000 7fc59a7fc700 1 -- 172.21.15.93:0/925403608 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58400ebe0 con 0x7fc57c004520 2020-11-20T12:14:42.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.285+0000 7fc5a15cd700 1 -- 172.21.15.93:0/925403608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc57c004520 msgr2=0x7fc57c0049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.285+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc57c004520 0x7fc57c0049a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7fc584006fd0 tx=0x7fc584006e30).stop 2020-11-20T12:14:42.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.285+0000 7fc5a15cd700 1 -- 172.21.15.93:0/925403608 shutdown_connections 2020-11-20T12:14:42.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.285+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/925403608 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc57c004520 0x7fc57c0049a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.285+0000 7fc5a15cd700 1 -- 172.21.15.93:0/925403608 >> 172.21.15.93:0/925403608 conn(0x7fc59c060130 msgr2=0x7fc59c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.285+0000 7fc5a15cd700 1 -- 172.21.15.93:0/925403608 shutdown_connections 2020-11-20T12:14:42.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.285+0000 7fc5a15cd700 1 -- 172.21.15.93:0/925403608 wait complete. 2020-11-20T12:14:42.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.286+0000 7fc5a15cd700 1 Processor -- start 2020-11-20T12:14:42.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.286+0000 7fc5a15cd700 1 -- start start 2020-11-20T12:14:42.301 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc5a15cd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c004520 0x7fc59c1533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc5a15cd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc59c147e80 0x7fc59c0c05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc5a15cd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc59c0c0ac0 0x7fc59c146460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc5a15cd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c160c90 con 0x7fc59c0c0ac0 2020-11-20T12:14:42.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc5a15cd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c1538a0 con 0x7fc59c147e80 2020-11-20T12:14:42.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc5a15cd700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc59c160e80 con 0x7fc57c004520 2020-11-20T12:14:42.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc59c147e80 0x7fc59c0c05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc59c147e80 0x7fc59c0c05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39022/0 (socket says 172.21.15.93:39022) 2020-11-20T12:14:42.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 -- 172.21.15.93:0/1203486429 learned_addr learned my addr 172.21.15.93:0/1203486429 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:42.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc59affd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c004520 0x7fc59c1533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc59b7fe700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc59c0c0ac0 0x7fc59c146460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 -- 172.21.15.93:0/1203486429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c004520 msgr2=0x7fc59c1533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c004520 0x7fc59c1533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 -- 172.21.15.93:0/1203486429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc59c0c0ac0 msgr2=0x7fc59c146460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc59c0c0ac0 0x7fc59c146460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 -- 172.21.15.93:0/1203486429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc59c161120 con 0x7fc59c147e80 2020-11-20T12:14:42.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc59b7fe700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc59c0c0ac0 0x7fc59c146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:42.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc593fff700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc59c147e80 0x7fc59c0c05d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc584006e70 tx=0x7fc584018000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc592ffd700 1 -- 172.21.15.93:0/1203486429 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584012d10 con 0x7fc59c147e80 2020-11-20T12:14:42.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.287+0000 7fc592ffd700 1 -- 172.21.15.93:0/1203486429 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc584000e90 con 0x7fc59c147e80 2020-11-20T12:14:42.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.288+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc59c1613c0 con 0x7fc59c147e80 2020-11-20T12:14:42.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.288+0000 7fc592ffd700 1 -- 172.21.15.93:0/1203486429 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc584012e90 con 0x7fc59c147e80 2020-11-20T12:14:42.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.288+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc59c0c10f0 con 0x7fc59c147e80 2020-11-20T12:14:42.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.288+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc59c061b90 con 0x7fc59c147e80 2020-11-20T12:14:42.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.289+0000 7fc592ffd700 1 -- 172.21.15.93:0/1203486429 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fc58402d070 con 0x7fc59c147e80 2020-11-20T12:14:42.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.290+0000 7fc592ffd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc5780806a0 0x7fc578082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.290+0000 7fc59affd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc5780806a0 0x7fc578082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.290+0000 7fc592ffd700 1 -- 172.21.15.93:0/1203486429 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fc5840a44e0 con 0x7fc59c147e80 2020-11-20T12:14:42.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.290+0000 7fc59affd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc5780806a0 0x7fc578082b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc58c006fd0 tx=0x7fc58c008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.293+0000 7fc592ffd700 1 -- 172.21.15.93:0/1203486429 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fc584078ef0 con 0x7fc59c147e80 2020-11-20T12:14:42.438 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.435+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fc59c05cad0 con 0x7fc59c147e80 2020-11-20T12:14:42.439 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.436+0000 7fc592ffd700 1 -- 172.21.15.93:0/1203486429 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7fc58407c510 con 0x7fc59c147e80 2020-11-20T12:14:42.439 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2020-11-20T12:14:42.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc5780806a0 msgr2=0x7fc578082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc5780806a0 0x7fc578082b60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fc58c006fd0 tx=0x7fc58c008040).stop 2020-11-20T12:14:42.442 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc59c147e80 msgr2=0x7fc59c0c05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc59c147e80 0x7fc59c0c05d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fc584006e70 tx=0x7fc584018000).stop 2020-11-20T12:14:42.445 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 shutdown_connections 2020-11-20T12:14:42.447 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fc5780806a0 0x7fc578082b60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.448 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fc59c0c0ac0 0x7fc59c146460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.449 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc57c004520 0x7fc59c1533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 --2- 172.21.15.93:0/1203486429 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fc59c147e80 0x7fc59c0c05d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 >> 172.21.15.93:0/1203486429 conn(0x7fc59c060130 msgr2=0x7fc59c14d370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 shutdown_connections 2020-11-20T12:14:42.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.437+0000 7fc5a15cd700 1 -- 172.21.15.93:0/1203486429 wait complete. 2020-11-20T12:14:42.452 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:42.564 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.561+0000 7fce3759e700 1 Processor -- start 2020-11-20T12:14:42.564 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.561+0000 7fce3759e700 1 -- start start 2020-11-20T12:14:42.566 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce3759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fce380bd810 0x7fce380661c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.567 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce3759e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fce380bc9d0 0x7fce38061240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.567 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce3759e700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce38061fe0 con 0x7fce38065de0 2020-11-20T12:14:42.567 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce3759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3814e020 con 0x7fce380bd810 2020-11-20T12:14:42.567 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce3759e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce3814e2c0 con 0x7fce380bc9d0 2020-11-20T12:14:42.567 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fce380bc9d0 0x7fce38061240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.568 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fce380bc9d0 0x7fce38061240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39032/0 (socket says 172.21.15.93:39032) 2020-11-20T12:14:42.568 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 -- 172.21.15.93:0/2792533363 learned_addr learned my addr 172.21.15.93:0/2792533363 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:42.568 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce35d9b700 1 --2- 172.21.15.93:0/2792533363 >> v2:172.21.15.66:3300/0 conn(0x7fce380bd810 0x7fce380661c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.568 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 -- 172.21.15.93:0/2792533363 >> v2:172.21.15.66:3300/0 conn(0x7fce380bd810 msgr2=0x7fce380661c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.568 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 --2- 172.21.15.93:0/2792533363 >> v2:172.21.15.66:3300/0 conn(0x7fce380bd810 0x7fce380661c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.569 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 -- 172.21.15.93:0/2792533363 >> v1:172.21.15.66:6789/0 conn(0x7fce38065de0 legacy=0x7fce380bd100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.569 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 -- 172.21.15.93:0/2792533363 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce3814e560 con 0x7fce380bc9d0 2020-11-20T12:14:42.569 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.562+0000 7fce36d9d700 1 --2- 172.21.15.93:0/2792533363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bc9d0 0x7fce38061240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fce38064510 tx=0x7fce300092d0).ready entity=mon.1 client_cookie=7af02121ea5fc02d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.569 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3559a700 1 -- 172.21.15.93:0/2792533363 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000bbb0 con 0x7fce380bc9d0 2020-11-20T12:14:42.570 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3559a700 1 -- 172.21.15.93:0/2792533363 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce3000bd10 con 0x7fce380bc9d0 2020-11-20T12:14:42.570 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3559a700 1 -- 172.21.15.93:0/2792533363 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30011610 con 0x7fce380bc9d0 2020-11-20T12:14:42.570 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 -- 172.21.15.93:0/2792533363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bc9d0 msgr2=0x7fce38061240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.570 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 --2- 172.21.15.93:0/2792533363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bc9d0 0x7fce38061240 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fce38064510 tx=0x7fce300092d0).stop 2020-11-20T12:14:42.570 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 -- 172.21.15.93:0/2792533363 shutdown_connections 2020-11-20T12:14:42.571 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 --2- 172.21.15.93:0/2792533363 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bc9d0 0x7fce38061240 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.571 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 --2- 172.21.15.93:0/2792533363 >> v2:172.21.15.66:3300/0 conn(0x7fce380bd810 0x7fce380661c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.571 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 -- 172.21.15.93:0/2792533363 >> 172.21.15.93:0/2792533363 conn(0x7fce38068c50 msgr2=0x7fce380ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.571 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 -- 172.21.15.93:0/2792533363 shutdown_connections 2020-11-20T12:14:42.571 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.563+0000 7fce3759e700 1 -- 172.21.15.93:0/2792533363 wait complete. 2020-11-20T12:14:42.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.564+0000 7fce3759e700 1 Processor -- start 2020-11-20T12:14:42.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.564+0000 7fce3759e700 1 -- start start 2020-11-20T12:14:42.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce3759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce38065de0 0x7fce38140110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce3759e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce380bc9d0 0x7fce380c4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce3759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bd810 0x7fce380bfa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce3759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce38140600 con 0x7fce38065de0 2020-11-20T12:14:42.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce3759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce38150c60 con 0x7fce380bd810 2020-11-20T12:14:42.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce3759e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce38150f00 con 0x7fce380bc9d0 2020-11-20T12:14:42.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bd810 0x7fce380bfa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bd810 0x7fce380bfa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39038/0 (socket says 172.21.15.93:39038) 2020-11-20T12:14:42.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 -- 172.21.15.93:0/2566921076 learned_addr learned my addr 172.21.15.93:0/2566921076 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:42.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce3659c700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce38065de0 0x7fce38140110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 -- 172.21.15.93:0/2566921076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce380bc9d0 msgr2=0x7fce380c4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce380bc9d0 0x7fce380c4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:42.577 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 -- 172.21.15.93:0/2566921076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce38065de0 msgr2=0x7fce38140110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.577 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce38065de0 0x7fce38140110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.577 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 -- 172.21.15.93:0/2566921076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce381511a0 con 0x7fce380bd810 2020-11-20T12:14:42.577 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.565+0000 7fce36d9d700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bd810 0x7fce380bfa90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fce30009130 tx=0x7fce30016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.577 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.566+0000 7fce267fc700 1 -- 172.21.15.93:0/2566921076 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce3000be80 con 0x7fce380bd810 2020-11-20T12:14:42.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.566+0000 7fce267fc700 1 -- 172.21.15.93:0/2566921076 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce30011e30 con 0x7fce380bd810 2020-11-20T12:14:42.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.566+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce380c45c0 con 0x7fce380bd810 2020-11-20T12:14:42.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.566+0000 7fce267fc700 1 -- 172.21.15.93:0/2566921076 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce30010d50 con 0x7fce380bd810 2020-11-20T12:14:42.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.566+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce380c51f0 con 0x7fce380bd810 2020-11-20T12:14:42.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.567+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce380c4a20 con 0x7fce380bd810 2020-11-20T12:14:42.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.567+0000 7fce267fc700 1 -- 172.21.15.93:0/2566921076 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fce30017070 con 0x7fce380bd810 2020-11-20T12:14:42.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.568+0000 7fce267fc700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fce0c080670 0x7fce0c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.568+0000 7fce267fc700 1 -- 172.21.15.93:0/2566921076 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fce300a4de0 con 0x7fce380bd810 2020-11-20T12:14:42.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.568+0000 7fce3659c700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fce0c080670 0x7fce0c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.568+0000 7fce3659c700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fce0c080670 0x7fce0c082b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fce2c002490 tx=0x7fce2c009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.580 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.571+0000 7fce267fc700 1 -- 172.21.15.93:0/2566921076 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fce300797f0 con 0x7fce380bd810 2020-11-20T12:14:42.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.711+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fce38069c70 con 0x7fce380bd810 2020-11-20T12:14:42.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.712+0000 7fce267fc700 1 -- 172.21.15.93:0/2566921076 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7fce30015070 con 0x7fce380bd810 2020-11-20T12:14:42.715 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:42.716 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fce0c080670 msgr2=0x7fce0c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fce0c080670 0x7fce0c082b30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fce2c002490 tx=0x7fce2c009040).stop 2020-11-20T12:14:42.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bd810 msgr2=0x7fce380bfa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bd810 0x7fce380bfa90 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fce30009130 tx=0x7fce30016000).stop 2020-11-20T12:14:42.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 shutdown_connections 2020-11-20T12:14:42.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fce380bd810 0x7fce380bfa90 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fce0c080670 0x7fce0c082b30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fce38065de0 0x7fce38140110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 --2- 172.21.15.93:0/2566921076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fce380bc9d0 0x7fce380c4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:42.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 >> 172.21.15.93:0/2566921076 conn(0x7fce38068c50 msgr2=0x7fce38060640 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.719 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 shutdown_connections 2020-11-20T12:14:42.719 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.713+0000 7fce3759e700 1 -- 172.21.15.93:0/2566921076 wait complete. 2020-11-20T12:14:42.728 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T12:14:42.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 Processor -- start 2020-11-20T12:14:42.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 -- start start 2020-11-20T12:14:42.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa1900c42d0 0x7fa190064820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1900c46b0 0x7fa1900c22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa190151150 0x7fa1901515c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa190151ab0 con 0x7fa190151150 2020-11-20T12:14:42.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa190151cf0 con 0x7fa1900c42d0 2020-11-20T12:14:42.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.837+0000 7fa196ac4700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa190151f90 con 0x7fa1900c46b0 2020-11-20T12:14:42.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa1900c42d0 0x7fa190064820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa1900c42d0 0x7fa190064820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39042/0 (socket says 172.21.15.93:39042) 2020-11-20T12:14:42.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 -- 172.21.15.93:0/4292771006 learned_addr learned my addr 172.21.15.93:0/4292771006 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:42.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa18ffff700 1 --2- 172.21.15.93:0/4292771006 >> v2:172.21.15.132:3300/0 conn(0x7fa1900c46b0 0x7fa1900c22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 -- 172.21.15.93:0/4292771006 >> v2:172.21.15.132:3300/0 conn(0x7fa1900c46b0 msgr2=0x7fa1900c22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 --2- 172.21.15.93:0/4292771006 >> v2:172.21.15.132:3300/0 conn(0x7fa1900c46b0 0x7fa1900c22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 -- 172.21.15.93:0/4292771006 >> v2:172.21.15.66:3300/0 conn(0x7fa190151150 msgr2=0x7fa1901515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:42.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 --2- 172.21.15.93:0/4292771006 >> v2:172.21.15.66:3300/0 conn(0x7fa190151150 0x7fa1901515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:42.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 -- 172.21.15.93:0/4292771006 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190063900 con 0x7fa1900c42d0 2020-11-20T12:14:42.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa18ffff700 1 --2- 172.21.15.93:0/4292771006 >> v2:172.21.15.132:3300/0 conn(0x7fa1900c46b0 0x7fa1900c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:42.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa194860700 1 --2- 172.21.15.93:0/4292771006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1900c42d0 0x7fa190064820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa1900c8940 tx=0x7fa184006ef0).ready entity=mon.1 client_cookie=ac22213a38e10685 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa18f7fe700 1 -- 172.21.15.93:0/4292771006 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400b8c0 con 0x7fa1900c42d0 2020-11-20T12:14:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa18f7fe700 1 -- 172.21.15.93:0/4292771006 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa184000e90 con 0x7fa1900c42d0 2020-11-20T12:14:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa18f7fe700 1 -- 172.21.15.93:0/4292771006 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18400bc30 con 0x7fa1900c42d0 2020-11-20T12:14:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa196ac4700 1 -- 172.21.15.93:0/4292771006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1900c42d0 msgr2=0x7fa190064820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.838+0000 7fa196ac4700 1 --2- 172.21.15.93:0/4292771006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1900c42d0 0x7fa190064820 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7fa1900c8940 tx=0x7fa184006ef0).stop 2020-11-20T12:14:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.839+0000 7fa196ac4700 1 -- 172.21.15.93:0/4292771006 shutdown_connections 2020-11-20T12:14:42.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.839+0000 7fa196ac4700 1 --2- 172.21.15.93:0/4292771006 >> v2:172.21.15.66:3300/0 conn(0x7fa190151150 0x7fa1901515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:42.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.839+0000 7fa196ac4700 1 --2- 172.21.15.93:0/4292771006 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa1900c42d0 0x7fa190064820 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.839+0000 7fa196ac4700 1 --2- 172.21.15.93:0/4292771006 >> v2:172.21.15.132:3300/0 conn(0x7fa1900c46b0 0x7fa1900c22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.839+0000 7fa196ac4700 1 -- 172.21.15.93:0/4292771006 >> 172.21.15.93:0/4292771006 conn(0x7fa190060130 msgr2=0x7fa190060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.839+0000 7fa196ac4700 1 -- 172.21.15.93:0/4292771006 shutdown_connections 2020-11-20T12:14:42.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.839+0000 7fa196ac4700 1 -- 172.21.15.93:0/4292771006 wait complete. 2020-11-20T12:14:42.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.840+0000 7fa196ac4700 1 Processor -- start 2020-11-20T12:14:42.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.840+0000 7fa196ac4700 1 -- start start 2020-11-20T12:14:42.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1900c42d0 0x7fa19014a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900c46b0 0x7fa19014fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa190151150 0x7fa190150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1900c0b10 con 0x7fa1900c46b0 2020-11-20T12:14:42.852 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190163ea0 con 0x7fa190151150 2020-11-20T12:14:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa190164140 con 0x7fa1900c42d0 2020-11-20T12:14:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa190151150 0x7fa190150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa190151150 0x7fa190150190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39052/0 (socket says 172.21.15.93:39052) 2020-11-20T12:14:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 -- 172.21.15.93:0/1640778616 learned_addr learned my addr 172.21.15.93:0/1640778616 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:42.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa194860700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1900c42d0 0x7fa19014a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa18ffff700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900c46b0 0x7fa19014fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 -- 172.21.15.93:0/1640778616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1900c42d0 msgr2=0x7fa19014a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1900c42d0 0x7fa19014a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 -- 172.21.15.93:0/1640778616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900c46b0 msgr2=0x7fa19014fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900c46b0 0x7fa19014fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 -- 172.21.15.93:0/1640778616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1901643e0 con 0x7fa190151150 2020-11-20T12:14:42.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa195061700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa190151150 0x7fa190150190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa18800bac0 tx=0x7fa188009270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa18cff9700 1 -- 172.21.15.93:0/1640778616 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800c900 con 0x7fa190151150 2020-11-20T12:14:42.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa18cff9700 1 -- 172.21.15.93:0/1640778616 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa18800ca60 con 0x7fa190151150 2020-11-20T12:14:42.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa190164680 con 0x7fa190151150 2020-11-20T12:14:42.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa18cff9700 1 -- 172.21.15.93:0/1640778616 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa18800cc10 con 0x7fa190151150 2020-11-20T12:14:42.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.841+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa190164bc0 con 0x7fa190151150 2020-11-20T12:14:42.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.842+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1900c0c80 con 0x7fa190151150 2020-11-20T12:14:42.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.843+0000 7fa18cff9700 1 -- 172.21.15.93:0/1640778616 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa18801c070 con 0x7fa190151150 2020-11-20T12:14:42.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.843+0000 7fa18cff9700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa1680806a0 0x7fa168082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:42.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.844+0000 7fa18cff9700 1 -- 172.21.15.93:0/1640778616 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa1880a2360 con 0x7fa190151150 2020-11-20T12:14:42.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.844+0000 7fa194860700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa1680806a0 0x7fa168082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:42.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.844+0000 7fa194860700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa1680806a0 0x7fa168082b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa184006f30 tx=0x7fa184016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:42.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.847+0000 7fa18cff9700 1 -- 172.21.15.93:0/1640778616 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa188076cf0 con 0x7fa190151150 2020-11-20T12:14:42.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.986+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa19005cad0 con 0x7fa190151150 2020-11-20T12:14:42.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.986+0000 7fa18cff9700 1 -- 172.21.15.93:0/1640778616 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7fa18801a030 con 0x7fa190151150 2020-11-20T12:14:42.990 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:42.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa1680806a0 msgr2=0x7fa168082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa1680806a0 0x7fa168082b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fa184006f30 tx=0x7fa184016000).stop 2020-11-20T12:14:42.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa190151150 msgr2=0x7fa190150190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:42.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa190151150 0x7fa190150190 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7fa18800bac0 tx=0x7fa188009270).stop 2020-11-20T12:14:42.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 shutdown_connections 2020-11-20T12:14:42.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa190151150 0x7fa190150190 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1900c42d0 0x7fa19014a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa1680806a0 0x7fa168082b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 --2- 172.21.15.93:0/1640778616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa1900c46b0 0x7fa19014fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:42.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 >> 172.21.15.93:0/1640778616 conn(0x7fa190060130 msgr2=0x7fa19014b250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:42.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 shutdown_connections 2020-11-20T12:14:42.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:42.988+0000 7fa196ac4700 1 -- 172.21.15.93:0/1640778616 wait complete. 2020-11-20T12:14:43.003 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T12:14:43.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.114+0000 7facd24ac700 1 Processor -- start 2020-11-20T12:14:43.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.114+0000 7facd24ac700 1 -- start start 2020-11-20T12:14:43.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd24ac700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faccc1522f0 0x7faccc0c28f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd24ac700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc061d90 con 0x7faccc0a0140 2020-11-20T12:14:43.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd24ac700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faccc154fb0 con 0x7faccc0c2510 2020-11-20T12:14:43.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd24ac700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faccc155250 con 0x7faccc1522f0 2020-11-20T12:14:43.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd0a49700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7faccc1522f0 0x7faccc0c28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7faccb7fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7faccc0a0140 0x7faccc150690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39754/0 (socket says 172.21.15.93:39754) 2020-11-20T12:14:43.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7faccb7fe700 1 -- 172.21.15.93:0/3754509655 learned_addr learned my addr 172.21.15.93:0/3754509655 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:43.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd0a49700 1 -- 172.21.15.93:0/3754509655 >> v1:172.21.15.132:6789/0 conn(0x7faccc0c2510 legacy=0x7faccc151be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:43.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd0a49700 1 -- 172.21.15.93:0/3754509655 >> v1:172.21.15.93:6789/0 conn(0x7faccc0a0140 legacy=0x7faccc150690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7faccaffd700 1 -- 172.21.15.93:0/3754509655 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779060838 0 0) 0x7faccc061d90 con 0x7faccc0a0140 2020-11-20T12:14:43.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.115+0000 7facd0a49700 1 -- 172.21.15.93:0/3754509655 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc1554f0 con 0x7faccc1522f0 2020-11-20T12:14:43.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd0a49700 1 --2- 172.21.15.93:0/3754509655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc0c28f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7facc4009ce0 tx=0x7facc4009220).ready entity=mon.1 client_cookie=330b79c5a0a2c04 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7faccaffd700 1 -- 172.21.15.93:0/3754509655 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400bbb0 con 0x7faccc1522f0 2020-11-20T12:14:43.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7faccaffd700 1 -- 172.21.15.93:0/3754509655 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc400bd10 con 0x7faccc1522f0 2020-11-20T12:14:43.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7faccaffd700 1 -- 172.21.15.93:0/3754509655 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4011610 con 0x7faccc1522f0 2020-11-20T12:14:43.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd24ac700 1 -- 172.21.15.93:0/3754509655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 msgr2=0x7faccc0c28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd24ac700 1 --2- 172.21.15.93:0/3754509655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc0c28f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7facc4009ce0 tx=0x7facc4009220).stop 2020-11-20T12:14:43.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd24ac700 1 -- 172.21.15.93:0/3754509655 shutdown_connections 2020-11-20T12:14:43.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd24ac700 1 --2- 172.21.15.93:0/3754509655 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc0c28f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd24ac700 1 -- 172.21.15.93:0/3754509655 >> 172.21.15.93:0/3754509655 conn(0x7faccc060130 msgr2=0x7faccc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:43.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd24ac700 1 -- 172.21.15.93:0/3754509655 shutdown_connections 2020-11-20T12:14:43.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.116+0000 7facd24ac700 1 -- 172.21.15.93:0/3754509655 wait complete. 2020-11-20T12:14:43.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.117+0000 7facd24ac700 1 Processor -- start 2020-11-20T12:14:43.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd24ac700 1 -- start start 2020-11-20T12:14:43.127 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd24ac700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faccc0a0140 0x7faccc0c58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.127 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd24ac700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faccc0c2510 0x7faccc142890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.127 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd24ac700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc163d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.127 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd24ac700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0bffe0 con 0x7faccc0c2510 2020-11-20T12:14:43.127 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd24ac700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0c7710 con 0x7faccc1522f0 2020-11-20T12:14:43.128 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd24ac700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faccc0c79b0 con 0x7faccc0a0140 2020-11-20T12:14:43.128 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd0a49700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc163d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.128 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd0a49700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc163d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39064/0 (socket says 172.21.15.93:39064) 2020-11-20T12:14:43.128 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.118+0000 7facd0a49700 1 -- 172.21.15.93:0/465055228 learned_addr learned my addr 172.21.15.93:0/465055228 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:43.128 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7faccbfff700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faccc0a0140 0x7faccc0c58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd0a49700 1 -- 172.21.15.93:0/465055228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faccc0a0140 msgr2=0x7faccc0c58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd0a49700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faccc0a0140 0x7faccc0c58b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7faccb7fe700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faccc0c2510 0x7faccc142890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd0a49700 1 -- 172.21.15.93:0/465055228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faccc0c2510 msgr2=0x7faccc142890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd0a49700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faccc0c2510 0x7faccc142890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd0a49700 1 -- 172.21.15.93:0/465055228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc0c0210 con 0x7faccc1522f0 2020-11-20T12:14:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd0a49700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc163d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7facc4011000 tx=0x7facc4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facabfff700 1 -- 172.21.15.93:0/465055228 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc400be80 con 0x7faccc1522f0 2020-11-20T12:14:43.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facabfff700 1 -- 172.21.15.93:0/465055228 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facc4009e20 con 0x7faccc1522f0 2020-11-20T12:14:43.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faccc0c04b0 con 0x7faccc1522f0 2020-11-20T12:14:43.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facabfff700 1 -- 172.21.15.93:0/465055228 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facc4010e10 con 0x7faccc1522f0 2020-11-20T12:14:43.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.119+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faccc142d80 con 0x7faccc1522f0 2020-11-20T12:14:43.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.120+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faccc061b90 con 0x7faccc1522f0 2020-11-20T12:14:43.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.121+0000 7facabfff700 1 -- 172.21.15.93:0/465055228 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7facc402a070 con 0x7faccc1522f0 2020-11-20T12:14:43.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.121+0000 7facabfff700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7faca4080670 0x7faca4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.121+0000 7faccbfff700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7faca4080670 0x7faca4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.121+0000 7facabfff700 1 -- 172.21.15.93:0/465055228 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7facc40a4d90 con 0x7faccc1522f0 2020-11-20T12:14:43.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.121+0000 7faccbfff700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7faca4080670 0x7faca4082b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7facbc0035b0 tx=0x7facbc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.133 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.124+0000 7facabfff700 1 -- 172.21.15.93:0/465055228 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7facc40a9070 con 0x7faccc1522f0 2020-11-20T12:14:43.268 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.265+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faccc0c0910 con 0x7faccc1522f0 2020-11-20T12:14:43.269 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.266+0000 7facabfff700 1 -- 172.21.15.93:0/465055228 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7facc4015030 con 0x7faccc1522f0 2020-11-20T12:14:43.270 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:43.271 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7faca4080670 msgr2=0x7faca4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.271 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7faca4080670 0x7faca4082b30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7facbc0035b0 tx=0x7facbc009040).stop 2020-11-20T12:14:43.271 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 msgr2=0x7faccc163d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.272 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc163d10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7facc4011000 tx=0x7facc4016000).stop 2020-11-20T12:14:43.272 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 shutdown_connections 2020-11-20T12:14:43.272 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7faccc1522f0 0x7faccc163d10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.272 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faccc0a0140 0x7faccc0c58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.273 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7faca4080670 0x7faca4082b30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.273 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 --2- 172.21.15.93:0/465055228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7faccc0c2510 0x7faccc142890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.273 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 >> 172.21.15.93:0/465055228 conn(0x7faccc060130 msgr2=0x7faccc0621c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:43.273 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 shutdown_connections 2020-11-20T12:14:43.273 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.267+0000 7facd24ac700 1 -- 172.21.15.93:0/465055228 wait complete. 2020-11-20T12:14:43.281 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-11-20T12:14:43.282 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-11-20T12:14:43.282 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2020-11-20T12:14:43.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.388+0000 7f3fd49c9700 1 Processor -- start 2020-11-20T12:14:43.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.388+0000 7f3fd49c9700 1 -- start start 2020-11-20T12:14:43.393 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fd49c9700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3fd00c2490 0x7f3fd00c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.394 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fd49c9700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3fd00bed70 0x7f3fd0155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.394 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fd49c9700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fd0155a60 con 0x7f3fd00c47d0 2020-11-20T12:14:43.394 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fd49c9700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd0151c40 con 0x7f3fd00bed70 2020-11-20T12:14:43.394 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fd49c9700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fd0151ee0 con 0x7f3fd00c2490 2020-11-20T12:14:43.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fce59c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3fd00c2490 0x7f3fd00c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fce59c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3fd00c2490 0x7f3fd00c2870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39070/0 (socket says 172.21.15.93:39070) 2020-11-20T12:14:43.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fce59c700 1 -- 172.21.15.93:0/616113307 learned_addr learned my addr 172.21.15.93:0/616113307 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:43.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fce59c700 1 -- 172.21.15.93:0/616113307 >> v2:172.21.15.66:3300/0 conn(0x7f3fd00bed70 msgr2=0x7f3fd0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:43.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fce59c700 1 --2- 172.21.15.93:0/616113307 >> v2:172.21.15.66:3300/0 conn(0x7f3fd00bed70 0x7f3fd0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:43.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fce59c700 1 -- 172.21.15.93:0/616113307 >> v1:172.21.15.132:6789/0 conn(0x7f3fd00c47d0 legacy=0x7f3fd00676b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:43.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.389+0000 7f3fce59c700 1 -- 172.21.15.93:0/616113307 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0152180 con 0x7f3fd00c2490 2020-11-20T12:14:43.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fce59c700 1 --2- 172.21.15.93:0/616113307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd00c2870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3fd00617b0 tx=0x7f3fc0006ef0).ready entity=mon.1 client_cookie=2108ad34fd24d581 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fcd59a700 1 -- 172.21.15.93:0/616113307 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000b820 con 0x7f3fd00c2490 2020-11-20T12:14:43.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fcd59a700 1 -- 172.21.15.93:0/616113307 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc0000e90 con 0x7f3fd00c2490 2020-11-20T12:14:43.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fcd59a700 1 -- 172.21.15.93:0/616113307 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000bb90 con 0x7f3fd00c2490 2020-11-20T12:14:43.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 -- 172.21.15.93:0/616113307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 msgr2=0x7f3fd00c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/616113307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd00c2870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3fd00617b0 tx=0x7f3fc0006ef0).stop 2020-11-20T12:14:43.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 -- 172.21.15.93:0/616113307 shutdown_connections 2020-11-20T12:14:43.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/616113307 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd00c2870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/616113307 >> v2:172.21.15.66:3300/0 conn(0x7f3fd00bed70 0x7f3fd0155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:43.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 -- 172.21.15.93:0/616113307 >> 172.21.15.93:0/616113307 conn(0x7f3fd0060130 msgr2=0x7f3fd0060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:43.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 -- 172.21.15.93:0/616113307 shutdown_connections 2020-11-20T12:14:43.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.390+0000 7f3fd49c9700 1 -- 172.21.15.93:0/616113307 wait complete. 2020-11-20T12:14:43.401 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.391+0000 7f3fd49c9700 1 Processor -- start 2020-11-20T12:14:43.401 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.391+0000 7f3fd49c9700 1 -- start start 2020-11-20T12:14:43.402 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fd49c9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd00bed70 0x7f3fd014a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.402 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fd49c9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd0153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.402 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fd49c9700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd00c47d0 0x7f3fd0154450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.402 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fd49c9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01652c0 con 0x7f3fd00bed70 2020-11-20T12:14:43.403 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fd49c9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd01645a0 con 0x7f3fd00c2490 2020-11-20T12:14:43.403 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fd49c9700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd0164840 con 0x7f3fd00c47d0 2020-11-20T12:14:43.403 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd0153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.403 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd0153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39074/0 (socket says 172.21.15.93:39074) 2020-11-20T12:14:43.403 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 -- 172.21.15.93:0/2718516549 learned_addr learned my addr 172.21.15.93:0/2718516549 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:43.404 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fced9d700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd00c47d0 0x7f3fd0154450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.404 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fce59c700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd00bed70 0x7f3fd014a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.404 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 -- 172.21.15.93:0/2718516549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd00c47d0 msgr2=0x7f3fd0154450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.404 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd00c47d0 0x7f3fd0154450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.404 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 -- 172.21.15.93:0/2718516549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd00bed70 msgr2=0x7f3fd014a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.405 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd00bed70 0x7f3fd014a9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.405 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fcdd9b700 1 -- 172.21.15.93:0/2718516549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd0164ae0 con 0x7f3fd00c2490 2020-11-20T12:14:43.405 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.392+0000 7f3fced9d700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd00c47d0 0x7f3fd0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:43.405 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.393+0000 7f3fcdd9b700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd0153f60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3fc40096b0 tx=0x7f3fc4006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.406 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.393+0000 7f3fbe7fc700 1 -- 172.21.15.93:0/2718516549 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400d500 con 0x7f3fd00c2490 2020-11-20T12:14:43.406 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.393+0000 7f3fbe7fc700 1 -- 172.21.15.93:0/2718516549 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc400d680 con 0x7f3fd00c2490 2020-11-20T12:14:43.406 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.393+0000 7f3fbe7fc700 1 -- 172.21.15.93:0/2718516549 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc400da40 con 0x7f3fd00c2490 2020-11-20T12:14:43.406 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.393+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fd0164d80 con 0x7f3fd00c2490 2020-11-20T12:14:43.406 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.393+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fd0148990 con 0x7f3fd00c2490 2020-11-20T12:14:43.407 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.394+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd005cd50 con 0x7f3fd00c2490 2020-11-20T12:14:43.407 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.394+0000 7f3fbe7fc700 1 -- 172.21.15.93:0/2718516549 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3fc4012420 con 0x7f3fd00c2490 2020-11-20T12:14:43.407 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.395+0000 7f3fbe7fc700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3fa4080670 0x7f3fa4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.407 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.395+0000 7f3fbe7fc700 1 -- 172.21.15.93:0/2718516549 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3fc40a2a20 con 0x7f3fd00c2490 2020-11-20T12:14:43.407 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.395+0000 7f3fce59c700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3fa4080670 0x7f3fa4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.408 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.395+0000 7f3fce59c700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3fa4080670 0x7f3fa4082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f3fc000c010 tx=0x7f3fc0016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.408 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.398+0000 7f3fbe7fc700 1 -- 172.21.15.93:0/2718516549 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3fc40773d0 con 0x7f3fd00c2490 2020-11-20T12:14:43.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.572+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f3fd00c3150 con 0x7f3fd00c2490 2020-11-20T12:14:43.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.576+0000 7f3fbe7fc700 1 -- 172.21.15.93:0/2718516549 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+202039 (secure 0 0 0) 0x7f3fc400ddb0 con 0x7f3fd00c2490 2020-11-20T12:14:43.582 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:43.583 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3fa4080670 msgr2=0x7f3fa4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.583 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3fa4080670 0x7f3fa4082b30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f3fc000c010 tx=0x7f3fc0016000).stop 2020-11-20T12:14:43.583 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 msgr2=0x7f3fd0153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd0153f60 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f3fc40096b0 tx=0x7f3fc4006e30).stop 2020-11-20T12:14:43.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 shutdown_connections 2020-11-20T12:14:43.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3fd00c47d0 0x7f3fd0154450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3fa4080670 0x7f3fa4082b30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3fd00bed70 0x7f3fd014a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 --2- 172.21.15.93:0/2718516549 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3fd00c2490 0x7f3fd0153f60 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 >> 172.21.15.93:0/2718516549 conn(0x7f3fd0060130 msgr2=0x7f3fd00bfe70 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:43.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 shutdown_connections 2020-11-20T12:14:43.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.578+0000 7f3fd49c9700 1 -- 172.21.15.93:0/2718516549 wait complete. 2020-11-20T12:14:43.592 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":4,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6800","nonce":22895},{"type":"v1","addr":"172.21.15.93:6801","nonce":22895}]},"active_addr":"172.21.15.93:6801/22895","active_change":"2020-11-20T12:14:19.006529+0000","active_mgr_features":4540138297136906239,"available":true,"standbys":[{"gid":4106,"name":"z","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4110,"name":"y","mgr_features":4540138297136906239,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/alertmanager:v0.20.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"docker.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"docker.io/ceph/ceph-grafana:6.6.2","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/node-exporter:v0.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"docker.io/prom/prometheus:v2.18.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository password","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository url","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"Custom repository username","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_nfs":{"name":"FEATURE_TOGGLE_nfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":3971785116}]},{"addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":1770824305}]},{"addrvec":[{"type":"v2","addr":"172.21.15.93:0","nonce":2782985345}]}]}} 2020-11-20T12:14:43.632 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-11-20T12:14:43.632 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-11-20T12:14:43.632 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:43.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.741+0000 7f179a4fd700 1 Processor -- start 2020-11-20T12:14:43.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.741+0000 7f179a4fd700 1 -- start start 2020-11-20T12:14:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.742+0000 7f179a4fd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f17940c2490 0x7f17940c2870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.742+0000 7f179a4fd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1794151c40 con 0x7f1794155570 2020-11-20T12:14:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.742+0000 7f179a4fd700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1794151ee0 con 0x7f17940bed70 2020-11-20T12:14:43.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.742+0000 7f179a4fd700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1794152180 con 0x7f17940c2490 2020-11-20T12:14:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.742+0000 7f1793fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f17940c2490 0x7f17940c2870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.742+0000 7f17937fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f17940bed70 0x7f17940c47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39780/0 (socket says 172.21.15.93:39780) 2020-11-20T12:14:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.742+0000 7f17937fe700 1 -- 172.21.15.93:0/3117677636 learned_addr learned my addr 172.21.15.93:0/3117677636 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f1793fff700 1 -- 172.21.15.93:0/3117677636 >> v1:172.21.15.93:6789/0 conn(0x7f17940bed70 legacy=0x7f17940c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f1793fff700 1 -- 172.21.15.93:0/3117677636 >> v1:172.21.15.66:6789/0 conn(0x7f1794155570 legacy=0x7f1794150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:43.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f1793fff700 1 -- 172.21.15.93:0/3117677636 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1794152420 con 0x7f17940c2490 2020-11-20T12:14:43.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f1793fff700 1 --2- 172.21.15.93:0/3117677636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f17940c2870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1784006fd0 tx=0x7f1784006e30).ready entity=mon.1 client_cookie=c6bdbc0b8a159a2c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f1792ffd700 1 -- 172.21.15.93:0/3117677636 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17840097a0 con 0x7f17940c2490 2020-11-20T12:14:43.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f1792ffd700 1 -- 172.21.15.93:0/3117677636 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1784000e90 con 0x7f17940c2490 2020-11-20T12:14:43.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f1792ffd700 1 -- 172.21.15.93:0/3117677636 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1784009b10 con 0x7f17940c2490 2020-11-20T12:14:43.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f179a4fd700 1 -- 172.21.15.93:0/3117677636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 msgr2=0x7f17940c2870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f179a4fd700 1 --2- 172.21.15.93:0/3117677636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f17940c2870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f1784006fd0 tx=0x7f1784006e30).stop 2020-11-20T12:14:43.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f179a4fd700 1 -- 172.21.15.93:0/3117677636 shutdown_connections 2020-11-20T12:14:43.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f179a4fd700 1 --2- 172.21.15.93:0/3117677636 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f17940c2870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f179a4fd700 1 -- 172.21.15.93:0/3117677636 >> 172.21.15.93:0/3117677636 conn(0x7f1794060130 msgr2=0x7f1794060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:43.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f179a4fd700 1 -- 172.21.15.93:0/3117677636 shutdown_connections 2020-11-20T12:14:43.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.743+0000 7f179a4fd700 1 -- 172.21.15.93:0/3117677636 wait complete. 2020-11-20T12:14:43.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.744+0000 7f179a4fd700 1 Processor -- start 2020-11-20T12:14:43.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f179a4fd700 1 -- start start 2020-11-20T12:14:43.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f179a4fd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940bed70 0x7f17940c8090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f179a4fd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f1794062730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f179a4fd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794155570 0x7f17941610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f179a4fd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940c5c50 con 0x7f1794155570 2020-11-20T12:14:43.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f179a4fd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940c5ef0 con 0x7f17940c2490 2020-11-20T12:14:43.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f179a4fd700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17940c76a0 con 0x7f17940bed70 2020-11-20T12:14:43.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f17937fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f1794062730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.745+0000 7f17937fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f1794062730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39088/0 (socket says 172.21.15.93:39088) 2020-11-20T12:14:43.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f17937fe700 1 -- 172.21.15.93:0/2825980442 learned_addr learned my addr 172.21.15.93:0/2825980442 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:43.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f1798a9a700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794155570 0x7f17941610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f17937fe700 1 -- 172.21.15.93:0/2825980442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940bed70 msgr2=0x7f17940c8090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f17937fe700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940bed70 0x7f17940c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:43.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f17937fe700 1 -- 172.21.15.93:0/2825980442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794155570 msgr2=0x7f17941610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f17937fe700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794155570 0x7f17941610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f17937fe700 1 -- 172.21.15.93:0/2825980442 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17940c7940 con 0x7f17940c2490 2020-11-20T12:14:43.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f17937fe700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f1794062730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f178800c710 tx=0x7f1788007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f1773fff700 1 -- 172.21.15.93:0/2825980442 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788007320 con 0x7f17940c2490 2020-11-20T12:14:43.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f1773fff700 1 -- 172.21.15.93:0/2825980442 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788007480 con 0x7f17940c2490 2020-11-20T12:14:43.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1794160c00 con 0x7f17940c2490 2020-11-20T12:14:43.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f1773fff700 1 -- 172.21.15.93:0/2825980442 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788005860 con 0x7f17940c2490 2020-11-20T12:14:43.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.746+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17940c7c40 con 0x7f17940c2490 2020-11-20T12:14:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.747+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1794164f20 con 0x7f17940c2490 2020-11-20T12:14:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.748+0000 7f1773fff700 1 -- 172.21.15.93:0/2825980442 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1788010030 con 0x7f17940c2490 2020-11-20T12:14:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.748+0000 7f1773fff700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f176c080670 0x7f176c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.748+0000 7f1773fff700 1 -- 172.21.15.93:0/2825980442 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f17880a26c0 con 0x7f17940c2490 2020-11-20T12:14:43.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.748+0000 7f1793fff700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f176c080670 0x7f176c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:43.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.748+0000 7f1793fff700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f176c080670 0x7f176c082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1784006e70 tx=0x7f1784015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:43.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.751+0000 7f1773fff700 1 -- 172.21.15.93:0/2825980442 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1788077050 con 0x7f17940c2490 2020-11-20T12:14:43.894 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.891+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1794160d90 con 0x7f17940c2490 2020-11-20T12:14:43.895 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.892+0000 7f1773fff700 1 -- 172.21.15.93:0/2825980442 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7f178807a670 con 0x7f17940c2490 2020-11-20T12:14:43.896 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:43.896 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:43.897 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f176c080670 msgr2=0x7f176c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.897 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f176c080670 0x7f176c082b30 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f1784006e70 tx=0x7f1784015000).stop 2020-11-20T12:14:43.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 msgr2=0x7f1794062730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:43.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f1794062730 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f178800c710 tx=0x7f1788007c70).stop 2020-11-20T12:14:43.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 shutdown_connections 2020-11-20T12:14:43.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f176c080670 0x7f176c082b30 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f1794155570 0x7f17941610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17940bed70 0x7f17940c8090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:43.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 --2- 172.21.15.93:0/2825980442 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f17940c2490 0x7f1794062730 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:43.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 >> 172.21.15.93:0/2825980442 conn(0x7f1794060130 msgr2=0x7f179414f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:43.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 shutdown_connections 2020-11-20T12:14:43.900 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:43.894+0000 7f179a4fd700 1 -- 172.21.15.93:0/2825980442 wait complete. 2020-11-20T12:14:43.908 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-11-20T12:14:43.909 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:44.018 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.015+0000 7f73019bf700 1 Processor -- start 2020-11-20T12:14:44.018 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.015+0000 7f73019bf700 1 -- start start 2020-11-20T12:14:44.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f73019bf700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f72fc0c2870 0x7f72fc155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f73019bf700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc155a60 con 0x7f72fc0c2490 2020-11-20T12:14:44.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f73019bf700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72fc151c40 con 0x7f72fc0bed70 2020-11-20T12:14:44.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f73019bf700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72fc151ee0 con 0x7f72fc0c2870 2020-11-20T12:14:44.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fb7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f72fc0c2870 0x7f72fc155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72f3fff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f72fc0bed70 0x7f72fc150ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39792/0 (socket says 172.21.15.93:39792) 2020-11-20T12:14:44.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72f3fff700 1 -- 172.21.15.93:0/729641365 learned_addr learned my addr 172.21.15.93:0/729641365 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:44.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fb7fe700 1 -- 172.21.15.93:0/729641365 >> v1:172.21.15.93:6789/0 conn(0x7f72fc0bed70 legacy=0x7f72fc150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fb7fe700 1 -- 172.21.15.93:0/729641365 >> v1:172.21.15.66:6789/0 conn(0x7f72fc0c2490 legacy=0x7f72fc0c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fa7fc700 1 -- 172.21.15.93:0/729641365 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1403697158 0 0) 0x7f72fc151c40 con 0x7f72fc0bed70 2020-11-20T12:14:44.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fb7fe700 1 -- 172.21.15.93:0/729641365 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc152180 con 0x7f72fc0c2870 2020-11-20T12:14:44.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fb7fe700 1 --2- 172.21.15.93:0/729641365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc155570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f72f4009ce0 tx=0x7f72f4009220).ready entity=mon.1 client_cookie=39d2b76e0ac70e68 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fa7fc700 1 -- 172.21.15.93:0/729641365 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f400bbf0 con 0x7f72fc0c2870 2020-11-20T12:14:44.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fa7fc700 1 -- 172.21.15.93:0/729641365 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f400bd50 con 0x7f72fc0c2870 2020-11-20T12:14:44.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.016+0000 7f72fa7fc700 1 -- 172.21.15.93:0/729641365 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4011610 con 0x7f72fc0c2870 2020-11-20T12:14:44.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.017+0000 7f73019bf700 1 -- 172.21.15.93:0/729641365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 msgr2=0x7f72fc155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.017+0000 7f73019bf700 1 --2- 172.21.15.93:0/729641365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc155570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f72f4009ce0 tx=0x7f72f4009220).stop 2020-11-20T12:14:44.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.017+0000 7f73019bf700 1 -- 172.21.15.93:0/729641365 shutdown_connections 2020-11-20T12:14:44.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.017+0000 7f73019bf700 1 --2- 172.21.15.93:0/729641365 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc155570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.017+0000 7f73019bf700 1 -- 172.21.15.93:0/729641365 >> 172.21.15.93:0/729641365 conn(0x7f72fc060130 msgr2=0x7f72fc060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.017+0000 7f73019bf700 1 -- 172.21.15.93:0/729641365 shutdown_connections 2020-11-20T12:14:44.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.017+0000 7f73019bf700 1 -- 172.21.15.93:0/729641365 wait complete. 2020-11-20T12:14:44.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.018+0000 7f73019bf700 1 Processor -- start 2020-11-20T12:14:44.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.018+0000 7f73019bf700 1 -- start start 2020-11-20T12:14:44.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72fc0bed70 0x7f72fc161130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72fc0c2490 0x7f72fc148320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc0bf680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc161620 con 0x7f72fc0bed70 2020-11-20T12:14:44.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc0c7100 con 0x7f72fc0c2870 2020-11-20T12:14:44.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72fc163da0 con 0x7f72fc0c2490 2020-11-20T12:14:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc0bf680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc0bf680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39102/0 (socket says 172.21.15.93:39102) 2020-11-20T12:14:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 -- 172.21.15.93:0/3003066025 learned_addr learned my addr 172.21.15.93:0/3003066025 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72faffd700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72fc0bed70 0x7f72fc161130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 -- 172.21.15.93:0/3003066025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72fc0c2490 msgr2=0x7f72fc148320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72fc0c2490 0x7f72fc148320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 -- 172.21.15.93:0/3003066025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72fc0bed70 msgr2=0x7f72fc161130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72fc0bed70 0x7f72fc161130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 -- 172.21.15.93:0/3003066025 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72fc164040 con 0x7f72fc0c2870 2020-11-20T12:14:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72fb7fe700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc0bf680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f72f400b750 tx=0x7f72f4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72f2ffd700 1 -- 172.21.15.93:0/3003066025 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f4009e20 con 0x7f72fc0c2870 2020-11-20T12:14:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72f2ffd700 1 -- 172.21.15.93:0/3003066025 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f4010bc0 con 0x7f72fc0c2870 2020-11-20T12:14:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72fc1642e0 con 0x7f72fc0c2870 2020-11-20T12:14:44.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f72f2ffd700 1 -- 172.21.15.93:0/3003066025 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f401c470 con 0x7f72fc0c2870 2020-11-20T12:14:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.019+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72fc164820 con 0x7f72fc0c2870 2020-11-20T12:14:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.020+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72fc1649b0 con 0x7f72fc0c2870 2020-11-20T12:14:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.021+0000 7f72f2ffd700 1 -- 172.21.15.93:0/3003066025 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f72f4017070 con 0x7f72fc0c2870 2020-11-20T12:14:44.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.021+0000 7f72f2ffd700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f72d8080670 0x7f72d8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.021+0000 7f72f2ffd700 1 -- 172.21.15.93:0/3003066025 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f72f40a4f80 con 0x7f72fc0c2870 2020-11-20T12:14:44.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.022+0000 7f72faffd700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f72d8080670 0x7f72d8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.022+0000 7f72faffd700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f72d8080670 0x7f72d8082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f72ec003570 tx=0x7f72ec009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.025+0000 7f72f2ffd700 1 -- 172.21.15.93:0/3003066025 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f72f4079990 con 0x7f72fc0c2870 2020-11-20T12:14:44.169 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.166+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f72fc05cd50 con 0x7f72fc0c2870 2020-11-20T12:14:44.170 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.167+0000 7f72f2ffd700 1 -- 172.21.15.93:0/3003066025 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7f72f4015070 con 0x7f72fc0c2870 2020-11-20T12:14:44.170 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:44.171 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:44.172 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f72d8080670 msgr2=0x7f72d8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.172 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f72d8080670 0x7f72d8082b30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f72ec003570 tx=0x7f72ec009040).stop 2020-11-20T12:14:44.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 msgr2=0x7f72fc0bf680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc0bf680 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f72f400b750 tx=0x7f72f4016000).stop 2020-11-20T12:14:44.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 shutdown_connections 2020-11-20T12:14:44.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f72fc0c2870 0x7f72fc0bf680 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f72d8080670 0x7f72d8082b30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f72fc0bed70 0x7f72fc161130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 --2- 172.21.15.93:0/3003066025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72fc0c2490 0x7f72fc148320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:44.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 >> 172.21.15.93:0/3003066025 conn(0x7f72fc060130 msgr2=0x7f72fc154bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 shutdown_connections 2020-11-20T12:14:44.175 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.169+0000 7f73019bf700 1 -- 172.21.15.93:0/3003066025 wait complete. 2020-11-20T12:14:44.183 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2020-11-20T12:14:44.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.290+0000 7fea3cf61700 1 Processor -- start 2020-11-20T12:14:44.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.290+0000 7fea3cf61700 1 -- start start 2020-11-20T12:14:44.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3cf61700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fea380c43c0 0x7fea38063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3cf61700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fea380c1010 0x7fea380bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3cf61700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea380c0230 con 0x7fea380c47a0 2020-11-20T12:14:44.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3cf61700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea38151510 con 0x7fea380c43c0 2020-11-20T12:14:44.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3cf61700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea381517b0 con 0x7fea380c1010 2020-11-20T12:14:44.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3659c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fea380c43c0 0x7fea38063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3659c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fea380c43c0 0x7fea38063890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39106/0 (socket says 172.21.15.93:39106) 2020-11-20T12:14:44.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.291+0000 7fea3659c700 1 -- 172.21.15.93:0/3408184335 learned_addr learned my addr 172.21.15.93:0/3408184335 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea36d9d700 1 --2- 172.21.15.93:0/3408184335 >> v2:172.21.15.132:3300/0 conn(0x7fea380c1010 0x7fea380bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3659c700 1 -- 172.21.15.93:0/3408184335 >> v2:172.21.15.132:3300/0 conn(0x7fea380c1010 msgr2=0x7fea380bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3659c700 1 --2- 172.21.15.93:0/3408184335 >> v2:172.21.15.132:3300/0 conn(0x7fea380c1010 0x7fea380bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3659c700 1 -- 172.21.15.93:0/3408184335 >> v1:172.21.15.66:6789/0 conn(0x7fea380c47a0 legacy=0x7fea380c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.300 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3659c700 1 -- 172.21.15.93:0/3408184335 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38151a50 con 0x7fea380c43c0 2020-11-20T12:14:44.300 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3659c700 1 --2- 172.21.15.93:0/3408184335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea38063890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fea380bf1d0 tx=0x7fea28006ef0).ready entity=mon.1 client_cookie=fed0053e1ad6645 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.300 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea35d9b700 1 -- 172.21.15.93:0/3408184335 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800b860 con 0x7fea380c43c0 2020-11-20T12:14:44.300 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea35d9b700 1 -- 172.21.15.93:0/3408184335 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea28000e90 con 0x7fea380c43c0 2020-11-20T12:14:44.300 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea35d9b700 1 -- 172.21.15.93:0/3408184335 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2800bbd0 con 0x7fea380c43c0 2020-11-20T12:14:44.301 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 -- 172.21.15.93:0/3408184335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 msgr2=0x7fea38063890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.301 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 --2- 172.21.15.93:0/3408184335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea38063890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7fea380bf1d0 tx=0x7fea28006ef0).stop 2020-11-20T12:14:44.301 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 -- 172.21.15.93:0/3408184335 shutdown_connections 2020-11-20T12:14:44.301 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 --2- 172.21.15.93:0/3408184335 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea38063890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 --2- 172.21.15.93:0/3408184335 >> v2:172.21.15.132:3300/0 conn(0x7fea380c1010 0x7fea380bfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 -- 172.21.15.93:0/3408184335 >> 172.21.15.93:0/3408184335 conn(0x7fea38060130 msgr2=0x7fea38060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 -- 172.21.15.93:0/3408184335 shutdown_connections 2020-11-20T12:14:44.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.292+0000 7fea3cf61700 1 -- 172.21.15.93:0/3408184335 wait complete. 2020-11-20T12:14:44.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 Processor -- start 2020-11-20T12:14:44.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 -- start start 2020-11-20T12:14:44.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea380c1010 0x7fea380c6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea380c6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea380c47a0 0x7fea3814c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea38112790 con 0x7fea380c1010 2020-11-20T12:14:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380c76b0 con 0x7fea380c43c0 2020-11-20T12:14:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea3cf61700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380c7430 con 0x7fea380c47a0 2020-11-20T12:14:44.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea2ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea380c6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea2ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea380c6110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39114/0 (socket says 172.21.15.93:39114) 2020-11-20T12:14:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea2ffff700 1 -- 172.21.15.93:0/1327815181 learned_addr learned my addr 172.21.15.93:0/1327815181 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.294+0000 7fea36d9d700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea380c47a0 0x7fea3814c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2ffff700 1 -- 172.21.15.93:0/1327815181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea380c47a0 msgr2=0x7fea3814c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2ffff700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea380c47a0 0x7fea3814c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea3659c700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea380c1010 0x7fea380c6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2ffff700 1 -- 172.21.15.93:0/1327815181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea380c1010 msgr2=0x7fea380c6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2ffff700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fea380c1010 0x7fea380c6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2ffff700 1 -- 172.21.15.93:0/1327815181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea38112980 con 0x7fea380c43c0 2020-11-20T12:14:44.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea36d9d700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea380c47a0 0x7fea3814c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2ffff700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea380c6110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fea2000c710 tx=0x7fea20007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000e4a0 con 0x7fea380c43c0 2020-11-20T12:14:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2000e600 con 0x7fea380c43c0 2020-11-20T12:14:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2000e9a0 con 0x7fea380c43c0 2020-11-20T12:14:44.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea38112c20 con 0x7fea380c43c0 2020-11-20T12:14:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.295+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea38161bb0 con 0x7fea380c43c0 2020-11-20T12:14:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.296+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fea380674d0 con 0x7fea380c43c0 2020-11-20T12:14:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fea20019030 con 0x7fea380c43c0 2020-11-20T12:14:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea2e7fc700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fea14080670 0x7fea14082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fea200a2680 con 0x7fea380c43c0 2020-11-20T12:14:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea3659c700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fea14080670 0x7fea14082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea2e7fc700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6802/23172,v1:172.21.15.93:6803/23172] conn(0x7fea140893a0 0x7fea1408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 --> [v2:172.21.15.93:6802/23172,v1:172.21.15.93:6803/23172] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fea1408be20 con 0x7fea140893a0 2020-11-20T12:14:44.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fea200a29f0 con 0x7fea380c43c0 2020-11-20T12:14:44.313 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea36d9d700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6802/23172,v1:172.21.15.93:6803/23172] conn(0x7fea140893a0 0x7fea1408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.313 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.297+0000 7fea3659c700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fea14080670 0x7fea14082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fea28006f30 tx=0x7fea28016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.313 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.298+0000 7fea36d9d700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6802/23172,v1:172.21.15.93:6803/23172] conn(0x7fea140893a0 0x7fea1408b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.313 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.298+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== osd.0 v2:172.21.15.93:6802/23172 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fea1408be20 con 0x7fea140893a0 2020-11-20T12:14:44.315 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 --> [v2:172.21.15.93:6802/23172,v1:172.21.15.93:6803/23172] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fea3805cd50 con 0x7fea140893a0 2020-11-20T12:14:44.316 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea2e7fc700 1 -- 172.21.15.93:0/1327815181 <== osd.0 v2:172.21.15.93:6802/23172 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fea3805cd50 con 0x7fea140893a0 2020-11-20T12:14:44.316 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6802/23172,v1:172.21.15.93:6803/23172] conn(0x7fea140893a0 msgr2=0x7fea1408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea3cf61700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6802/23172,v1:172.21.15.93:6803/23172] conn(0x7fea140893a0 0x7fea1408b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fea14080670 msgr2=0x7fea14082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea3cf61700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fea14080670 0x7fea14082b30 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fea28006f30 tx=0x7fea28016000).stop 2020-11-20T12:14:44.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 msgr2=0x7fea380c6110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea3cf61700 1 --2- 172.21.15.93:0/1327815181 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fea380c43c0 0x7fea380c6110 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fea2000c710 tx=0x7fea20007c40).stop 2020-11-20T12:14:44.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.312+0000 7fea36d9d700 1 -- 172.21.15.93:0/1327815181 reap_dead start 2020-11-20T12:14:44.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.313+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 shutdown_connections 2020-11-20T12:14:44.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.313+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 >> 172.21.15.93:0/1327815181 conn(0x7fea38060130 msgr2=0x7fea380676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.313+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 shutdown_connections 2020-11-20T12:14:44.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.313+0000 7fea3cf61700 1 -- 172.21.15.93:0/1327815181 wait complete. 2020-11-20T12:14:44.326 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:44.327 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2020-11-20T12:14:44.436 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.433+0000 7f115ebdd700 1 Processor -- start 2020-11-20T12:14:44.437 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.433+0000 7f115ebdd700 1 -- start start 2020-11-20T12:14:44.439 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115ebdd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f1158066d50 0x7f11580c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.439 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115ebdd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1158150770 0x7f1158150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.439 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115ebdd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11581549d0 con 0x7f11580c2250 2020-11-20T12:14:44.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115ebdd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11580671c0 con 0x7f1158066d50 2020-11-20T12:14:44.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115ebdd700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1158154c70 con 0x7f1158150770 2020-11-20T12:14:44.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115d17a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1158150770 0x7f1158150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115d17a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1158150770 0x7f1158150bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39124/0 (socket says 172.21.15.93:39124) 2020-11-20T12:14:44.441 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115d17a700 1 -- 172.21.15.93:0/1265662333 learned_addr learned my addr 172.21.15.93:0/1265662333 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.441 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f1157fff700 1 --2- 172.21.15.93:0/1265662333 >> v2:172.21.15.66:3300/0 conn(0x7f1158066d50 0x7f11580c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.441 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115d17a700 1 -- 172.21.15.93:0/1265662333 >> v2:172.21.15.66:3300/0 conn(0x7f1158066d50 msgr2=0x7f11580c2630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.441 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115d17a700 1 --2- 172.21.15.93:0/1265662333 >> v2:172.21.15.66:3300/0 conn(0x7f1158066d50 0x7f11580c2630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.442 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115d17a700 1 -- 172.21.15.93:0/1265662333 >> v1:172.21.15.66:6789/0 conn(0x7f11580c2250 legacy=0x7f1158064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.442 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f115d17a700 1 -- 172.21.15.93:0/1265662333 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158154f10 con 0x7f1158150770 2020-11-20T12:14:44.442 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.434+0000 7f1157fff700 1 --2- 172.21.15.93:0/1265662333 >> v2:172.21.15.66:3300/0 conn(0x7f1158066d50 0x7f11580c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:44.442 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115d17a700 1 --2- 172.21.15.93:0/1265662333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158150770 0x7f1158150bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f11580c56e0 tx=0x7f11500092d0).ready entity=mon.1 client_cookie=3c710fbe53bdc9dd server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f11577fe700 1 -- 172.21.15.93:0/1265662333 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000bc40 con 0x7f1158150770 2020-11-20T12:14:44.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f11577fe700 1 -- 172.21.15.93:0/1265662333 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000bda0 con 0x7f1158150770 2020-11-20T12:14:44.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f11577fe700 1 -- 172.21.15.93:0/1265662333 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150011610 con 0x7f1158150770 2020-11-20T12:14:44.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 -- 172.21.15.93:0/1265662333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158150770 msgr2=0x7f1158150bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 --2- 172.21.15.93:0/1265662333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158150770 0x7f1158150bb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f11580c56e0 tx=0x7f11500092d0).stop 2020-11-20T12:14:44.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 -- 172.21.15.93:0/1265662333 shutdown_connections 2020-11-20T12:14:44.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 --2- 172.21.15.93:0/1265662333 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158150770 0x7f1158150bb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 --2- 172.21.15.93:0/1265662333 >> v2:172.21.15.66:3300/0 conn(0x7f1158066d50 0x7f11580c2630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 -- 172.21.15.93:0/1265662333 >> 172.21.15.93:0/1265662333 conn(0x7f11580bb880 msgr2=0x7f11580bbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.445 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 -- 172.21.15.93:0/1265662333 shutdown_connections 2020-11-20T12:14:44.445 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.435+0000 7f115ebdd700 1 -- 172.21.15.93:0/1265662333 wait complete. 2020-11-20T12:14:44.445 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.436+0000 7f115ebdd700 1 Processor -- start 2020-11-20T12:14:44.448 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115ebdd700 1 -- start start 2020-11-20T12:14:44.448 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115ebdd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158066d50 0x7f11580c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.448 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115ebdd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11580c2250 0x7f115814ba00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.449 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115ebdd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1158150770 0x7f115814bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.449 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115ebdd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11581604d0 con 0x7f11580c2250 2020-11-20T12:14:44.449 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115ebdd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158160770 con 0x7f1158066d50 2020-11-20T12:14:44.449 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115ebdd700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1158160a10 con 0x7f1158150770 2020-11-20T12:14:44.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115c979700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158066d50 0x7f11580c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115c979700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158066d50 0x7f11580c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39128/0 (socket says 172.21.15.93:39128) 2020-11-20T12:14:44.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.437+0000 7f115c979700 1 -- 172.21.15.93:0/870529294 learned_addr learned my addr 172.21.15.93:0/870529294 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115c979700 1 -- 172.21.15.93:0/870529294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1158150770 msgr2=0x7f115814bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115c979700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1158150770 0x7f115814bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:44.451 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115c979700 1 -- 172.21.15.93:0/870529294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11580c2250 msgr2=0x7f115814ba00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.451 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115c979700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f11580c2250 0x7f115814ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:44.451 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115c979700 1 -- 172.21.15.93:0/870529294 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1158160cb0 con 0x7f1158066d50 2020-11-20T12:14:44.451 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115c979700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158066d50 0x7f11580c49f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f114c00c730 tx=0x7f114c007c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.451 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c010510 con 0x7f1158066d50 2020-11-20T12:14:44.452 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c010670 con 0x7f1158066d50 2020-11-20T12:14:44.452 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1158160f50 con 0x7f1158066d50 2020-11-20T12:14:44.452 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c010a30 con 0x7f1158066d50 2020-11-20T12:14:44.452 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1158152fb0 con 0x7f1158066d50 2020-11-20T12:14:44.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.438+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f115805c2e0 con 0x7f1158066d50 2020-11-20T12:14:44.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.439+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f114c010070 con 0x7f1158066d50 2020-11-20T12:14:44.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f1154ff9700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1130080670 0x7f1130082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f114c0a3100 con 0x7f1158066d50 2020-11-20T12:14:44.453 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f1157fff700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1130080670 0x7f1130082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f1154ff9700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.66:6800/22843,v1:172.21.15.66:6801/22843] conn(0x7f11300893a0 0x7f113008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 --> [v2:172.21.15.66:6800/22843,v1:172.21.15.66:6801/22843] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f113008be20 con 0x7f11300893a0 2020-11-20T12:14:44.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f114c0a3470 con 0x7f1158066d50 2020-11-20T12:14:44.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f1157fff700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1130080670 0x7f1130082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1144006fd0 tx=0x7f1144008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.440+0000 7f115d17a700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.66:6800/22843,v1:172.21.15.66:6801/22843] conn(0x7f11300893a0 0x7f113008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.441+0000 7f115d17a700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.66:6800/22843,v1:172.21.15.66:6801/22843] conn(0x7f11300893a0 0x7f113008b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.442+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== osd.1 v2:172.21.15.66:6800/22843 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f113008be20 con 0x7f11300893a0 2020-11-20T12:14:44.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.455+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 --> [v2:172.21.15.66:6800/22843,v1:172.21.15.66:6801/22843] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f115805cd50 con 0x7f11300893a0 2020-11-20T12:14:44.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f1154ff9700 1 -- 172.21.15.93:0/870529294 <== osd.1 v2:172.21.15.66:6800/22843 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f115805cd50 con 0x7f11300893a0 2020-11-20T12:14:44.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 >> [v2:172.21.15.66:6800/22843,v1:172.21.15.66:6801/22843] conn(0x7f11300893a0 msgr2=0x7f113008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.66:6800/22843,v1:172.21.15.66:6801/22843] conn(0x7f11300893a0 0x7f113008b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1130080670 msgr2=0x7f1130082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1130080670 0x7f1130082b30 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1144006fd0 tx=0x7f1144008040).stop 2020-11-20T12:14:44.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158066d50 msgr2=0x7f11580c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 --2- 172.21.15.93:0/870529294 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1158066d50 0x7f11580c49f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f114c00c730 tx=0x7f114c007c70).stop 2020-11-20T12:14:44.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115d17a700 1 -- 172.21.15.93:0/870529294 reap_dead start 2020-11-20T12:14:44.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 shutdown_connections 2020-11-20T12:14:44.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.456+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 >> 172.21.15.93:0/870529294 conn(0x7f11580bb880 msgr2=0x7f11580c1510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.457+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 shutdown_connections 2020-11-20T12:14:44.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.457+0000 7f115ebdd700 1 -- 172.21.15.93:0/870529294 wait complete. 2020-11-20T12:14:44.471 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:44.472 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2020-11-20T12:14:44.581 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.578+0000 7f6f4c9b4700 1 Processor -- start 2020-11-20T12:14:44.582 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.578+0000 7f6f4c9b4700 1 -- start start 2020-11-20T12:14:44.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4c9b4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6f480625a0 0x7f6f48062980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4c9b4700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6f480c3b00 0x7f6f480c15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4c9b4700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f480c85d0 con 0x7f6f48064310 2020-11-20T12:14:44.584 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4c9b4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f480c3f60 con 0x7f6f480625a0 2020-11-20T12:14:44.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4c9b4700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f480c7e30 con 0x7f6f480c3b00 2020-11-20T12:14:44.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4659c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6f480c3b00 0x7f6f480c15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4659c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f6f480c3b00 0x7f6f480c15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39136/0 (socket says 172.21.15.93:39136) 2020-11-20T12:14:44.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.579+0000 7f6f4659c700 1 -- 172.21.15.93:0/1868336584 learned_addr learned my addr 172.21.15.93:0/1868336584 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f46d9d700 1 --2- 172.21.15.93:0/1868336584 >> v2:172.21.15.66:3300/0 conn(0x7f6f480625a0 0x7f6f48062980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4659c700 1 -- 172.21.15.93:0/1868336584 >> v2:172.21.15.66:3300/0 conn(0x7f6f480625a0 msgr2=0x7f6f48062980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4659c700 1 --2- 172.21.15.93:0/1868336584 >> v2:172.21.15.66:3300/0 conn(0x7f6f480625a0 0x7f6f48062980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4659c700 1 -- 172.21.15.93:0/1868336584 >> v1:172.21.15.66:6789/0 conn(0x7f6f48064310 legacy=0x7f6f481517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4659c700 1 -- 172.21.15.93:0/1868336584 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f480c2400 con 0x7f6f480c3b00 2020-11-20T12:14:44.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4659c700 1 --2- 172.21.15.93:0/1868336584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f480c3b00 0x7f6f480c15e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6f4805c390 tx=0x7f6f30006ef0).ready entity=mon.1 client_cookie=d984ae8145aa258b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f45d9b700 1 -- 172.21.15.93:0/1868336584 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000b820 con 0x7f6f480c3b00 2020-11-20T12:14:44.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f45d9b700 1 -- 172.21.15.93:0/1868336584 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30000e90 con 0x7f6f480c3b00 2020-11-20T12:14:44.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f45d9b700 1 -- 172.21.15.93:0/1868336584 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3000bb90 con 0x7f6f480c3b00 2020-11-20T12:14:44.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/1868336584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f480c3b00 msgr2=0x7f6f480c15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 --2- 172.21.15.93:0/1868336584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f480c3b00 0x7f6f480c15e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6f4805c390 tx=0x7f6f30006ef0).stop 2020-11-20T12:14:44.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/1868336584 shutdown_connections 2020-11-20T12:14:44.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 --2- 172.21.15.93:0/1868336584 >> v2:172.21.15.66:3300/0 conn(0x7f6f480625a0 0x7f6f48062980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 --2- 172.21.15.93:0/1868336584 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f480c3b00 0x7f6f480c15e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/1868336584 >> 172.21.15.93:0/1868336584 conn(0x7f6f48060bc0 msgr2=0x7f6f480c7720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/1868336584 shutdown_connections 2020-11-20T12:14:44.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.580+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/1868336584 wait complete. 2020-11-20T12:14:44.592 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 Processor -- start 2020-11-20T12:14:44.592 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 -- start start 2020-11-20T12:14:44.592 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480625a0 0x7f6f4814de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.592 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f48064310 0x7f6f48164540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.593 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f480c3b00 0x7f6f480c0e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.593 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480c1300 con 0x7f6f480c3b00 2020-11-20T12:14:44.593 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480c0420 con 0x7f6f48064310 2020-11-20T12:14:44.593 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4c9b4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f480c06c0 con 0x7f6f480625a0 2020-11-20T12:14:44.594 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.582+0000 7f6f4659c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f48064310 0x7f6f48164540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.594 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f48064310 0x7f6f48164540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39144/0 (socket says 172.21.15.93:39144) 2020-11-20T12:14:44.594 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 -- 172.21.15.93:0/23358445 learned_addr learned my addr 172.21.15.93:0/23358445 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.594 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f46d9d700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480625a0 0x7f6f4814de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.594 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4759e700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f480c3b00 0x7f6f480c0e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.595 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 -- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480625a0 msgr2=0x7f6f4814de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.595 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6f480625a0 0x7f6f4814de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.595 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 -- 172.21.15.93:0/23358445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f480c3b00 msgr2=0x7f6f480c0e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.595 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6f480c3b00 0x7f6f480c0e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 -- 172.21.15.93:0/23358445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f48160790 con 0x7f6f48064310 2020-11-20T12:14:44.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4659c700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f48064310 0x7f6f48164540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6f30011000 tx=0x7f6f30016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f30011c40 con 0x7f6f48064310 2020-11-20T12:14:44.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f30011da0 con 0x7f6f48064310 2020-11-20T12:14:44.596 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f48160a30 con 0x7f6f48064310 2020-11-20T12:14:44.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f3001d6a0 con 0x7f6f48064310 2020-11-20T12:14:44.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.583+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f4814c210 con 0x7f6f48064310 2020-11-20T12:14:44.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.584+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6f48061680 con 0x7f6f48064310 2020-11-20T12:14:44.597 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.585+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6f30023020 con 0x7f6f48064310 2020-11-20T12:14:44.598 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.585+0000 7f6f3effd700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6f24080670 0x7f6f24082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.598 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.585+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6f300a5030 con 0x7f6f48064310 2020-11-20T12:14:44.598 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.585+0000 7f6f46d9d700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6f24080670 0x7f6f24082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.598 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.585+0000 7f6f3effd700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:6805/23325,v1:172.21.15.132:6807/23325] conn(0x7f6f240893a0 0x7f6f2408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.598 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.585+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 --> [v2:172.21.15.132:6805/23325,v1:172.21.15.132:6807/23325] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6f2408be20 con 0x7f6f240893a0 2020-11-20T12:14:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.585+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6f300a53a0 con 0x7f6f48064310 2020-11-20T12:14:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.586+0000 7f6f46d9d700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6f24080670 0x7f6f24082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f6f48155850 tx=0x7f6f38008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.586+0000 7f6f4759e700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:6805/23325,v1:172.21.15.132:6807/23325] conn(0x7f6f240893a0 0x7f6f2408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.586+0000 7f6f4759e700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:6805/23325,v1:172.21.15.132:6807/23325] conn(0x7f6f240893a0 0x7f6f2408b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.599 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.587+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== osd.2 v2:172.21.15.132:6805/23325 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f6f2408be20 con 0x7f6f240893a0 2020-11-20T12:14:44.604 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.601+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 --> [v2:172.21.15.132:6805/23325,v1:172.21.15.132:6807/23325] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6f4805ca60 con 0x7f6f240893a0 2020-11-20T12:14:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f3effd700 1 -- 172.21.15.93:0/23358445 <== osd.2 v2:172.21.15.132:6805/23325 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6f4805ca60 con 0x7f6f240893a0 2020-11-20T12:14:44.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:6805/23325,v1:172.21.15.132:6807/23325] conn(0x7f6f240893a0 msgr2=0x7f6f2408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.132:6805/23325,v1:172.21.15.132:6807/23325] conn(0x7f6f240893a0 0x7f6f2408b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6f24080670 msgr2=0x7f6f24082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6f24080670 0x7f6f24082b30 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f6f48155850 tx=0x7f6f38008040).stop 2020-11-20T12:14:44.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f48064310 msgr2=0x7f6f48164540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 --2- 172.21.15.93:0/23358445 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6f48064310 0x7f6f48164540 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f6f30011000 tx=0x7f6f30016000).stop 2020-11-20T12:14:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4759e700 1 -- 172.21.15.93:0/23358445 reap_dead start 2020-11-20T12:14:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 shutdown_connections 2020-11-20T12:14:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 >> 172.21.15.93:0/23358445 conn(0x7f6f48060bc0 msgr2=0x7f6f4814eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 shutdown_connections 2020-11-20T12:14:44.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.602+0000 7f6f4c9b4700 1 -- 172.21.15.93:0/23358445 wait complete. 2020-11-20T12:14:44.616 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:44.616 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2020-11-20T12:14:44.677 INFO:tasks.ceph.mds.c.smithi132.stderr:2020-11-20T12:14:44.673+0000 7fcb09c27700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2020-11-20T12:14:44.726 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.723+0000 7fd16013c700 1 Processor -- start 2020-11-20T12:14:44.727 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.723+0000 7fd16013c700 1 -- start start 2020-11-20T12:14:44.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd16013c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd1580c43c0 0x7fd158063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd16013c700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd1580c47a0 0x7fd1580bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd16013c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1581552c0 0x7fd1580c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.731 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd16013c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1580c0230 con 0x7fd1580c43c0 2020-11-20T12:14:44.731 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd16013c700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd158151510 con 0x7fd1580c47a0 2020-11-20T12:14:44.731 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd16013c700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1581517b0 con 0x7fd1581552c0 2020-11-20T12:14:44.732 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd15d6d7700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd1580c47a0 0x7fd1580bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.732 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd15d6d7700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fd1580c47a0 0x7fd1580bfb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39152/0 (socket says 172.21.15.93:39152) 2020-11-20T12:14:44.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd15d6d7700 1 -- 172.21.15.93:0/2077872385 learned_addr learned my addr 172.21.15.93:0/2077872385 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd15ded8700 1 --2- 172.21.15.93:0/2077872385 >> v2:172.21.15.66:3300/0 conn(0x7fd1580c43c0 0x7fd158063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.724+0000 7fd15e6d9700 1 --2- 172.21.15.93:0/2077872385 >> v2:172.21.15.132:3300/0 conn(0x7fd1581552c0 0x7fd1580c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15d6d7700 1 -- 172.21.15.93:0/2077872385 >> v2:172.21.15.132:3300/0 conn(0x7fd1581552c0 msgr2=0x7fd1580c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15d6d7700 1 --2- 172.21.15.93:0/2077872385 >> v2:172.21.15.132:3300/0 conn(0x7fd1581552c0 0x7fd1580c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15d6d7700 1 -- 172.21.15.93:0/2077872385 >> v2:172.21.15.66:3300/0 conn(0x7fd1580c43c0 msgr2=0x7fd158063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15d6d7700 1 --2- 172.21.15.93:0/2077872385 >> v2:172.21.15.66:3300/0 conn(0x7fd1580c43c0 0x7fd158063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15d6d7700 1 -- 172.21.15.93:0/2077872385 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd158151a50 con 0x7fd1580c47a0 2020-11-20T12:14:44.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15e6d9700 1 --2- 172.21.15.93:0/2077872385 >> v2:172.21.15.132:3300/0 conn(0x7fd1581552c0 0x7fd1580c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:44.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15d6d7700 1 --2- 172.21.15.93:0/2077872385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c47a0 0x7fd1580bfb70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd1580c0840 tx=0x7fd148006ef0).ready entity=mon.1 client_cookie=76af80561d68dcd8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15ced6700 1 -- 172.21.15.93:0/2077872385 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800b830 con 0x7fd1580c47a0 2020-11-20T12:14:44.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15ced6700 1 -- 172.21.15.93:0/2077872385 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd148000e90 con 0x7fd1580c47a0 2020-11-20T12:14:44.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd15ced6700 1 -- 172.21.15.93:0/2077872385 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd14800bba0 con 0x7fd1580c47a0 2020-11-20T12:14:44.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 -- 172.21.15.93:0/2077872385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c47a0 msgr2=0x7fd1580bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 --2- 172.21.15.93:0/2077872385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c47a0 0x7fd1580bfb70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7fd1580c0840 tx=0x7fd148006ef0).stop 2020-11-20T12:14:44.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 -- 172.21.15.93:0/2077872385 shutdown_connections 2020-11-20T12:14:44.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 --2- 172.21.15.93:0/2077872385 >> v2:172.21.15.132:3300/0 conn(0x7fd1581552c0 0x7fd1580c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 --2- 172.21.15.93:0/2077872385 >> v2:172.21.15.66:3300/0 conn(0x7fd1580c43c0 0x7fd158063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 --2- 172.21.15.93:0/2077872385 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c47a0 0x7fd1580bfb70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 -- 172.21.15.93:0/2077872385 >> 172.21.15.93:0/2077872385 conn(0x7fd158060130 msgr2=0x7fd158060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 -- 172.21.15.93:0/2077872385 shutdown_connections 2020-11-20T12:14:44.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.725+0000 7fd16013c700 1 -- 172.21.15.93:0/2077872385 wait complete. 2020-11-20T12:14:44.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.726+0000 7fd16013c700 1 Processor -- start 2020-11-20T12:14:44.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd16013c700 1 -- start start 2020-11-20T12:14:44.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd16013c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c43c0 0x7fd158155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd16013c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1580c47a0 0x7fd158160ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd16013c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1581552c0 0x7fd158154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd16013c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158153f40 con 0x7fd1580c47a0 2020-11-20T12:14:44.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd16013c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1581613b0 con 0x7fd1580c43c0 2020-11-20T12:14:44.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd16013c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd158155040 con 0x7fd1581552c0 2020-11-20T12:14:44.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd15ded8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c43c0 0x7fd158155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd15ded8700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c43c0 0x7fd158155db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39158/0 (socket says 172.21.15.93:39158) 2020-11-20T12:14:44.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd15ded8700 1 -- 172.21.15.93:0/2989370050 learned_addr learned my addr 172.21.15.93:0/2989370050 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd15e6d9700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1581552c0 0x7fd158154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd15d6d7700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1580c47a0 0x7fd158160ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.727+0000 7fd15ded8700 1 -- 172.21.15.93:0/2989370050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1581552c0 msgr2=0x7fd158154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd15ded8700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1581552c0 0x7fd158154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd15ded8700 1 -- 172.21.15.93:0/2989370050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1580c47a0 msgr2=0x7fd158160ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd15ded8700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1580c47a0 0x7fd158160ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd15ded8700 1 -- 172.21.15.93:0/2989370050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1581534c0 con 0x7fd1580c43c0 2020-11-20T12:14:44.750 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd15d6d7700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd1580c47a0 0x7fd158160ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:44.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd15ded8700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c43c0 0x7fd158155db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd15400eba0 tx=0x7fd154006e30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400c970 con 0x7fd1580c43c0 2020-11-20T12:14:44.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd15400cad0 con 0x7fd1580c43c0 2020-11-20T12:14:44.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd158112ad0 con 0x7fd1580c43c0 2020-11-20T12:14:44.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd15400ce50 con 0x7fd1580c43c0 2020-11-20T12:14:44.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.728+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd158154410 con 0x7fd1580c43c0 2020-11-20T12:14:44.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.729+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd1580674d0 con 0x7fd1580c43c0 2020-11-20T12:14:44.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.729+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd154012600 con 0x7fd1580c43c0 2020-11-20T12:14:44.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd145ffb700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd130080670 0x7fd130082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd1540a2e90 con 0x7fd1580c43c0 2020-11-20T12:14:44.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd15d6d7700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd130080670 0x7fd130082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd145ffb700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6806/23173,v1:172.21.15.93:6808/23173] conn(0x7fd1300893a0 0x7fd13008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 --> [v2:172.21.15.93:6806/23173,v1:172.21.15.93:6808/23173] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd13008be20 con 0x7fd1300893a0 2020-11-20T12:14:44.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd1540a5470 con 0x7fd1580c43c0 2020-11-20T12:14:44.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd15e6d9700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6806/23173,v1:172.21.15.93:6808/23173] conn(0x7fd1300893a0 0x7fd13008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd15d6d7700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd130080670 0x7fd130082b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd1580c1730 tx=0x7fd148016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.730+0000 7fd15e6d9700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6806/23173,v1:172.21.15.93:6808/23173] conn(0x7fd1300893a0 0x7fd13008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.731+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== osd.3 v2:172.21.15.93:6806/23173 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fd13008be20 con 0x7fd1300893a0 2020-11-20T12:14:44.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.745+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 --> [v2:172.21.15.93:6806/23173,v1:172.21.15.93:6808/23173] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd158112890 con 0x7fd1300893a0 2020-11-20T12:14:44.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.745+0000 7fd145ffb700 1 -- 172.21.15.93:0/2989370050 <== osd.3 v2:172.21.15.93:6806/23173 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd158112890 con 0x7fd1300893a0 2020-11-20T12:14:44.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.745+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6806/23173,v1:172.21.15.93:6808/23173] conn(0x7fd1300893a0 msgr2=0x7fd13008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.745+0000 7fd16013c700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6806/23173,v1:172.21.15.93:6808/23173] conn(0x7fd1300893a0 0x7fd13008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd130080670 msgr2=0x7fd130082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd130080670 0x7fd130082b30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fd1580c1730 tx=0x7fd148016000).stop 2020-11-20T12:14:44.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c43c0 msgr2=0x7fd158155db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 --2- 172.21.15.93:0/2989370050 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd1580c43c0 0x7fd158155db0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fd15400eba0 tx=0x7fd154006e30).stop 2020-11-20T12:14:44.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd15e6d9700 1 -- 172.21.15.93:0/2989370050 reap_dead start 2020-11-20T12:14:44.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 shutdown_connections 2020-11-20T12:14:44.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 >> 172.21.15.93:0/2989370050 conn(0x7fd158060130 msgr2=0x7fd15814d840 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 shutdown_connections 2020-11-20T12:14:44.761 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.746+0000 7fd16013c700 1 -- 172.21.15.93:0/2989370050 wait complete. 2020-11-20T12:14:44.763 INFO:teuthology.orchestra.run.smithi093.stdout:73014444037 2020-11-20T12:14:44.763 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2020-11-20T12:14:44.872 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.869+0000 7fb279f93700 1 Processor -- start 2020-11-20T12:14:44.873 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.869+0000 7fb279f93700 1 -- start start 2020-11-20T12:14:44.875 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb279f93700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fb2740c43c0 0x7fb274063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.875 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb279f93700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb2740c47a0 0x7fb2740bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.875 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb279f93700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2740c0230 con 0x7fb2741552c0 2020-11-20T12:14:44.876 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb279f93700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb274151510 con 0x7fb2740c43c0 2020-11-20T12:14:44.876 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb279f93700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2741517b0 con 0x7fb2740c47a0 2020-11-20T12:14:44.876 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb272ffd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb2740c47a0 0x7fb2740bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.876 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb273fff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fb2741552c0 0x7fb2740c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39868/0 (socket says 172.21.15.93:39868) 2020-11-20T12:14:44.876 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.870+0000 7fb273fff700 1 -- 172.21.15.93:0/1185354674 learned_addr learned my addr 172.21.15.93:0/1185354674 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:44.877 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb2737fe700 1 --2- 172.21.15.93:0/1185354674 >> v2:172.21.15.66:3300/0 conn(0x7fb2740c43c0 0x7fb274063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.877 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb272ffd700 1 -- 172.21.15.93:0/1185354674 >> v2:172.21.15.66:3300/0 conn(0x7fb2740c43c0 msgr2=0x7fb274063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:44.877 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb272ffd700 1 --2- 172.21.15.93:0/1185354674 >> v2:172.21.15.66:3300/0 conn(0x7fb2740c43c0 0x7fb274063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.877 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb272ffd700 1 -- 172.21.15.93:0/1185354674 >> v1:172.21.15.93:6789/0 conn(0x7fb2741552c0 legacy=0x7fb2740c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.878 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb272ffd700 1 -- 172.21.15.93:0/1185354674 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274151a50 con 0x7fb2740c47a0 2020-11-20T12:14:44.878 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb2727fc700 1 -- 172.21.15.93:0/1185354674 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1747954528 0 0) 0x7fb2740c0230 con 0x7fb2741552c0 2020-11-20T12:14:44.878 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb2737fe700 1 --2- 172.21.15.93:0/1185354674 >> v2:172.21.15.66:3300/0 conn(0x7fb2740c43c0 0x7fb274063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:44.878 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb272ffd700 1 --2- 172.21.15.93:0/1185354674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2740c47a0 0x7fb2740bfb70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb2740c0840 tx=0x7fb268006e30).ready entity=mon.1 client_cookie=c9292d92b83c82ad server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.878 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb2727fc700 1 -- 172.21.15.93:0/1185354674 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2680097b0 con 0x7fb2740c47a0 2020-11-20T12:14:44.879 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb2727fc700 1 -- 172.21.15.93:0/1185354674 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb268000e90 con 0x7fb2740c47a0 2020-11-20T12:14:44.879 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb2727fc700 1 -- 172.21.15.93:0/1185354674 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb268009b20 con 0x7fb2740c47a0 2020-11-20T12:14:44.879 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb279f93700 1 -- 172.21.15.93:0/1185354674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2740c47a0 msgr2=0x7fb2740bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.879 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.871+0000 7fb279f93700 1 --2- 172.21.15.93:0/1185354674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2740c47a0 0x7fb2740bfb70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fb2740c0840 tx=0x7fb268006e30).stop 2020-11-20T12:14:44.879 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.872+0000 7fb279f93700 1 -- 172.21.15.93:0/1185354674 shutdown_connections 2020-11-20T12:14:44.880 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.872+0000 7fb279f93700 1 --2- 172.21.15.93:0/1185354674 >> v2:172.21.15.66:3300/0 conn(0x7fb2740c43c0 0x7fb274063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.880 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.872+0000 7fb279f93700 1 --2- 172.21.15.93:0/1185354674 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2740c47a0 0x7fb2740bfb70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.880 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.872+0000 7fb279f93700 1 -- 172.21.15.93:0/1185354674 >> 172.21.15.93:0/1185354674 conn(0x7fb274060130 msgr2=0x7fb274060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.880 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.872+0000 7fb279f93700 1 -- 172.21.15.93:0/1185354674 shutdown_connections 2020-11-20T12:14:44.880 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.872+0000 7fb279f93700 1 -- 172.21.15.93:0/1185354674 wait complete. 2020-11-20T12:14:44.883 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 Processor -- start 2020-11-20T12:14:44.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 -- start start 2020-11-20T12:14:44.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2740c43c0 0x7fb2741549f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2740c47a0 0x7fb2740c0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2741552c0 0x7fb2741123e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.884 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb274163960 con 0x7fb2740c43c0 2020-11-20T12:14:44.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb274163c00 con 0x7fb2741552c0 2020-11-20T12:14:44.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.873+0000 7fb279f93700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb274163ea0 con 0x7fb2740c47a0 2020-11-20T12:14:44.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2741552c0 0x7fb2741123e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2741552c0 0x7fb2741123e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39176/0 (socket says 172.21.15.93:39176) 2020-11-20T12:14:44.886 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 -- 172.21.15.93:0/3928878556 learned_addr learned my addr 172.21.15.93:0/3928878556 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:44.886 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb272ffd700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2740c47a0 0x7fb2740c0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.886 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb2737fe700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2740c43c0 0x7fb2741549f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.886 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 -- 172.21.15.93:0/3928878556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2740c47a0 msgr2=0x7fb2740c0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.886 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2740c47a0 0x7fb2740c0a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.887 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 -- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2740c43c0 msgr2=0x7fb2741549f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.887 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2740c43c0 0x7fb2741549f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.887 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 -- 172.21.15.93:0/3928878556 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274164140 con 0x7fb2741552c0 2020-11-20T12:14:44.887 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb2737fe700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb2740c43c0 0x7fb2741549f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:44.887 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb273fff700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2741552c0 0x7fb2741123e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb26c00cae0 tx=0x7fb26c001360).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c005bc0 con 0x7fb2741552c0 2020-11-20T12:14:44.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb26c005d20 con 0x7fb2741552c0 2020-11-20T12:14:44.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2741643e0 con 0x7fb2741552c0 2020-11-20T12:14:44.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb26c007340 con 0x7fb2741552c0 2020-11-20T12:14:44.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.874+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2740c0f20 con 0x7fb2741552c0 2020-11-20T12:14:44.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.875+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2740c1170 con 0x7fb2741552c0 2020-11-20T12:14:44.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.876+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb26c010030 con 0x7fb2741552c0 2020-11-20T12:14:44.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.876+0000 7fb2537fe700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb24c080670 0x7fb24c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.876+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb26c0a2f00 con 0x7fb2741552c0 2020-11-20T12:14:44.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.876+0000 7fb2737fe700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb24c080670 0x7fb24c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.890 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.876+0000 7fb2537fe700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:6808/22844,v1:172.21.15.66:6809/22844] conn(0x7fb24c0893a0 0x7fb24c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:44.890 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.876+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 --> [v2:172.21.15.66:6808/22844,v1:172.21.15.66:6809/22844] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb24c08be20 con 0x7fb24c0893a0 2020-11-20T12:14:44.890 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.876+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb26c0a3270 con 0x7fb2741552c0 2020-11-20T12:14:44.890 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.877+0000 7fb2737fe700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb24c080670 0x7fb24c082b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb26400b850 tx=0x7fb264008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.890 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.877+0000 7fb272ffd700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:6808/22844,v1:172.21.15.66:6809/22844] conn(0x7fb24c0893a0 0x7fb24c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:44.891 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.877+0000 7fb272ffd700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:6808/22844,v1:172.21.15.66:6809/22844] conn(0x7fb24c0893a0 0x7fb24c08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:44.891 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.878+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== osd.4 v2:172.21.15.66:6808/22844 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fb24c08be20 con 0x7fb24c0893a0 2020-11-20T12:14:44.895 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.892+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 --> [v2:172.21.15.66:6808/22844,v1:172.21.15.66:6809/22844] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb274112b90 con 0x7fb24c0893a0 2020-11-20T12:14:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb2537fe700 1 -- 172.21.15.93:0/3928878556 <== osd.4 v2:172.21.15.66:6808/22844 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb274112b90 con 0x7fb24c0893a0 2020-11-20T12:14:44.896 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:6808/22844,v1:172.21.15.66:6809/22844] conn(0x7fb24c0893a0 msgr2=0x7fb24c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.897 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.66:6808/22844,v1:172.21.15.66:6809/22844] conn(0x7fb24c0893a0 0x7fb24c08b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:44.897 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb24c080670 msgr2=0x7fb24c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.897 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb24c080670 0x7fb24c082b30 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb26400b850 tx=0x7fb264008040).stop 2020-11-20T12:14:44.897 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2741552c0 msgr2=0x7fb2741123e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:44.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 --2- 172.21.15.93:0/3928878556 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb2741552c0 0x7fb2741123e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7fb26c00cae0 tx=0x7fb26c001360).stop 2020-11-20T12:14:44.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb273fff700 1 -- 172.21.15.93:0/3928878556 reap_dead start 2020-11-20T12:14:44.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 shutdown_connections 2020-11-20T12:14:44.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 >> 172.21.15.93:0/3928878556 conn(0x7fb274060130 msgr2=0x7fb27414d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:44.898 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 shutdown_connections 2020-11-20T12:14:44.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:44.893+0000 7fb279f93700 1 -- 172.21.15.93:0/3928878556 wait complete. 2020-11-20T12:14:44.907 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:44.907 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2020-11-20T12:14:45.016 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.013+0000 7f6b40f46700 1 Processor -- start 2020-11-20T12:14:45.016 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.013+0000 7f6b40f46700 1 -- start start 2020-11-20T12:14:45.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b40f46700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f6b3c0c1010 0x7f6b3c063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b40f46700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c0c0230 con 0x7f6b3c0c47a0 2020-11-20T12:14:45.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b40f46700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b3c151510 con 0x7f6b3c0c43c0 2020-11-20T12:14:45.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b40f46700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b3c0c4bf0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b3ad9d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f6b3c0c47a0 0x7f6b3c150350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39886/0 (socket says 172.21.15.93:39886) 2020-11-20T12:14:45.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b3ad9d700 1 -- 172.21.15.93:0/2107923871 learned_addr learned my addr 172.21.15.93:0/2107923871 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:45.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b39d9b700 1 --2- 172.21.15.93:0/2107923871 >> v2:172.21.15.66:3300/0 conn(0x7f6b3c0c1010 0x7f6b3c063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b3959a700 1 -- 172.21.15.93:0/2107923871 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3379079901 0 0) 0x7f6b3c0c0230 con 0x7f6b3c0c47a0 2020-11-20T12:14:45.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.014+0000 7f6b3959a700 1 -- 172.21.15.93:0/2107923871 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b20003280 con 0x7f6b3c0c47a0 2020-11-20T12:14:45.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b39d9b700 1 -- 172.21.15.93:0/2107923871 >> v1:172.21.15.132:6789/0 conn(0x7f6b3c0c43c0 legacy=0x7f6b3c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b39d9b700 1 -- 172.21.15.93:0/2107923871 >> v1:172.21.15.93:6789/0 conn(0x7f6b3c0c47a0 legacy=0x7f6b3c150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b3959a700 1 -- 172.21.15.93:0/2107923871 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 12461373 0 0) 0x7f6b20003280 con 0x7f6b3c0c47a0 2020-11-20T12:14:45.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b39d9b700 1 -- 172.21.15.93:0/2107923871 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c1517b0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b39d9b700 1 --2- 172.21.15.93:0/2107923871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c063890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6b3000ba00 tx=0x7f6b30006e30).ready entity=mon.0 client_cookie=379866558e6c118a server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b3959a700 1 -- 172.21.15.93:0/2107923871 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b340018a0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b3959a700 1 -- 172.21.15.93:0/2107923871 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b30000e90 con 0x7f6b3c0c1010 2020-11-20T12:14:45.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b3959a700 1 -- 172.21.15.93:0/2107923871 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b300096e0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b40f46700 1 -- 172.21.15.93:0/2107923871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c1010 msgr2=0x7f6b3c063890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.015+0000 7f6b40f46700 1 --2- 172.21.15.93:0/2107923871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c063890 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f6b3000ba00 tx=0x7f6b30006e30).stop 2020-11-20T12:14:45.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.016+0000 7f6b40f46700 1 -- 172.21.15.93:0/2107923871 shutdown_connections 2020-11-20T12:14:45.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.016+0000 7f6b40f46700 1 --2- 172.21.15.93:0/2107923871 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c063890 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.016+0000 7f6b40f46700 1 -- 172.21.15.93:0/2107923871 >> 172.21.15.93:0/2107923871 conn(0x7f6b3c060130 msgr2=0x7f6b3c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.016+0000 7f6b40f46700 1 -- 172.21.15.93:0/2107923871 shutdown_connections 2020-11-20T12:14:45.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.016+0000 7f6b40f46700 1 -- 172.21.15.93:0/2107923871 wait complete. 2020-11-20T12:14:45.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 Processor -- start 2020-11-20T12:14:45.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 -- start start 2020-11-20T12:14:45.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c14c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c43c0 0x7f6b3c164710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b3c0c47a0 0x7f6b3c0c6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c14cd90 con 0x7f6b3c0c43c0 2020-11-20T12:14:45.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c1476b0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b40f46700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b3c146f10 con 0x7f6b3c0c47a0 2020-11-20T12:14:45.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.017+0000 7f6b3a59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c14c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c14c8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39192/0 (socket says 172.21.15.93:39192) 2020-11-20T12:14:45.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 -- 172.21.15.93:0/854479693 learned_addr learned my addr 172.21.15.93:0/854479693 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3ad9d700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b3c0c47a0 0x7f6b3c0c6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b39d9b700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c43c0 0x7f6b3c164710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 -- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b3c0c47a0 msgr2=0x7f6b3c0c6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b3c0c47a0 0x7f6b3c0c6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 -- 172.21.15.93:0/854479693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c43c0 msgr2=0x7f6b3c164710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f6b3c0c43c0 0x7f6b3c164710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 -- 172.21.15.93:0/854479693 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b3c147170 con 0x7f6b3c0c1010 2020-11-20T12:14:45.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3ad9d700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b3c0c47a0 0x7f6b3c0c6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:45.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b3a59c700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c14c8a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6b2c00c710 tx=0x7f6b2c007c90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c007020 con 0x7f6b3c0c1010 2020-11-20T12:14:45.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2c001e90 con 0x7f6b3c0c1010 2020-11-20T12:14:45.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c147410 con 0x7f6b3c0c1010 2020-11-20T12:14:45.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c0073b0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.018+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b3c164c00 con 0x7f6b3c0c1010 2020-11-20T12:14:45.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.019+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6b3c0674d0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6b2c010070 con 0x7f6b3c0c1010 2020-11-20T12:14:45.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b2a7fc700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6b10080670 0x7f6b10082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b39d9b700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6b10080670 0x7f6b10082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f6b2c0a1dd0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b2a7fc700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:6800/23326,v1:172.21.15.132:6801/23326] conn(0x7f6b100893a0 0x7f6b1008b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 --> [v2:172.21.15.132:6800/23326,v1:172.21.15.132:6801/23326] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6b1008be20 con 0x7f6b100893a0 2020-11-20T12:14:45.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6b2c0a43b0 con 0x7f6b3c0c1010 2020-11-20T12:14:45.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b39d9b700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6b10080670 0x7f6b10082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6b30006e70 tx=0x7f6b30015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.020+0000 7f6b3ad9d700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:6800/23326,v1:172.21.15.132:6801/23326] conn(0x7f6b100893a0 0x7f6b1008b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.021+0000 7f6b3ad9d700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:6800/23326,v1:172.21.15.132:6801/23326] conn(0x7f6b100893a0 0x7f6b1008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.022+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== osd.5 v2:172.21.15.132:6800/23326 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f6b1008be20 con 0x7f6b100893a0 2020-11-20T12:14:45.039 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.036+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 --> [v2:172.21.15.132:6800/23326,v1:172.21.15.132:6801/23326] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6b3c14d030 con 0x7f6b100893a0 2020-11-20T12:14:45.040 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b2a7fc700 1 -- 172.21.15.93:0/854479693 <== osd.5 v2:172.21.15.132:6800/23326 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6b3c14d030 con 0x7f6b100893a0 2020-11-20T12:14:45.041 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:6800/23326,v1:172.21.15.132:6801/23326] conn(0x7f6b100893a0 msgr2=0x7f6b1008b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.041 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.132:6800/23326,v1:172.21.15.132:6801/23326] conn(0x7f6b100893a0 0x7f6b1008b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.041 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6b10080670 msgr2=0x7f6b10082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.041 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6b10080670 0x7f6b10082b30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f6b30006e70 tx=0x7f6b30015000).stop 2020-11-20T12:14:45.042 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6b3c0c1010 msgr2=0x7f6b3c14c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.042 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 --2- 172.21.15.93:0/854479693 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f6b3c0c1010 0x7f6b3c14c8a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f6b2c00c710 tx=0x7f6b2c007c90).stop 2020-11-20T12:14:45.042 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b3ad9d700 1 -- 172.21.15.93:0/854479693 reap_dead start 2020-11-20T12:14:45.042 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 shutdown_connections 2020-11-20T12:14:45.042 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 >> 172.21.15.93:0/854479693 conn(0x7f6b3c060130 msgr2=0x7f6b3c060510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.043 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 shutdown_connections 2020-11-20T12:14:45.043 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.037+0000 7f6b40f46700 1 -- 172.21.15.93:0/854479693 wait complete. 2020-11-20T12:14:45.051 INFO:teuthology.orchestra.run.smithi093.stdout:73014444039 2020-11-20T12:14:45.051 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2020-11-20T12:14:45.161 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.158+0000 7fa76b2f9700 1 Processor -- start 2020-11-20T12:14:45.162 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.159+0000 7fa76b2f9700 1 -- start start 2020-11-20T12:14:45.164 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.159+0000 7fa76b2f9700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7640c2290 0x7fa7640c2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.164 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.159+0000 7fa76b2f9700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7641530c0 0x7fa7640bd620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.164 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.159+0000 7fa76b2f9700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa76414f450 con 0x7fa7640bdb10 2020-11-20T12:14:45.165 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.159+0000 7fa76b2f9700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76414f6f0 con 0x7fa7641530c0 2020-11-20T12:14:45.165 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.159+0000 7fa76b2f9700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa76414f990 con 0x7fa7640c2290 2020-11-20T12:14:45.165 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa768894700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7641530c0 0x7fa7640bd620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.165 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa769896700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa7640bdb10 0x7fa76414c130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39902/0 (socket says 172.21.15.93:39902) 2020-11-20T12:14:45.165 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa768894700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fa7641530c0 0x7fa7640bd620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39200/0 (socket says 172.21.15.93:39200) 2020-11-20T12:14:45.166 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa769896700 1 -- 172.21.15.93:0/1283337251 learned_addr learned my addr 172.21.15.93:0/1283337251 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:45.166 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa769095700 1 --2- 172.21.15.93:0/1283337251 >> v2:172.21.15.132:3300/0 conn(0x7fa7640c2290 0x7fa7640c2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.166 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa768894700 1 -- 172.21.15.93:0/1283337251 >> v2:172.21.15.132:3300/0 conn(0x7fa7640c2290 msgr2=0x7fa7640c2670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.166 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa768894700 1 --2- 172.21.15.93:0/1283337251 >> v2:172.21.15.132:3300/0 conn(0x7fa7640c2290 0x7fa7640c2670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.167 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa768894700 1 -- 172.21.15.93:0/1283337251 >> v1:172.21.15.93:6789/0 conn(0x7fa7640bdb10 legacy=0x7fa76414c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.167 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa753fff700 1 -- 172.21.15.93:0/1283337251 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667213850 0 0) 0x7fa76414f450 con 0x7fa7640bdb10 2020-11-20T12:14:45.167 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa768894700 1 -- 172.21.15.93:0/1283337251 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76414fc30 con 0x7fa7641530c0 2020-11-20T12:14:45.167 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa768894700 1 --2- 172.21.15.93:0/1283337251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7641530c0 0x7fa7640bd620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa764061140 tx=0x7fa754006e30).ready entity=mon.1 client_cookie=ddc33c0d022d76b8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.167 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa753fff700 1 -- 172.21.15.93:0/1283337251 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754009840 con 0x7fa7641530c0 2020-11-20T12:14:45.168 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa753fff700 1 -- 172.21.15.93:0/1283337251 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa754000e90 con 0x7fa7641530c0 2020-11-20T12:14:45.168 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa753fff700 1 -- 172.21.15.93:0/1283337251 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754009bb0 con 0x7fa7641530c0 2020-11-20T12:14:45.168 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1283337251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7641530c0 msgr2=0x7fa7640bd620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.168 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.160+0000 7fa76b2f9700 1 --2- 172.21.15.93:0/1283337251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7641530c0 0x7fa7640bd620 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fa764061140 tx=0x7fa754006e30).stop 2020-11-20T12:14:45.168 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.161+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1283337251 shutdown_connections 2020-11-20T12:14:45.169 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.161+0000 7fa76b2f9700 1 --2- 172.21.15.93:0/1283337251 >> v2:172.21.15.132:3300/0 conn(0x7fa7640c2290 0x7fa7640c2670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.169 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.161+0000 7fa76b2f9700 1 --2- 172.21.15.93:0/1283337251 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7641530c0 0x7fa7640bd620 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.169 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.161+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1283337251 >> 172.21.15.93:0/1283337251 conn(0x7fa7640bb880 msgr2=0x7fa7640bbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.169 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.161+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1283337251 shutdown_connections 2020-11-20T12:14:45.169 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.161+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1283337251 wait complete. 2020-11-20T12:14:45.172 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.162+0000 7fa76b2f9700 1 Processor -- start 2020-11-20T12:14:45.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.162+0000 7fa76b2f9700 1 -- start start 2020-11-20T12:14:45.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7640bdb10 0x7fa7641102a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7640c2290 0x7fa76415f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7641530c0 0x7fa764161c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76415e700 con 0x7fa7641530c0 2020-11-20T12:14:45.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7641624e0 con 0x7fa7640c2290 2020-11-20T12:14:45.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa764162780 con 0x7fa7640bdb10 2020-11-20T12:14:45.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7640c2290 0x7fa76415f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7640c2290 0x7fa76415f0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39208/0 (socket says 172.21.15.93:39208) 2020-11-20T12:14:45.174 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 -- 172.21.15.93:0/1915317140 learned_addr learned my addr 172.21.15.93:0/1915317140 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 -- 172.21.15.93:0/1915317140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7640bdb10 msgr2=0x7fa7641102a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa769095700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7640bdb10 0x7fa7641102a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7640bdb10 0x7fa7641102a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.175 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 -- 172.21.15.93:0/1915317140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7641530c0 msgr2=0x7fa764161c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa7641530c0 0x7fa764161c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 -- 172.21.15.93:0/1915317140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa764162a20 con 0x7fa7640c2290 2020-11-20T12:14:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa768894700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7640c2290 0x7fa76415f0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa754006c90 tx=0x7fa754015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754011d70 con 0x7fa7640c2290 2020-11-20T12:14:45.176 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa75401e460 con 0x7fa7640c2290 2020-11-20T12:14:45.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa76415e960 con 0x7fa7640c2290 2020-11-20T12:14:45.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa75401e800 con 0x7fa7640c2290 2020-11-20T12:14:45.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.163+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa764110790 con 0x7fa7640c2290 2020-11-20T12:14:45.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.164+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa76405c2e0 con 0x7fa7640c2290 2020-11-20T12:14:45.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.165+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa754025030 con 0x7fa7640c2290 2020-11-20T12:14:45.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.165+0000 7fa7517fa700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa73c080670 0x7fa73c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.165+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa7540a4a10 con 0x7fa7640c2290 2020-11-20T12:14:45.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.165+0000 7fa769095700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa73c080670 0x7fa73c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.165+0000 7fa7517fa700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6826/23174,v1:172.21.15.93:6827/23174] conn(0x7fa73c0893a0 0x7fa73c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.165+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 --> [v2:172.21.15.93:6826/23174,v1:172.21.15.93:6827/23174] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa73c08be20 con 0x7fa73c0893a0 2020-11-20T12:14:45.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.166+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7540a4d00 con 0x7fa7640c2290 2020-11-20T12:14:45.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.166+0000 7fa769896700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6826/23174,v1:172.21.15.93:6827/23174] conn(0x7fa73c0893a0 0x7fa73c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.166+0000 7fa769095700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa73c080670 0x7fa73c082b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa760006fd0 tx=0x7fa760008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.166+0000 7fa769896700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6826/23174,v1:172.21.15.93:6827/23174] conn(0x7fa73c0893a0 0x7fa73c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.167+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== osd.6 v2:172.21.15.93:6826/23174 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fa73c08be20 con 0x7fa73c0893a0 2020-11-20T12:14:45.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.180+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 --> [v2:172.21.15.93:6826/23174,v1:172.21.15.93:6827/23174] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa76415f590 con 0x7fa73c0893a0 2020-11-20T12:14:45.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa7517fa700 1 -- 172.21.15.93:0/1915317140 <== osd.6 v2:172.21.15.93:6826/23174 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa76415f590 con 0x7fa73c0893a0 2020-11-20T12:14:45.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6826/23174,v1:172.21.15.93:6827/23174] conn(0x7fa73c0893a0 msgr2=0x7fa73c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6826/23174,v1:172.21.15.93:6827/23174] conn(0x7fa73c0893a0 0x7fa73c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa73c080670 msgr2=0x7fa73c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa73c080670 0x7fa73c082b30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fa760006fd0 tx=0x7fa760008040).stop 2020-11-20T12:14:45.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7640c2290 msgr2=0x7fa76415f0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 --2- 172.21.15.93:0/1915317140 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa7640c2290 0x7fa76415f0a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fa754006c90 tx=0x7fa754015000).stop 2020-11-20T12:14:45.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa769896700 1 -- 172.21.15.93:0/1915317140 reap_dead start 2020-11-20T12:14:45.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 shutdown_connections 2020-11-20T12:14:45.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 >> 172.21.15.93:0/1915317140 conn(0x7fa7640bb880 msgr2=0x7fa76414b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 shutdown_connections 2020-11-20T12:14:45.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.181+0000 7fa76b2f9700 1 -- 172.21.15.93:0/1915317140 wait complete. 2020-11-20T12:14:45.195 INFO:teuthology.orchestra.run.smithi093.stdout:73014444039 2020-11-20T12:14:45.196 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2020-11-20T12:14:45.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.302+0000 7f9f55bd4700 1 Processor -- start 2020-11-20T12:14:45.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.302+0000 7f9f55bd4700 1 -- start start 2020-11-20T12:14:45.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f55bd4700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9f5014a6c0 0x7f9f5014aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f55bd4700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9f500c03f0 0x7f9f500c0880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f55bd4700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f500be330 con 0x7f9f50151440 2020-11-20T12:14:45.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f55bd4700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5014d5c0 con 0x7f9f5014a6c0 2020-11-20T12:14:45.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f55bd4700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f5014d860 con 0x7f9f500c03f0 2020-11-20T12:14:45.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f54bd2700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f9f5014a6c0 0x7f9f5014aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f4ffff700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f9f50151440 0x7f9f500bbd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39448/0 (socket says 172.21.15.93:39448) 2020-11-20T12:14:45.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f4ffff700 1 -- 172.21.15.93:0/1286159371 learned_addr learned my addr 172.21.15.93:0/1286159371 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:45.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f553d3700 1 --2- 172.21.15.93:0/1286159371 >> v2:172.21.15.132:3300/0 conn(0x7f9f500c03f0 0x7f9f500c0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.309 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f54bd2700 1 -- 172.21.15.93:0/1286159371 >> v2:172.21.15.132:3300/0 conn(0x7f9f500c03f0 msgr2=0x7f9f500c0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f54bd2700 1 --2- 172.21.15.93:0/1286159371 >> v2:172.21.15.132:3300/0 conn(0x7f9f500c03f0 0x7f9f500c0880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f54bd2700 1 -- 172.21.15.93:0/1286159371 >> v1:172.21.15.66:6789/0 conn(0x7f9f50151440 legacy=0x7f9f500bbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f54bd2700 1 -- 172.21.15.93:0/1286159371 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5014db00 con 0x7f9f5014a6c0 2020-11-20T12:14:45.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f4f7fe700 1 -- 172.21.15.93:0/1286159371 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2559144384 0 0) 0x7f9f500be330 con 0x7f9f50151440 2020-11-20T12:14:45.310 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.303+0000 7f9f54bd2700 1 --2- 172.21.15.93:0/1286159371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 0x7f9f5014aaa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9f50067ac0 tx=0x7f9f44006ec0).ready entity=mon.0 client_cookie=edea0d208a633312 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f4f7fe700 1 -- 172.21.15.93:0/1286159371 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f44014070 con 0x7f9f5014a6c0 2020-11-20T12:14:45.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f4f7fe700 1 -- 172.21.15.93:0/1286159371 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f44000e90 con 0x7f9f5014a6c0 2020-11-20T12:14:45.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f4f7fe700 1 -- 172.21.15.93:0/1286159371 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4400a9e0 con 0x7f9f5014a6c0 2020-11-20T12:14:45.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 -- 172.21.15.93:0/1286159371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 msgr2=0x7f9f5014aaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.311 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 --2- 172.21.15.93:0/1286159371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 0x7f9f5014aaa0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f9f50067ac0 tx=0x7f9f44006ec0).stop 2020-11-20T12:14:45.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 -- 172.21.15.93:0/1286159371 shutdown_connections 2020-11-20T12:14:45.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 --2- 172.21.15.93:0/1286159371 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 0x7f9f5014aaa0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 --2- 172.21.15.93:0/1286159371 >> v2:172.21.15.132:3300/0 conn(0x7f9f500c03f0 0x7f9f500c0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 -- 172.21.15.93:0/1286159371 >> 172.21.15.93:0/1286159371 conn(0x7f9f50067200 msgr2=0x7f9f500622d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.312 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 -- 172.21.15.93:0/1286159371 shutdown_connections 2020-11-20T12:14:45.313 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.304+0000 7f9f55bd4700 1 -- 172.21.15.93:0/1286159371 wait complete. 2020-11-20T12:14:45.315 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.305+0000 7f9f55bd4700 1 Processor -- start 2020-11-20T12:14:45.316 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.305+0000 7f9f55bd4700 1 -- start start 2020-11-20T12:14:45.316 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f55bd4700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f500c03f0 0x7f9f5015efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.316 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f55bd4700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 0x7f9f5010f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.316 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f55bd4700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f50151440 0x7f9f50110c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f55bd4700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f5015e3e0 con 0x7f9f5014a6c0 2020-11-20T12:14:45.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f55bd4700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50113c30 con 0x7f9f50151440 2020-11-20T12:14:45.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f55bd4700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f50113ed0 con 0x7f9f500c03f0 2020-11-20T12:14:45.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f553d3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f50151440 0x7f9f50110c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.317 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f553d3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f50151440 0x7f9f50110c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39226/0 (socket says 172.21.15.93:39226) 2020-11-20T12:14:45.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f553d3700 1 -- 172.21.15.93:0/2974231228 learned_addr learned my addr 172.21.15.93:0/2974231228 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f54bd2700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f500c03f0 0x7f9f5015efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.306+0000 7f9f4ffff700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 0x7f9f5010f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.318 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f553d3700 1 -- 172.21.15.93:0/2974231228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f500c03f0 msgr2=0x7f9f5015efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.319 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f553d3700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f500c03f0 0x7f9f5015efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.319 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f553d3700 1 -- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 msgr2=0x7f9f5010f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.319 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f553d3700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f9f5014a6c0 0x7f9f5010f860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.319 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f553d3700 1 -- 172.21.15.93:0/2974231228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f5015e5c0 con 0x7f9f50151440 2020-11-20T12:14:45.319 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f553d3700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f50151440 0x7f9f50110c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9f4800ed20 tx=0x7f9f48009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.320 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800ee80 con 0x7f9f50151440 2020-11-20T12:14:45.320 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f4800cb30 con 0x7f9f50151440 2020-11-20T12:14:45.320 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f5015e860 con 0x7f9f50151440 2020-11-20T12:14:45.320 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f4800ced0 con 0x7f9f50151440 2020-11-20T12:14:45.320 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.307+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f500bd920 con 0x7f9f50151440 2020-11-20T12:14:45.321 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.308+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9f5005ca60 con 0x7f9f50151440 2020-11-20T12:14:45.321 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f9f48022070 con 0x7f9f50151440 2020-11-20T12:14:45.321 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f4cff9700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9f280806a0 0x7f9f28082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.321 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f9f480a36b0 con 0x7f9f50151440 2020-11-20T12:14:45.321 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f54bd2700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9f280806a0 0x7f9f28082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.322 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f4cff9700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:6824/22845,v1:172.21.15.66:6825/22845] conn(0x7f9f28089260 0x7f9f2808b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.322 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 --> [v2:172.21.15.66:6824/22845,v1:172.21.15.66:6825/22845] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9f2808bce0 con 0x7f9f28089260 2020-11-20T12:14:45.322 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9f480a3a20 con 0x7f9f50151440 2020-11-20T12:14:45.322 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.309+0000 7f9f54bd2700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9f280806a0 0x7f9f28082b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9f44006f00 tx=0x7f9f5014dc90).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.322 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.310+0000 7f9f4ffff700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:6824/22845,v1:172.21.15.66:6825/22845] conn(0x7f9f28089260 0x7f9f2808b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.323 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.310+0000 7f9f4ffff700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:6824/22845,v1:172.21.15.66:6825/22845] conn(0x7f9f28089260 0x7f9f2808b680 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.323 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.311+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== osd.7 v2:172.21.15.66:6824/22845 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f9f2808bce0 con 0x7f9f28089260 2020-11-20T12:14:45.328 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.325+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 --> [v2:172.21.15.66:6824/22845,v1:172.21.15.66:6825/22845] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9f500699c0 con 0x7f9f28089260 2020-11-20T12:14:45.329 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f4cff9700 1 -- 172.21.15.93:0/2974231228 <== osd.7 v2:172.21.15.66:6824/22845 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9f500699c0 con 0x7f9f28089260 2020-11-20T12:14:45.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:6824/22845,v1:172.21.15.66:6825/22845] conn(0x7f9f28089260 msgr2=0x7f9f2808b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.66:6824/22845,v1:172.21.15.66:6825/22845] conn(0x7f9f28089260 0x7f9f2808b680 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9f280806a0 msgr2=0x7f9f28082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f9f280806a0 0x7f9f28082b60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f9f44006f00 tx=0x7f9f5014dc90).stop 2020-11-20T12:14:45.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f50151440 msgr2=0x7f9f50110c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 --2- 172.21.15.93:0/2974231228 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f9f50151440 0x7f9f50110c40 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f9f4800ed20 tx=0x7f9f48009220).stop 2020-11-20T12:14:45.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f553d3700 1 -- 172.21.15.93:0/2974231228 reap_dead start 2020-11-20T12:14:45.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 shutdown_connections 2020-11-20T12:14:45.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 >> 172.21.15.93:0/2974231228 conn(0x7f9f50067200 msgr2=0x7f9f500bc050 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 shutdown_connections 2020-11-20T12:14:45.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.326+0000 7f9f55bd4700 1 -- 172.21.15.93:0/2974231228 wait complete. 2020-11-20T12:14:45.340 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:45.340 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.8 flush_pg_stats 2020-11-20T12:14:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.446+0000 7fa23c80c700 1 Processor -- start 2020-11-20T12:14:45.450 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.446+0000 7fa23c80c700 1 -- start start 2020-11-20T12:14:45.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa23c80c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa2380c1010 0x7fa238063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa23c80c700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2380c0230 con 0x7fa2380c47a0 2020-11-20T12:14:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa23c80c700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa238151510 con 0x7fa2380c43c0 2020-11-20T12:14:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa23c80c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2380c4bf0 con 0x7fa2380c1010 2020-11-20T12:14:45.456 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa236d9d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa2380c47a0 0x7fa238150350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39932/0 (socket says 172.21.15.93:39932) 2020-11-20T12:14:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa236d9d700 1 -- 172.21.15.93:0/3181583687 learned_addr learned my addr 172.21.15.93:0/3181583687 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa22ffff700 1 --2- 172.21.15.93:0/3181583687 >> v2:172.21.15.66:3300/0 conn(0x7fa2380c1010 0x7fa238063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.447+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862542975 0 0) 0x7fa2380c0230 con 0x7fa2380c47a0 2020-11-20T12:14:45.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa218003280 con 0x7fa2380c47a0 2020-11-20T12:14:45.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1571456515 0 0) 0x7fa238151510 con 0x7fa2380c43c0 2020-11-20T12:14:45.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2380c0230 con 0x7fa2380c43c0 2020-11-20T12:14:45.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 734185212 0 0) 0x7fa218003280 con 0x7fa2380c47a0 2020-11-20T12:14:45.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 >> v2:172.21.15.66:3300/0 conn(0x7fa2380c1010 msgr2=0x7fa238063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 --2- 172.21.15.93:0/3181583687 >> v2:172.21.15.66:3300/0 conn(0x7fa2380c1010 0x7fa238063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 >> v1:172.21.15.132:6789/0 conn(0x7fa2380c43c0 legacy=0x7fa2380c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2381517b0 con 0x7fa2380c47a0 2020-11-20T12:14:45.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7fa2300018a0 con 0x7fa2380c47a0 2020-11-20T12:14:45.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 >> v1:172.21.15.93:6789/0 conn(0x7fa2380c47a0 legacy=0x7fa238150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa218003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa218004520 0x7fa2180049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa218004e90 0x7fa21800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2380c4bf0 con 0x7fa218004520 2020-11-20T12:14:45.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21800bc60 con 0x7fa218003980 2020-11-20T12:14:45.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa21800bda0 con 0x7fa218004e90 2020-11-20T12:14:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa23659c700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa218003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa22ffff700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa218004520 0x7fa2180049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa236d9d700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa218004e90 0x7fa21800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa23659c700 1 -- 172.21.15.93:0/3181583687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa218004e90 msgr2=0x7fa21800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa23659c700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa218004e90 0x7fa21800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa23659c700 1 -- 172.21.15.93:0/3181583687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa218004520 msgr2=0x7fa2180049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa23659c700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa218004520 0x7fa2180049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa23659c700 1 -- 172.21.15.93:0/3181583687 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa218003280 con 0x7fa218003980 2020-11-20T12:14:45.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa236d9d700 1 -- 172.21.15.93:0/3181583687 reap_dead start 2020-11-20T12:14:45.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa23659c700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa218003d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa228001af0 tx=0x7fa228007bd0).ready entity=mon.1 client_cookie=1377adafde799a7f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.448+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228007020 con 0x7fa218003980 2020-11-20T12:14:45.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa228007180 con 0x7fa218003980 2020-11-20T12:14:45.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa235d9b700 1 -- 172.21.15.93:0/3181583687 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa22800c7f0 con 0x7fa218003980 2020-11-20T12:14:45.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa23c80c700 1 -- 172.21.15.93:0/3181583687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 msgr2=0x7fa218003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa23c80c700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa218003d80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7fa228001af0 tx=0x7fa228007bd0).stop 2020-11-20T12:14:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa23c80c700 1 -- 172.21.15.93:0/3181583687 shutdown_connections 2020-11-20T12:14:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa23c80c700 1 --2- 172.21.15.93:0/3181583687 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa218003d80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa23c80c700 1 -- 172.21.15.93:0/3181583687 >> 172.21.15.93:0/3181583687 conn(0x7fa238060130 msgr2=0x7fa238060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa23c80c700 1 -- 172.21.15.93:0/3181583687 shutdown_connections 2020-11-20T12:14:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.449+0000 7fa23c80c700 1 -- 172.21.15.93:0/3181583687 wait complete. 2020-11-20T12:14:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.450+0000 7fa23c80c700 1 Processor -- start 2020-11-20T12:14:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.450+0000 7fa23c80c700 1 -- start start 2020-11-20T12:14:45.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa238164300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238160fd0 0x7fa23814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa238158330 0x7fa2381559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2381647f0 con 0x7fa238160fd0 2020-11-20T12:14:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238160370 con 0x7fa218003980 2020-11-20T12:14:45.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa238152ba0 con 0x7fa238158330 2020-11-20T12:14:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa238164300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa238164300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39244/0 (socket says 172.21.15.93:39244) 2020-11-20T12:14:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 -- 172.21.15.93:0/1413418076 learned_addr learned my addr 172.21.15.93:0/1413418076 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 -- 172.21.15.93:0/1413418076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa238158330 msgr2=0x7fa2381559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa238158330 0x7fa2381559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:45.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 -- 172.21.15.93:0/1413418076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238160fd0 msgr2=0x7fa23814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa238160fd0 0x7fa23814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:45.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 -- 172.21.15.93:0/1413418076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2381124b0 con 0x7fa218003980 2020-11-20T12:14:45.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23659c700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa238164300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa228001a10 tx=0x7fa228015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228014770 con 0x7fa218003980 2020-11-20T12:14:45.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2280148f0 con 0x7fa218003980 2020-11-20T12:14:45.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa238112750 con 0x7fa218003980 2020-11-20T12:14:45.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa228014cb0 con 0x7fa218003980 2020-11-20T12:14:45.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.451+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa238160890 con 0x7fa218003980 2020-11-20T12:14:45.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.452+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2380674d0 con 0x7fa218003980 2020-11-20T12:14:45.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.453+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa228025020 con 0x7fa218003980 2020-11-20T12:14:45.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.453+0000 7fa22e7fc700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa214080670 0x7fa214082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.453+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa2280a39a0 con 0x7fa218003980 2020-11-20T12:14:45.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.453+0000 7fa22ffff700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa214080670 0x7fa214082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.453+0000 7fa22e7fc700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.132:6816/23327,v1:172.21.15.132:6817/23327] conn(0x7fa2140893a0 0x7fa21408b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.453+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 --> [v2:172.21.15.132:6816/23327,v1:172.21.15.132:6817/23327] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa21408be20 con 0x7fa2140893a0 2020-11-20T12:14:45.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.453+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2280a8220 con 0x7fa218003980 2020-11-20T12:14:45.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.454+0000 7fa22ffff700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa214080670 0x7fa214082b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa238157fc0 tx=0x7fa220006e30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.454+0000 7fa236d9d700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.132:6816/23327,v1:172.21.15.132:6817/23327] conn(0x7fa2140893a0 0x7fa21408b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.454+0000 7fa236d9d700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.132:6816/23327,v1:172.21.15.132:6817/23327] conn(0x7fa2140893a0 0x7fa21408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.455+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== osd.8 v2:172.21.15.132:6816/23327 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fa21408be20 con 0x7fa2140893a0 2020-11-20T12:14:45.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.469+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 --> [v2:172.21.15.132:6816/23327,v1:172.21.15.132:6817/23327] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa23805cd50 con 0x7fa2140893a0 2020-11-20T12:14:45.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa22e7fc700 1 -- 172.21.15.93:0/1413418076 <== osd.8 v2:172.21.15.132:6816/23327 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa23805cd50 con 0x7fa2140893a0 2020-11-20T12:14:45.482 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 >> [v2:172.21.15.132:6816/23327,v1:172.21.15.132:6817/23327] conn(0x7fa2140893a0 msgr2=0x7fa21408b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.482 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.132:6816/23327,v1:172.21.15.132:6817/23327] conn(0x7fa2140893a0 0x7fa21408b7c0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.482 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa214080670 msgr2=0x7fa214082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.482 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa214080670 0x7fa214082b30 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa238157fc0 tx=0x7fa220006e30).stop 2020-11-20T12:14:45.482 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 msgr2=0x7fa238164300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.483 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 --2- 172.21.15.93:0/1413418076 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa218003980 0x7fa238164300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fa228001a10 tx=0x7fa228015000).stop 2020-11-20T12:14:45.483 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa236d9d700 1 -- 172.21.15.93:0/1413418076 reap_dead start 2020-11-20T12:14:45.483 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 shutdown_connections 2020-11-20T12:14:45.483 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.470+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 >> 172.21.15.93:0/1413418076 conn(0x7fa238060130 msgr2=0x7fa2380c1460 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.483 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.471+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 shutdown_connections 2020-11-20T12:14:45.484 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.471+0000 7fa23c80c700 1 -- 172.21.15.93:0/1413418076 wait complete. 2020-11-20T12:14:45.484 INFO:teuthology.orchestra.run.smithi093.stdout:73014444040 2020-11-20T12:14:45.485 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.9 flush_pg_stats 2020-11-20T12:14:45.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.599+0000 7f605f1f3700 1 Processor -- start 2020-11-20T12:14:45.603 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.599+0000 7f605f1f3700 1 -- start start 2020-11-20T12:14:45.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605f1f3700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60580c43c0 0x7f6058063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605f1f3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f60580c47a0 0x7f60580bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.614 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605f1f3700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60581552c0 0x7f60580c0900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.614 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605f1f3700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60580c0230 con 0x7f60580c47a0 2020-11-20T12:14:45.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605f1f3700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6058151510 con 0x7f60580c43c0 2020-11-20T12:14:45.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605f1f3700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60581517b0 con 0x7f60581552c0 2020-11-20T12:14:45.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605cf8f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60580c43c0 0x7f6058063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605cf8f700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f60580c43c0 0x7f6058063890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39254/0 (socket says 172.21.15.93:39254) 2020-11-20T12:14:45.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.600+0000 7f605cf8f700 1 -- 172.21.15.93:0/2218406038 learned_addr learned my addr 172.21.15.93:0/2218406038 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605d790700 1 --2- 172.21.15.93:0/2218406038 >> v2:172.21.15.132:3300/0 conn(0x7f60581552c0 0x7f60580c0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f6057fff700 1 --2- 172.21.15.93:0/2218406038 >> v2:172.21.15.66:3300/0 conn(0x7f60580c47a0 0x7f60580bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605cf8f700 1 -- 172.21.15.93:0/2218406038 >> v2:172.21.15.132:3300/0 conn(0x7f60581552c0 msgr2=0x7f60580c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605cf8f700 1 --2- 172.21.15.93:0/2218406038 >> v2:172.21.15.132:3300/0 conn(0x7f60581552c0 0x7f60580c0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.617 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605cf8f700 1 -- 172.21.15.93:0/2218406038 >> v2:172.21.15.66:3300/0 conn(0x7f60580c47a0 msgr2=0x7f60580bfb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.617 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605cf8f700 1 --2- 172.21.15.93:0/2218406038 >> v2:172.21.15.66:3300/0 conn(0x7f60580c47a0 0x7f60580bfb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.617 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605cf8f700 1 -- 172.21.15.93:0/2218406038 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058151a50 con 0x7f60580c43c0 2020-11-20T12:14:45.617 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605cf8f700 1 --2- 172.21.15.93:0/2218406038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60580c43c0 0x7f6058063890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f6058063120 tx=0x7f604c006ef0).ready entity=mon.1 client_cookie=bea6884ad3e4976e server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.618 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f60577fe700 1 -- 172.21.15.93:0/2218406038 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c00b680 con 0x7f60580c43c0 2020-11-20T12:14:45.618 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f60577fe700 1 -- 172.21.15.93:0/2218406038 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604c000e90 con 0x7f60580c43c0 2020-11-20T12:14:45.618 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f60577fe700 1 -- 172.21.15.93:0/2218406038 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604c00b9f0 con 0x7f60580c43c0 2020-11-20T12:14:45.618 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605f1f3700 1 -- 172.21.15.93:0/2218406038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60580c43c0 msgr2=0x7f6058063890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.618 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605f1f3700 1 --2- 172.21.15.93:0/2218406038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60580c43c0 0x7f6058063890 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f6058063120 tx=0x7f604c006ef0).stop 2020-11-20T12:14:45.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.601+0000 7f605f1f3700 1 -- 172.21.15.93:0/2218406038 shutdown_connections 2020-11-20T12:14:45.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.602+0000 7f605f1f3700 1 --2- 172.21.15.93:0/2218406038 >> v2:172.21.15.132:3300/0 conn(0x7f60581552c0 0x7f60580c0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.602+0000 7f605f1f3700 1 --2- 172.21.15.93:0/2218406038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60580c43c0 0x7f6058063890 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.602+0000 7f605f1f3700 1 --2- 172.21.15.93:0/2218406038 >> v2:172.21.15.66:3300/0 conn(0x7f60580c47a0 0x7f60580bfb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.602+0000 7f605f1f3700 1 -- 172.21.15.93:0/2218406038 >> 172.21.15.93:0/2218406038 conn(0x7f6058060130 msgr2=0x7f6058060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.602+0000 7f605f1f3700 1 -- 172.21.15.93:0/2218406038 shutdown_connections 2020-11-20T12:14:45.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.602+0000 7f605f1f3700 1 -- 172.21.15.93:0/2218406038 wait complete. 2020-11-20T12:14:45.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.603+0000 7f605f1f3700 1 Processor -- start 2020-11-20T12:14:45.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.603+0000 7f605f1f3700 1 -- start start 2020-11-20T12:14:45.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60580c43c0 0x7f6058156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60580c47a0 0x7f6058154460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60581552c0 0x7f605814d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605814e790 con 0x7f60580c47a0 2020-11-20T12:14:45.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6058154950 con 0x7f60581552c0 2020-11-20T12:14:45.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6058163af0 con 0x7f60580c43c0 2020-11-20T12:14:45.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60581552c0 0x7f605814d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60581552c0 0x7f605814d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39264/0 (socket says 172.21.15.93:39264) 2020-11-20T12:14:45.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 -- 172.21.15.93:0/4005044923 learned_addr learned my addr 172.21.15.93:0/4005044923 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605cf8f700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60580c43c0 0x7f6058156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f6057fff700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60580c47a0 0x7f6058154460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 -- 172.21.15.93:0/4005044923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60580c43c0 msgr2=0x7f6058156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60580c43c0 0x7f6058156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 -- 172.21.15.93:0/4005044923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60580c47a0 msgr2=0x7f6058154460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f60580c47a0 0x7f6058154460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 -- 172.21.15.93:0/4005044923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6058112c90 con 0x7f60581552c0 2020-11-20T12:14:45.625 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605d790700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60581552c0 0x7f605814d9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f605000ed20 tx=0x7f6050009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.625 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000ee80 con 0x7f60581552c0 2020-11-20T12:14:45.625 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f605000cb30 con 0x7f60581552c0 2020-11-20T12:14:45.625 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6058112f30 con 0x7f60581552c0 2020-11-20T12:14:45.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f605000ced0 con 0x7f60581552c0 2020-11-20T12:14:45.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.604+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6058163d70 con 0x7f60581552c0 2020-11-20T12:14:45.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.605+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6058164380 con 0x7f60581552c0 2020-11-20T12:14:45.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.606+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f6050022070 con 0x7f60581552c0 2020-11-20T12:14:45.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.606+0000 7f6054ff9700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6030080670 0x7f6030082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.606+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f60500a3650 con 0x7f60581552c0 2020-11-20T12:14:45.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.606+0000 7f605cf8f700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6030080670 0x7f6030082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.607+0000 7f6054ff9700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6818/23175,v1:172.21.15.93:6819/23175] conn(0x7f6030089230 0x7f603008b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.607+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 --> [v2:172.21.15.93:6818/23175,v1:172.21.15.93:6819/23175] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f603008bcb0 con 0x7f6030089230 2020-11-20T12:14:45.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.607+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7f60500a3940 con 0x7f60581552c0 2020-11-20T12:14:45.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.607+0000 7f6057fff700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6818/23175,v1:172.21.15.93:6819/23175] conn(0x7f6030089230 0x7f603008b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.607+0000 7f605cf8f700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6030080670 0x7f6030082b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f604c006f30 tx=0x7f604c016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.607+0000 7f6057fff700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6818/23175,v1:172.21.15.93:6819/23175] conn(0x7f6030089230 0x7f603008b650 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.629 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.608+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== osd.9 v2:172.21.15.93:6818/23175 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7f603008bcb0 con 0x7f6030089230 2020-11-20T12:14:45.630 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 --> [v2:172.21.15.93:6818/23175,v1:172.21.15.93:6819/23175] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f605814e110 con 0x7f6030089230 2020-11-20T12:14:45.630 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f6054ff9700 1 -- 172.21.15.93:0/4005044923 <== osd.9 v2:172.21.15.93:6818/23175 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f605814e110 con 0x7f6030089230 2020-11-20T12:14:45.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6818/23175,v1:172.21.15.93:6819/23175] conn(0x7f6030089230 msgr2=0x7f603008b650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f605f1f3700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6818/23175,v1:172.21.15.93:6819/23175] conn(0x7f6030089230 0x7f603008b650 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6030080670 msgr2=0x7f6030082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f605f1f3700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6030080670 0x7f6030082b30 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f604c006f30 tx=0x7f604c016000).stop 2020-11-20T12:14:45.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60581552c0 msgr2=0x7f605814d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.622+0000 7f605f1f3700 1 --2- 172.21.15.93:0/4005044923 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f60581552c0 0x7f605814d9e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f605000ed20 tx=0x7f6050009220).stop 2020-11-20T12:14:45.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.623+0000 7f605d790700 1 -- 172.21.15.93:0/4005044923 reap_dead start 2020-11-20T12:14:45.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.623+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 shutdown_connections 2020-11-20T12:14:45.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.623+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 >> 172.21.15.93:0/4005044923 conn(0x7f6058060130 msgr2=0x7f60580676b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.633 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.623+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 shutdown_connections 2020-11-20T12:14:45.633 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.623+0000 7f605f1f3700 1 -- 172.21.15.93:0/4005044923 wait complete. 2020-11-20T12:14:45.636 INFO:teuthology.orchestra.run.smithi093.stdout:73014444039 2020-11-20T12:14:45.637 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.10 flush_pg_stats 2020-11-20T12:14:45.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.747+0000 7fd0c98d7700 1 Processor -- start 2020-11-20T12:14:45.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.748+0000 7fd0c98d7700 1 -- start start 2020-11-20T12:14:45.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.748+0000 7fd0c98d7700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd0c4067c60 0x7fd0c40c4560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.748+0000 7fd0c98d7700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c40c1c10 con 0x7fd0c40c4180 2020-11-20T12:14:45.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.748+0000 7fd0c98d7700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0c4064310 con 0x7fd0c414ffb0 2020-11-20T12:14:45.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.748+0000 7fd0c98d7700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0c4065460 con 0x7fd0c4067c60 2020-11-20T12:14:45.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.748+0000 7fd0c88d5700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fd0c40c4180 0x7fd0c4067550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39968/0 (socket says 172.21.15.93:39968) 2020-11-20T12:14:45.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.748+0000 7fd0c88d5700 1 -- 172.21.15.93:0/3063184609 learned_addr learned my addr 172.21.15.93:0/3063184609 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:45.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c3fff700 1 --2- 172.21.15.93:0/3063184609 >> v2:172.21.15.66:3300/0 conn(0x7fd0c4067c60 0x7fd0c40c4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c37fe700 1 -- 172.21.15.93:0/3063184609 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1310846556 0 0) 0x7fd0c40c1c10 con 0x7fd0c40c4180 2020-11-20T12:14:45.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c37fe700 1 -- 172.21.15.93:0/3063184609 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd0a8003280 con 0x7fd0c40c4180 2020-11-20T12:14:45.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c37fe700 1 -- 172.21.15.93:0/3063184609 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4008117297 0 0) 0x7fd0a8003280 con 0x7fd0c40c4180 2020-11-20T12:14:45.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c3fff700 1 -- 172.21.15.93:0/3063184609 >> v1:172.21.15.132:6789/0 conn(0x7fd0c414ffb0 legacy=0x7fd0c4150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c3fff700 1 -- 172.21.15.93:0/3063184609 >> v1:172.21.15.93:6789/0 conn(0x7fd0c40c4180 legacy=0x7fd0c4067550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c3fff700 1 -- 172.21.15.93:0/3063184609 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c4064540 con 0x7fd0c4067c60 2020-11-20T12:14:45.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c3fff700 1 --2- 172.21.15.93:0/3063184609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 0x7fd0c40c4560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd0b0006fd0 tx=0x7fd0b0006e30).ready entity=mon.0 client_cookie=ec19cff1f4e2b645 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c37fe700 1 -- 172.21.15.93:0/3063184609 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b8001520 con 0x7fd0c4067c60 2020-11-20T12:14:45.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c37fe700 1 -- 172.21.15.93:0/3063184609 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b0000e90 con 0x7fd0c4067c60 2020-11-20T12:14:45.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.749+0000 7fd0c37fe700 1 -- 172.21.15.93:0/3063184609 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0009770 con 0x7fd0c4067c60 2020-11-20T12:14:45.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.750+0000 7fd0c98d7700 1 -- 172.21.15.93:0/3063184609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 msgr2=0x7fd0c40c4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.758 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.750+0000 7fd0c98d7700 1 --2- 172.21.15.93:0/3063184609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 0x7fd0c40c4560 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd0b0006fd0 tx=0x7fd0b0006e30).stop 2020-11-20T12:14:45.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.750+0000 7fd0c98d7700 1 -- 172.21.15.93:0/3063184609 shutdown_connections 2020-11-20T12:14:45.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.750+0000 7fd0c98d7700 1 --2- 172.21.15.93:0/3063184609 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 0x7fd0c40c4560 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.759 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.750+0000 7fd0c98d7700 1 -- 172.21.15.93:0/3063184609 >> 172.21.15.93:0/3063184609 conn(0x7fd0c4062440 msgr2=0x7fd0c4062850 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.750+0000 7fd0c98d7700 1 -- 172.21.15.93:0/3063184609 shutdown_connections 2020-11-20T12:14:45.760 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.750+0000 7fd0c98d7700 1 -- 172.21.15.93:0/3063184609 wait complete. 2020-11-20T12:14:45.764 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.751+0000 7fd0c98d7700 1 Processor -- start 2020-11-20T12:14:45.764 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.751+0000 7fd0c98d7700 1 -- start start 2020-11-20T12:14:45.764 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 0x7fd0c414bd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0c40c4180 0x7fd0c414c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0c414ffb0 0x7fd0c4161e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c414cd10 con 0x7fd0c4067c60 2020-11-20T12:14:45.765 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c41617e0 con 0x7fd0c40c4180 2020-11-20T12:14:45.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0c414c710 con 0x7fd0c414ffb0 2020-11-20T12:14:45.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0c40c4180 0x7fd0c414c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0c40c4180 0x7fd0c414c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39278/0 (socket says 172.21.15.93:39278) 2020-11-20T12:14:45.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 -- 172.21.15.93:0/1965164945 learned_addr learned my addr 172.21.15.93:0/1965164945 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c88d5700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 0x7fd0c414bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.767 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c90d6700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0c414ffb0 0x7fd0c4161e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.767 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 -- 172.21.15.93:0/1965164945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0c414ffb0 msgr2=0x7fd0c4161e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.767 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd0c414ffb0 0x7fd0c4161e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 -- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 msgr2=0x7fd0c414bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd0c4067c60 0x7fd0c414bd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 -- 172.21.15.93:0/1965164945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0c40b0330 con 0x7fd0c40c4180 2020-11-20T12:14:45.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c3fff700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0c40c4180 0x7fd0c414c220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd0c41520d0 tx=0x7fd0b0015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b0011b70 con 0x7fd0c40c4180 2020-11-20T12:14:45.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0b0011cd0 con 0x7fd0c40c4180 2020-11-20T12:14:45.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0c40c6a90 con 0x7fd0c40c4180 2020-11-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0b001d5d0 con 0x7fd0c40c4180 2020-11-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.752+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0c40b0830 con 0x7fd0c40c4180 2020-11-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.753+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd0c405ca60 con 0x7fd0c40c4180 2020-11-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.754+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd0b001a040 con 0x7fd0c40c4180 2020-11-20T12:14:45.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.754+0000 7fd0c0ff9700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd09c080670 0x7fd09c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.771 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.754+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd0b00a4310 con 0x7fd0c40c4180 2020-11-20T12:14:45.771 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.754+0000 7fd0c88d5700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd09c080670 0x7fd09c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.771 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.754+0000 7fd0c0ff9700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:6816/22848,v1:172.21.15.66:6817/22848] conn(0x7fd09c0893a0 0x7fd09c08b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.771 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.754+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 --> [v2:172.21.15.66:6816/22848,v1:172.21.15.66:6817/22848] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd09c08be20 con 0x7fd09c0893a0 2020-11-20T12:14:45.772 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.754+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd0b00a4680 con 0x7fd0c40c4180 2020-11-20T12:14:45.772 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.755+0000 7fd0c88d5700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd09c080670 0x7fd09c082b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd0b8004a50 tx=0x7fd0b80012c0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.773 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.755+0000 7fd0c90d6700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:6816/22848,v1:172.21.15.66:6817/22848] conn(0x7fd09c0893a0 0x7fd09c08b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.773 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.755+0000 7fd0c90d6700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:6816/22848,v1:172.21.15.66:6817/22848] conn(0x7fd09c0893a0 0x7fd09c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.773 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.756+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== osd.10 v2:172.21.15.66:6816/22848 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fd09c08be20 con 0x7fd09c0893a0 2020-11-20T12:14:45.775 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.770+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 --> [v2:172.21.15.66:6816/22848,v1:172.21.15.66:6817/22848] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd0c405c550 con 0x7fd09c0893a0 2020-11-20T12:14:45.775 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.770+0000 7fd0c0ff9700 1 -- 172.21.15.93:0/1965164945 <== osd.10 v2:172.21.15.66:6816/22848 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd0c405c550 con 0x7fd09c0893a0 2020-11-20T12:14:45.775 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:6816/22848,v1:172.21.15.66:6817/22848] conn(0x7fd09c0893a0 msgr2=0x7fd09c08b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.776 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.66:6816/22848,v1:172.21.15.66:6817/22848] conn(0x7fd09c0893a0 0x7fd09c08b7c0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.776 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd09c080670 msgr2=0x7fd09c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.776 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd09c080670 0x7fd09c082b30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fd0b8004a50 tx=0x7fd0b80012c0).stop 2020-11-20T12:14:45.776 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0c40c4180 msgr2=0x7fd0c414c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.776 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 --2- 172.21.15.93:0/1965164945 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd0c40c4180 0x7fd0c414c220 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7fd0c41520d0 tx=0x7fd0b0015000).stop 2020-11-20T12:14:45.777 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c90d6700 1 -- 172.21.15.93:0/1965164945 reap_dead start 2020-11-20T12:14:45.777 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 shutdown_connections 2020-11-20T12:14:45.777 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 >> 172.21.15.93:0/1965164945 conn(0x7fd0c4062440 msgr2=0x7fd0c4150440 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.777 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 shutdown_connections 2020-11-20T12:14:45.778 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.771+0000 7fd0c98d7700 1 -- 172.21.15.93:0/1965164945 wait complete. 2020-11-20T12:14:45.785 INFO:teuthology.orchestra.run.smithi093.stdout:73014444040 2020-11-20T12:14:45.786 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.11 flush_pg_stats 2020-11-20T12:14:45.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.896+0000 7fd276426700 1 Processor -- start 2020-11-20T12:14:45.900 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.896+0000 7fd276426700 1 -- start start 2020-11-20T12:14:45.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd276426700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2700c43c0 0x7fd270063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd276426700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd2700c1010 0x7fd2700bfb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd276426700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700c0230 con 0x7fd2700c47a0 2020-11-20T12:14:45.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd276426700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd270151510 con 0x7fd2700c1010 2020-11-20T12:14:45.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd276426700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2701517b0 con 0x7fd2700c43c0 2020-11-20T12:14:45.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd26ffff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2700c43c0 0x7fd270063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd2749c3700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd2700c1010 0x7fd2700bfb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd26f7fe700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd2700c47a0 0x7fd2700c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.93:37066/0 (socket says 172.21.15.93:37066) 2020-11-20T12:14:45.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd26f7fe700 1 -- 172.21.15.93:0/4201882033 learned_addr learned my addr 172.21.15.93:0/4201882033 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:45.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd2749c3700 1 -- 172.21.15.93:0/4201882033 >> v2:172.21.15.132:3300/0 conn(0x7fd2700c43c0 msgr2=0x7fd270063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:45.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd2749c3700 1 --2- 172.21.15.93:0/4201882033 >> v2:172.21.15.132:3300/0 conn(0x7fd2700c43c0 0x7fd270063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd2749c3700 1 -- 172.21.15.93:0/4201882033 >> v1:172.21.15.132:6789/0 conn(0x7fd2700c47a0 legacy=0x7fd2700c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd2749c3700 1 -- 172.21.15.93:0/4201882033 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd270151a50 con 0x7fd2700c1010 2020-11-20T12:14:45.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.897+0000 7fd2749c3700 1 --2- 172.21.15.93:0/4201882033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c1010 0x7fd2700bfb70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd270063120 tx=0x7fd268009220).ready entity=mon.0 client_cookie=861613ea0e94d4b9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd26effd700 1 -- 172.21.15.93:0/4201882033 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26800ba00 con 0x7fd2700c1010 2020-11-20T12:14:45.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd26effd700 1 -- 172.21.15.93:0/4201882033 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26800bb60 con 0x7fd2700c1010 2020-11-20T12:14:45.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd26effd700 1 -- 172.21.15.93:0/4201882033 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd268011400 con 0x7fd2700c1010 2020-11-20T12:14:45.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 -- 172.21.15.93:0/4201882033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c1010 msgr2=0x7fd2700bfb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 --2- 172.21.15.93:0/4201882033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c1010 0x7fd2700bfb70 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fd270063120 tx=0x7fd268009220).stop 2020-11-20T12:14:45.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 -- 172.21.15.93:0/4201882033 shutdown_connections 2020-11-20T12:14:45.917 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 --2- 172.21.15.93:0/4201882033 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c1010 0x7fd2700bfb70 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.917 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 --2- 172.21.15.93:0/4201882033 >> v2:172.21.15.132:3300/0 conn(0x7fd2700c43c0 0x7fd270063890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.918 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 -- 172.21.15.93:0/4201882033 >> 172.21.15.93:0/4201882033 conn(0x7fd270060130 msgr2=0x7fd270060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.918 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 -- 172.21.15.93:0/4201882033 shutdown_connections 2020-11-20T12:14:45.919 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.898+0000 7fd276426700 1 -- 172.21.15.93:0/4201882033 wait complete. 2020-11-20T12:14:45.919 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.899+0000 7fd276426700 1 Processor -- start 2020-11-20T12:14:45.919 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.899+0000 7fd276426700 1 -- start start 2020-11-20T12:14:45.920 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd276426700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2700c1010 0x7fd2701642b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.920 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd276426700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c43c0 0x7fd270150610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.921 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd276426700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2700c47a0 0x7fd2701572f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.921 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd276426700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2701647a0 con 0x7fd2700c43c0 2020-11-20T12:14:45.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd276426700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270153190 con 0x7fd2700c47a0 2020-11-20T12:14:45.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd276426700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd270153430 con 0x7fd2700c1010 2020-11-20T12:14:45.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd2749c3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2700c47a0 0x7fd2701572f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.923 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd2749c3700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2700c47a0 0x7fd2701572f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39294/0 (socket says 172.21.15.93:39294) 2020-11-20T12:14:45.923 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd2749c3700 1 -- 172.21.15.93:0/603015746 learned_addr learned my addr 172.21.15.93:0/603015746 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:45.924 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd26f7fe700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c43c0 0x7fd270150610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.924 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd26ffff700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2700c1010 0x7fd2701642b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.925 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.900+0000 7fd2749c3700 1 -- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2700c1010 msgr2=0x7fd2701642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.925 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd2749c3700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2700c1010 0x7fd2701642b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.925 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd2749c3700 1 -- 172.21.15.93:0/603015746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c43c0 msgr2=0x7fd270150610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.926 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd2749c3700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd2700c43c0 0x7fd270150610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.926 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd2749c3700 1 -- 172.21.15.93:0/603015746 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2701536d0 con 0x7fd2700c47a0 2020-11-20T12:14:45.927 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd2749c3700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2700c47a0 0x7fd2701572f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd2680090b0 tx=0x7fd268016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.927 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26801b6b0 con 0x7fd2700c47a0 2020-11-20T12:14:45.928 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26801b810 con 0x7fd2700c47a0 2020-11-20T12:14:45.928 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd270153970 con 0x7fd2700c47a0 2020-11-20T12:14:45.929 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26801bbb0 con 0x7fd2700c47a0 2020-11-20T12:14:45.929 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.901+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd270153eb0 con 0x7fd2700c47a0 2020-11-20T12:14:45.929 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.902+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd2700674d0 con 0x7fd2700c47a0 2020-11-20T12:14:45.930 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.902+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd268017070 con 0x7fd2700c47a0 2020-11-20T12:14:45.930 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd24ffff700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd248080670 0x7fd248082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.931 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd26ffff700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd248080670 0x7fd248082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.931 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd2680a4d30 con 0x7fd2700c47a0 2020-11-20T12:14:45.932 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd24ffff700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:6822/23328,v1:172.21.15.132:6824/23328] conn(0x7fd2480893a0 0x7fd24808b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:45.932 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 --> [v2:172.21.15.132:6822/23328,v1:172.21.15.132:6824/23328] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd24808be20 con 0x7fd2480893a0 2020-11-20T12:14:45.932 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_get_version_reply(handle=1 version=28) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2680a7310 con 0x7fd2700c47a0 2020-11-20T12:14:45.933 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd26ffff700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd248080670 0x7fd248082b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd260006fd0 tx=0x7fd260006e30).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.933 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.903+0000 7fd26f7fe700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:6822/23328,v1:172.21.15.132:6824/23328] conn(0x7fd2480893a0 0x7fd24808b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:45.934 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.904+0000 7fd26f7fe700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:6822/23328,v1:172.21.15.132:6824/23328] conn(0x7fd2480893a0 0x7fd24808b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:45.934 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.905+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== osd.11 v2:172.21.15.132:6822/23328 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+22725 (crc 0 0 0) 0x7fd24808be20 con 0x7fd2480893a0 2020-11-20T12:14:45.938 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.918+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 --> [v2:172.21.15.132:6822/23328,v1:172.21.15.132:6824/23328] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd27005cd50 con 0x7fd2480893a0 2020-11-20T12:14:45.938 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd24ffff700 1 -- 172.21.15.93:0/603015746 <== osd.11 v2:172.21.15.132:6822/23328 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd27005cd50 con 0x7fd2480893a0 2020-11-20T12:14:45.939 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:6822/23328,v1:172.21.15.132:6824/23328] conn(0x7fd2480893a0 msgr2=0x7fd24808b7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.939 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.132:6822/23328,v1:172.21.15.132:6824/23328] conn(0x7fd2480893a0 0x7fd24808b7c0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:45.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd248080670 msgr2=0x7fd248082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd248080670 0x7fd248082b30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fd260006fd0 tx=0x7fd260006e30).stop 2020-11-20T12:14:45.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2700c47a0 msgr2=0x7fd2701572f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:45.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 --2- 172.21.15.93:0/603015746 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd2700c47a0 0x7fd2701572f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fd2680090b0 tx=0x7fd268016000).stop 2020-11-20T12:14:45.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd2749c3700 1 -- 172.21.15.93:0/603015746 reap_dead start 2020-11-20T12:14:45.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 shutdown_connections 2020-11-20T12:14:45.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 >> 172.21.15.93:0/603015746 conn(0x7fd270060130 msgr2=0x7fd2700c3790 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:45.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 shutdown_connections 2020-11-20T12:14:45.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:45.920+0000 7fd276426700 1 -- 172.21.15.93:0/603015746 wait complete. 2020-11-20T12:14:45.942 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:45.943 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2020-11-20T12:14:46.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.052+0000 7f8d23c2d700 1 Processor -- start 2020-11-20T12:14:46.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.052+0000 7f8d23c2d700 1 -- start start 2020-11-20T12:14:46.059 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d23c2d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8d1c063890 0x7f8d1c0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.059 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d23c2d700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c0c0230 con 0x7f8d1c0c43c0 2020-11-20T12:14:46.059 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d23c2d700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d1c151510 con 0x7f8d1c0c1010 2020-11-20T12:14:46.059 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d23c2d700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d1c1517b0 con 0x7f8d1c063890 2020-11-20T12:14:46.060 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d219c9700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8d1c0c43c0 0x7f8d1c0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:39998/0 (socket says 172.21.15.93:39998) 2020-11-20T12:14:46.060 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d219c9700 1 -- 172.21.15.93:0/2926869805 learned_addr learned my addr 172.21.15.93:0/2926869805 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:46.060 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641331089 0 0) 0x7f8d1c0c0230 con 0x7f8d1c0c43c0 2020-11-20T12:14:46.060 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d04003280 con 0x7f8d1c0c43c0 2020-11-20T12:14:46.061 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.053+0000 7f8d221ca700 1 --2- 172.21.15.93:0/2926869805 >> v2:172.21.15.66:3300/0 conn(0x7f8d1c063890 0x7f8d1c0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.061 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 39884931 0 0) 0x7f8d04003280 con 0x7f8d1c0c43c0 2020-11-20T12:14:46.061 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 >> v2:172.21.15.66:3300/0 conn(0x7f8d1c063890 msgr2=0x7f8d1c0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.061 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 --2- 172.21.15.93:0/2926869805 >> v2:172.21.15.66:3300/0 conn(0x7f8d1c063890 0x7f8d1c0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.061 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 >> v1:172.21.15.132:6789/0 conn(0x7f8d1c0c1010 legacy=0x7f8d1c150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.062 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c151a50 con 0x7f8d1c0c43c0 2020-11-20T12:14:46.062 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f8d18001520 con 0x7f8d1c0c43c0 2020-11-20T12:14:46.062 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 >> v1:172.21.15.93:6789/0 conn(0x7f8d1c0c43c0 legacy=0x7f8d1c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.062 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04003770 0x7f8d04003b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.063 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d04004520 0x7f8d040049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.063 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d04004e90 0x7f8d0400b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.063 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c1517b0 con 0x7f8d04004e90 2020-11-20T12:14:46.063 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d04004260 con 0x7f8d04004520 2020-11-20T12:14:46.063 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d0400bc60 con 0x7f8d04003770 2020-11-20T12:14:46.064 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d211c8700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d04004520 0x7f8d040049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.064 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d219c9700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04003770 0x7f8d04003b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.064 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d221ca700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d04004e90 0x7f8d0400b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.064 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d211c8700 1 -- 172.21.15.93:0/2926869805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04003770 msgr2=0x7f8d04003b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.064 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d211c8700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04003770 0x7f8d04003b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.065 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d211c8700 1 -- 172.21.15.93:0/2926869805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d04004e90 msgr2=0x7f8d0400b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.065 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d211c8700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d04004e90 0x7f8d0400b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.065 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d211c8700 1 -- 172.21.15.93:0/2926869805 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d04003280 con 0x7f8d04004520 2020-11-20T12:14:46.065 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d221ca700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d04004e90 0x7f8d0400b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:46.065 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d221ca700 1 -- 172.21.15.93:0/2926869805 reap_dead start 2020-11-20T12:14:46.066 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d211c8700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d04004520 0x7f8d040049a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8d0c001a70 tx=0x7f8d0c007bb0).ready entity=mon.1 client_cookie=f9d2d9ac1c5a03c2 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.066 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00c860 con 0x7f8d04004520 2020-11-20T12:14:46.066 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d0c001e90 con 0x7f8d04004520 2020-11-20T12:14:46.066 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.054+0000 7f8d209c7700 1 -- 172.21.15.93:0/2926869805 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d0c00cc10 con 0x7f8d04004520 2020-11-20T12:14:46.066 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.055+0000 7f8d23c2d700 1 -- 172.21.15.93:0/2926869805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d04004520 msgr2=0x7f8d040049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.067 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.055+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d04004520 0x7f8d040049a0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f8d0c001a70 tx=0x7f8d0c007bb0).stop 2020-11-20T12:14:46.067 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.055+0000 7f8d23c2d700 1 -- 172.21.15.93:0/2926869805 shutdown_connections 2020-11-20T12:14:46.067 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.055+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/2926869805 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d04004520 0x7f8d040049a0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.067 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.055+0000 7f8d23c2d700 1 -- 172.21.15.93:0/2926869805 >> 172.21.15.93:0/2926869805 conn(0x7f8d1c060130 msgr2=0x7f8d1c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:46.068 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.055+0000 7f8d23c2d700 1 -- 172.21.15.93:0/2926869805 shutdown_connections 2020-11-20T12:14:46.068 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.055+0000 7f8d23c2d700 1 -- 172.21.15.93:0/2926869805 wait complete. 2020-11-20T12:14:46.068 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.056+0000 7f8d23c2d700 1 Processor -- start 2020-11-20T12:14:46.068 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.056+0000 7f8d23c2d700 1 -- start start 2020-11-20T12:14:46.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d23c2d700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04004520 0x7f8d1c164390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d23c2d700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1c152930 0x7f8d1c0606d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d23c2d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c060bc0 0x7f8d1c1604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d23c2d700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c157110 con 0x7f8d1c152930 2020-11-20T12:14:46.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d23c2d700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c164880 con 0x7f8d1c060bc0 2020-11-20T12:14:46.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d23c2d700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1c112090 con 0x7f8d04004520 2020-11-20T12:14:46.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c060bc0 0x7f8d1c1604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c060bc0 0x7f8d1c1604e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39316/0 (socket says 172.21.15.93:39316) 2020-11-20T12:14:46.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 -- 172.21.15.93:0/1612048627 learned_addr learned my addr 172.21.15.93:0/1612048627 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:46.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d211c8700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1c152930 0x7f8d1c0606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 -- 172.21.15.93:0/1612048627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04004520 msgr2=0x7f8d1c164390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04004520 0x7f8d1c164390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:46.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 -- 172.21.15.93:0/1612048627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1c152930 msgr2=0x7f8d1c0606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1c152930 0x7f8d1c0606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 -- 172.21.15.93:0/1612048627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c112330 con 0x7f8d1c060bc0 2020-11-20T12:14:46.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d211c8700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1c152930 0x7f8d1c0606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:46.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d221ca700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c060bc0 0x7f8d1c1604e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8d1c062990 tx=0x7f8d14008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d09ffb700 1 -- 172.21.15.93:0/1612048627 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14015690 con 0x7f8d1c060bc0 2020-11-20T12:14:46.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d09ffb700 1 -- 172.21.15.93:0/1612048627 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d140157f0 con 0x7f8d1c060bc0 2020-11-20T12:14:46.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d09ffb700 1 -- 172.21.15.93:0/1612048627 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d14015bb0 con 0x7f8d1c060bc0 2020-11-20T12:14:46.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.057+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d1c1125d0 con 0x7f8d1c060bc0 2020-11-20T12:14:46.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.058+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d1c157650 con 0x7f8d1c060bc0 2020-11-20T12:14:46.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.058+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d1c0674d0 con 0x7f8d1c060bc0 2020-11-20T12:14:46.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.059+0000 7f8d09ffb700 1 -- 172.21.15.93:0/1612048627 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8d1401e030 con 0x7f8d1c060bc0 2020-11-20T12:14:46.076 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.060+0000 7f8d09ffb700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8cf4080670 0x7f8cf4082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.076 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.060+0000 7f8d219c9700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8cf4080670 0x7f8cf4082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.076 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.060+0000 7f8d09ffb700 1 -- 172.21.15.93:0/1612048627 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8d140a2910 con 0x7f8d1c060bc0 2020-11-20T12:14:46.076 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.060+0000 7f8d219c9700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8cf4080670 0x7f8cf4082b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f8d18000e10 tx=0x7f8d1c1516a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.076 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.063+0000 7f8d09ffb700 1 -- 172.21.15.93:0/1612048627 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8d140772a0 con 0x7f8d1c060bc0 2020-11-20T12:14:46.205 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.202+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8d1c05cd50 con 0x7f8d1c060bc0 2020-11-20T12:14:46.206 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.203+0000 7f8d09ffb700 1 -- 172.21.15.93:0/1612048627 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8d1407a8c0 con 0x7f8d1c060bc0 2020-11-20T12:14:46.206 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:46.207 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8cf4080670 msgr2=0x7f8cf4082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.207 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8cf4080670 0x7f8cf4082b30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f8d18000e10 tx=0x7f8d1c1516a0).stop 2020-11-20T12:14:46.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c060bc0 msgr2=0x7f8d1c1604e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c060bc0 0x7f8d1c1604e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f8d1c062990 tx=0x7f8d14008040).stop 2020-11-20T12:14:46.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 shutdown_connections 2020-11-20T12:14:46.208 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8d1c060bc0 0x7f8d1c1604e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d04004520 0x7f8d1c164390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:46.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8cf4080670 0x7f8cf4082b30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 --2- 172.21.15.93:0/1612048627 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8d1c152930 0x7f8d1c0606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 >> 172.21.15.93:0/1612048627 conn(0x7f8d1c060130 msgr2=0x7f8d1c0c26c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:46.209 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 shutdown_connections 2020-11-20T12:14:46.210 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.204+0000 7f8d23c2d700 1 -- 172.21.15.93:0/1612048627 wait complete. 2020-11-20T12:14:46.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.0 2020-11-20T12:14:46.219 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2020-11-20T12:14:46.327 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.324+0000 7fb5896b5700 1 Processor -- start 2020-11-20T12:14:46.328 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.324+0000 7fb5896b5700 1 -- start start 2020-11-20T12:14:46.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb5896b5700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb5840c2450 0x7fb5840c2830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb5896b5700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5840bed30 0x7fb584151f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb5896b5700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb584155300 con 0x7fb584064670 2020-11-20T12:14:46.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb5896b5700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5841555a0 con 0x7fb5840c2450 2020-11-20T12:14:46.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb5896b5700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb584151540 con 0x7fb5840bed30 2020-11-20T12:14:46.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb582ffd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb5840c2450 0x7fb5840c2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb582ffd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fb5840c2450 0x7fb5840c2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39320/0 (socket says 172.21.15.93:39320) 2020-11-20T12:14:46.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.325+0000 7fb582ffd700 1 -- 172.21.15.93:0/3405307801 learned_addr learned my addr 172.21.15.93:0/3405307801 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:46.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5827fc700 1 --2- 172.21.15.93:0/3405307801 >> v2:172.21.15.132:3300/0 conn(0x7fb5840bed30 0x7fb584151f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb582ffd700 1 -- 172.21.15.93:0/3405307801 >> v2:172.21.15.132:3300/0 conn(0x7fb5840bed30 msgr2=0x7fb584151f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb582ffd700 1 --2- 172.21.15.93:0/3405307801 >> v2:172.21.15.132:3300/0 conn(0x7fb5840bed30 0x7fb584151f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb582ffd700 1 -- 172.21.15.93:0/3405307801 >> v1:172.21.15.132:6789/0 conn(0x7fb584064670 legacy=0x7fb584154920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb582ffd700 1 -- 172.21.15.93:0/3405307801 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5841517e0 con 0x7fb5840c2450 2020-11-20T12:14:46.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5827fc700 1 --2- 172.21.15.93:0/3405307801 >> v2:172.21.15.132:3300/0 conn(0x7fb5840bed30 0x7fb584151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:46.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb582ffd700 1 --2- 172.21.15.93:0/3405307801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5840c2450 0x7fb5840c2830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb5840c2d20 tx=0x7fb574006ef0).ready entity=mon.1 client_cookie=720a4c15bbeafd95 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb581ffb700 1 -- 172.21.15.93:0/3405307801 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400b8f0 con 0x7fb5840c2450 2020-11-20T12:14:46.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb581ffb700 1 -- 172.21.15.93:0/3405307801 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb574000e90 con 0x7fb5840c2450 2020-11-20T12:14:46.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb581ffb700 1 -- 172.21.15.93:0/3405307801 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57400bc60 con 0x7fb5840c2450 2020-11-20T12:14:46.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 -- 172.21.15.93:0/3405307801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5840c2450 msgr2=0x7fb5840c2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 --2- 172.21.15.93:0/3405307801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5840c2450 0x7fb5840c2830 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fb5840c2d20 tx=0x7fb574006ef0).stop 2020-11-20T12:14:46.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 -- 172.21.15.93:0/3405307801 shutdown_connections 2020-11-20T12:14:46.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 --2- 172.21.15.93:0/3405307801 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb5840c2450 0x7fb5840c2830 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 --2- 172.21.15.93:0/3405307801 >> v2:172.21.15.132:3300/0 conn(0x7fb5840bed30 0x7fb584151f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.335 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 -- 172.21.15.93:0/3405307801 >> 172.21.15.93:0/3405307801 conn(0x7fb5840be850 msgr2=0x7fb584060130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:46.335 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 -- 172.21.15.93:0/3405307801 shutdown_connections 2020-11-20T12:14:46.335 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.326+0000 7fb5896b5700 1 -- 172.21.15.93:0/3405307801 wait complete. 2020-11-20T12:14:46.338 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 Processor -- start 2020-11-20T12:14:46.338 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 -- start start 2020-11-20T12:14:46.338 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb584064670 0x7fb5841611e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.339 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5840bed30 0x7fb584064c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.339 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5840c2450 0x7fb5841642f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.339 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5841616d0 con 0x7fb5840bed30 2020-11-20T12:14:46.339 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5840c86c0 con 0x7fb584064670 2020-11-20T12:14:46.339 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.328+0000 7fb5896b5700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb58414e4c0 con 0x7fb5840c2450 2020-11-20T12:14:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb584064670 0x7fb5841611e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb584064670 0x7fb5841611e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39326/0 (socket says 172.21.15.93:39326) 2020-11-20T12:14:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 -- 172.21.15.93:0/269388521 learned_addr learned my addr 172.21.15.93:0/269388521 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:46.340 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb5837fe700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5840c2450 0x7fb5841642f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 -- 172.21.15.93:0/269388521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5840c2450 msgr2=0x7fb5841642f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5840c2450 0x7fb5841642f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 -- 172.21.15.93:0/269388521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5840bed30 msgr2=0x7fb584064c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5840bed30 0x7fb584064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:46.341 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 -- 172.21.15.93:0/269388521 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb584155a00 con 0x7fb584064670 2020-11-20T12:14:46.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb5837fe700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5840c2450 0x7fb5841642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:46.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb582ffd700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb584064670 0x7fb5841611e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb584063ed0 tx=0x7fb574016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb56affd700 1 -- 172.21.15.93:0/269388521 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb574011e70 con 0x7fb584064670 2020-11-20T12:14:46.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb56affd700 1 -- 172.21.15.93:0/269388521 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb57401c470 con 0x7fb584064670 2020-11-20T12:14:46.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb56affd700 1 -- 172.21.15.93:0/269388521 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb57401c830 con 0x7fb584064670 2020-11-20T12:14:46.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb584155ca0 con 0x7fb584064670 2020-11-20T12:14:46.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.329+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb584163e50 con 0x7fb584064670 2020-11-20T12:14:46.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.330+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb584164010 con 0x7fb584064670 2020-11-20T12:14:46.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.331+0000 7fb56affd700 1 -- 172.21.15.93:0/269388521 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fb574017070 con 0x7fb584064670 2020-11-20T12:14:46.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.331+0000 7fb56affd700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb560080670 0x7fb560082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.331+0000 7fb56affd700 1 -- 172.21.15.93:0/269388521 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fb5740a44b0 con 0x7fb584064670 2020-11-20T12:14:46.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.331+0000 7fb5827fc700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb560080670 0x7fb560082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.331+0000 7fb5827fc700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb560080670 0x7fb560082b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb578006c10 tx=0x7fb578008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.334+0000 7fb56affd700 1 -- 172.21.15.93:0/269388521 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fb574078ec0 con 0x7fb584064670 2020-11-20T12:14:46.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.473+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb5840674d0 con 0x7fb584064670 2020-11-20T12:14:46.477 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.473+0000 7fb56affd700 1 -- 172.21.15.93:0/269388521 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb574015030 con 0x7fb584064670 2020-11-20T12:14:46.477 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:46.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb560080670 msgr2=0x7fb560082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb560080670 0x7fb560082b30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fb578006c10 tx=0x7fb578008040).stop 2020-11-20T12:14:46.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb584064670 msgr2=0x7fb5841611e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.479 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb584064670 0x7fb5841611e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fb584063ed0 tx=0x7fb574016000).stop 2020-11-20T12:14:46.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 shutdown_connections 2020-11-20T12:14:46.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5840c2450 0x7fb5841642f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fb584064670 0x7fb5841611e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fb560080670 0x7fb560082b30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.480 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 --2- 172.21.15.93:0/269388521 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fb5840bed30 0x7fb584064c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:46.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 >> 172.21.15.93:0/269388521 conn(0x7fb5840be850 msgr2=0x7fb584153fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:46.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 shutdown_connections 2020-11-20T12:14:46.481 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.475+0000 7fb5896b5700 1 -- 172.21.15.93:0/269388521 wait complete. 2020-11-20T12:14:46.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.1 2020-11-20T12:14:46.490 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2020-11-20T12:14:46.601 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.598+0000 7f85930bf700 1 Processor -- start 2020-11-20T12:14:46.601 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.598+0000 7f85930bf700 1 -- start start 2020-11-20T12:14:46.605 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f85930bf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f858c0c1010 0x7f858c063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f85930bf700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c0c0230 con 0x7f858c0c43c0 2020-11-20T12:14:46.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f85930bf700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f858c151510 con 0x7f858c0c47a0 2020-11-20T12:14:46.606 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f85930bf700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f858c0c4bf0 con 0x7f858c0c1010 2020-11-20T12:14:46.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f859165c700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f858c0c47a0 0x7f858c150350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40034/0 (socket says 172.21.15.93:40034) 2020-11-20T12:14:46.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f859165c700 1 -- 172.21.15.93:0/3740698170 learned_addr learned my addr 172.21.15.93:0/3740698170 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:46.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f858bfff700 1 --2- 172.21.15.93:0/3740698170 >> v2:172.21.15.66:3300/0 conn(0x7f858c0c1010 0x7f858c063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1789917208 0 0) 0x7f858c151510 con 0x7f858c0c47a0 2020-11-20T12:14:46.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.599+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8570003280 con 0x7f858c0c47a0 2020-11-20T12:14:46.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2874992844 0 0) 0x7f8570003280 con 0x7f858c0c47a0 2020-11-20T12:14:46.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 >> v2:172.21.15.66:3300/0 conn(0x7f858c0c1010 msgr2=0x7f858c063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 --2- 172.21.15.93:0/3740698170 >> v2:172.21.15.66:3300/0 conn(0x7f858c0c1010 0x7f858c063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 >> v1:172.21.15.66:6789/0 conn(0x7f858c0c43c0 legacy=0x7f858c0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c1517b0 con 0x7f858c0c47a0 2020-11-20T12:14:46.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f85840018a0 con 0x7f858c0c47a0 2020-11-20T12:14:46.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 >> v1:172.21.15.93:6789/0 conn(0x7f858c0c47a0 legacy=0x7f858c150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f8570003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8570004520 0x7f85700049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8570004e90 0x7f857000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c0c4bf0 con 0x7f8570004520 2020-11-20T12:14:46.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8570005340 con 0x7f85700037c0 2020-11-20T12:14:46.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f857000bc60 con 0x7f8570004e90 2020-11-20T12:14:46.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f8590e5b700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f8570003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858bfff700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8570004520 0x7f85700049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f8590e5b700 1 -- 172.21.15.93:0/3740698170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8570004e90 msgr2=0x7f857000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f8590e5b700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8570004e90 0x7f857000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:46.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f8590e5b700 1 -- 172.21.15.93:0/3740698170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8570004520 msgr2=0x7f85700049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f8590e5b700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8570004520 0x7f85700049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f8590e5b700 1 -- 172.21.15.93:0/3740698170 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8570003280 con 0x7f85700037c0 2020-11-20T12:14:46.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f859165c700 1 -- 172.21.15.93:0/3740698170 reap_dead start 2020-11-20T12:14:46.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f8590e5b700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f8570003be0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8580001960 tx=0x7f8580007bd0).ready entity=mon.1 client_cookie=4080444dc808afa9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580007020 con 0x7f85700037c0 2020-11-20T12:14:46.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580007180 con 0x7f85700037c0 2020-11-20T12:14:46.614 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.600+0000 7f858b7fe700 1 -- 172.21.15.93:0/3740698170 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858000c860 con 0x7f85700037c0 2020-11-20T12:14:46.614 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.601+0000 7f85930bf700 1 -- 172.21.15.93:0/3740698170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 msgr2=0x7f8570003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.614 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.601+0000 7f85930bf700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f8570003be0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f8580001960 tx=0x7f8580007bd0).stop 2020-11-20T12:14:46.614 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.601+0000 7f85930bf700 1 -- 172.21.15.93:0/3740698170 shutdown_connections 2020-11-20T12:14:46.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.601+0000 7f85930bf700 1 --2- 172.21.15.93:0/3740698170 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f8570003be0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.601+0000 7f85930bf700 1 -- 172.21.15.93:0/3740698170 >> 172.21.15.93:0/3740698170 conn(0x7f858c060130 msgr2=0x7f858c060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:46.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.601+0000 7f85930bf700 1 -- 172.21.15.93:0/3740698170 shutdown_connections 2020-11-20T12:14:46.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.601+0000 7f85930bf700 1 -- 172.21.15.93:0/3740698170 wait complete. 2020-11-20T12:14:46.615 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.602+0000 7f85930bf700 1 Processor -- start 2020-11-20T12:14:46.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.602+0000 7f85930bf700 1 -- start start 2020-11-20T12:14:46.618 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f85930bf700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f858c14d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f85930bf700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f858c0c64f0 0x7f858c112090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f85930bf700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858c14da50 0x7f858c14bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f85930bf700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c1607c0 con 0x7f858c0c64f0 2020-11-20T12:14:46.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f85930bf700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c160a60 con 0x7f85700037c0 2020-11-20T12:14:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f85930bf700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f858c160d00 con 0x7f858c14da50 2020-11-20T12:14:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f858c14d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f858c14d560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39346/0 (socket says 172.21.15.93:39346) 2020-11-20T12:14:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 -- 172.21.15.93:0/1381135519 learned_addr learned my addr 172.21.15.93:0/1381135519 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:46.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f858bfff700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f858c0c64f0 0x7f858c112090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 -- 172.21.15.93:0/1381135519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858c14da50 msgr2=0x7f858c14bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858c14da50 0x7f858c14bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:46.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 -- 172.21.15.93:0/1381135519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f858c0c64f0 msgr2=0x7f858c112090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f858c0c64f0 0x7f858c112090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 -- 172.21.15.93:0/1381135519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c160fa0 con 0x7f85700037c0 2020-11-20T12:14:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f858bfff700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f858c0c64f0 0x7f858c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8590e5b700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f858c14d560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f85700054d0 tx=0x7f8580015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8588ff9700 1 -- 172.21.15.93:0/1381135519 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580013aa0 con 0x7f85700037c0 2020-11-20T12:14:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8588ff9700 1 -- 172.21.15.93:0/1381135519 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580013c00 con 0x7f85700037c0 2020-11-20T12:14:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f858c161240 con 0x7f85700037c0 2020-11-20T12:14:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.603+0000 7f8588ff9700 1 -- 172.21.15.93:0/1381135519 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580020440 con 0x7f85700037c0 2020-11-20T12:14:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.604+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f858c1603e0 con 0x7f85700037c0 2020-11-20T12:14:46.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.604+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f858c160a60 con 0x7f85700037c0 2020-11-20T12:14:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.605+0000 7f8588ff9700 1 -- 172.21.15.93:0/1381135519 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8580026020 con 0x7f85700037c0 2020-11-20T12:14:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.606+0000 7f8588ff9700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8564080670 0x7f8564082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.606+0000 7f8588ff9700 1 -- 172.21.15.93:0/1381135519 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f85800a4020 con 0x7f85700037c0 2020-11-20T12:14:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.606+0000 7f858bfff700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8564080670 0x7f8564082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.624 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.606+0000 7f858bfff700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8564080670 0x7f8564082b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f858c14dfc0 tx=0x7f8578008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.625 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.609+0000 7f8588ff9700 1 -- 172.21.15.93:0/1381135519 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8580078a30 con 0x7f85700037c0 2020-11-20T12:14:46.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.750+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f858c0674d0 con 0x7f85700037c0 2020-11-20T12:14:46.783 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.751+0000 7f8588ff9700 1 -- 172.21.15.93:0/1381135519 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f858007c050 con 0x7f85700037c0 2020-11-20T12:14:46.783 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:46.785 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8564080670 msgr2=0x7f8564082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.785 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8564080670 0x7f8564082b30 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f858c14dfc0 tx=0x7f8578008040).stop 2020-11-20T12:14:46.785 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 msgr2=0x7f858c14d560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.785 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f858c14d560 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f85700054d0 tx=0x7f8580015000).stop 2020-11-20T12:14:46.786 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 shutdown_connections 2020-11-20T12:14:46.786 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f858c14da50 0x7f858c14bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:46.786 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85700037c0 0x7f858c14d560 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.786 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8564080670 0x7f8564082b30 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.786 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 --2- 172.21.15.93:0/1381135519 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f858c0c64f0 0x7f858c112090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.787 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 >> 172.21.15.93:0/1381135519 conn(0x7f858c060130 msgr2=0x7f858c0c2870 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:46.787 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 shutdown_connections 2020-11-20T12:14:46.787 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.752+0000 7f85930bf700 1 -- 172.21.15.93:0/1381135519 wait complete. 2020-11-20T12:14:46.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.2 2020-11-20T12:14:46.788 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2020-11-20T12:14:46.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.895+0000 7f0aa5d3b700 1 Processor -- start 2020-11-20T12:14:46.899 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.895+0000 7f0aa5d3b700 1 -- start start 2020-11-20T12:14:46.901 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.896+0000 7f0aa5d3b700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0aa00c2250 0x7f0aa0066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.901 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.896+0000 7f0aa5d3b700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0aa0150770 0x7f0aa0150bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.901 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.896+0000 7f0aa5d3b700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0aa00c2aa0 con 0x7f0aa00c2630 2020-11-20T12:14:46.901 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.896+0000 7f0aa5d3b700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa01549d0 con 0x7f0aa00c2250 2020-11-20T12:14:46.902 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.896+0000 7f0aa5d3b700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0aa0154c70 con 0x7f0aa0150770 2020-11-20T12:14:46.902 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.896+0000 7f0a9f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0aa00c2250 0x7f0aa0066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.902 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9f7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f0aa00c2250 0x7f0aa0066d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39358/0 (socket says 172.21.15.93:39358) 2020-11-20T12:14:46.902 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9f7fe700 1 -- 172.21.15.93:0/3375111098 learned_addr learned my addr 172.21.15.93:0/3375111098 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:46.903 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9ffff700 1 --2- 172.21.15.93:0/3375111098 >> v2:172.21.15.132:3300/0 conn(0x7f0aa0150770 0x7f0aa0150bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.903 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9f7fe700 1 -- 172.21.15.93:0/3375111098 >> v2:172.21.15.132:3300/0 conn(0x7f0aa0150770 msgr2=0x7f0aa0150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:46.903 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9f7fe700 1 --2- 172.21.15.93:0/3375111098 >> v2:172.21.15.132:3300/0 conn(0x7f0aa0150770 0x7f0aa0150bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.903 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9f7fe700 1 -- 172.21.15.93:0/3375111098 >> v1:172.21.15.132:6789/0 conn(0x7f0aa00c2630 legacy=0x7f0aa0064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.903 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9f7fe700 1 -- 172.21.15.93:0/3375111098 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0154f10 con 0x7f0aa00c2250 2020-11-20T12:14:46.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9f7fe700 1 --2- 172.21.15.93:0/3375111098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa00c2250 0x7f0aa0066d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0aa00c56e0 tx=0x7f0a90006ef0).ready entity=mon.1 client_cookie=8a52d5a05f47489 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9e7fc700 1 -- 172.21.15.93:0/3375111098 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000b8f0 con 0x7f0aa00c2250 2020-11-20T12:14:46.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9e7fc700 1 -- 172.21.15.93:0/3375111098 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a90000e90 con 0x7f0aa00c2250 2020-11-20T12:14:46.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.897+0000 7f0a9e7fc700 1 -- 172.21.15.93:0/3375111098 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9000bc60 con 0x7f0aa00c2250 2020-11-20T12:14:46.904 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/3375111098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa00c2250 msgr2=0x7f0aa0066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/3375111098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa00c2250 0x7f0aa0066d50 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f0aa00c56e0 tx=0x7f0a90006ef0).stop 2020-11-20T12:14:46.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/3375111098 shutdown_connections 2020-11-20T12:14:46.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/3375111098 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa00c2250 0x7f0aa0066d50 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/3375111098 >> v2:172.21.15.132:3300/0 conn(0x7f0aa0150770 0x7f0aa0150bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.905 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/3375111098 >> 172.21.15.93:0/3375111098 conn(0x7f0aa00bb880 msgr2=0x7f0aa00bbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:46.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/3375111098 shutdown_connections 2020-11-20T12:14:46.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.898+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/3375111098 wait complete. 2020-11-20T12:14:46.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.899+0000 7f0aa5d3b700 1 Processor -- start 2020-11-20T12:14:46.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.899+0000 7f0aa5d3b700 1 -- start start 2020-11-20T12:14:46.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0aa00c2250 0x7f0aa00bbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0aa00c2630 0x7f0aa014e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa0150770 0x7f0aa013d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa00bc2b0 con 0x7f0aa00c2250 2020-11-20T12:14:46.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0161840 con 0x7f0aa0150770 2020-11-20T12:14:46.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0aa0160990 con 0x7f0aa00c2630 2020-11-20T12:14:46.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa0150770 0x7f0aa013d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa0150770 0x7f0aa013d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39364/0 (socket says 172.21.15.93:39364) 2020-11-20T12:14:46.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 -- 172.21.15.93:0/2397316185 learned_addr learned my addr 172.21.15.93:0/2397316185 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9f7fe700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0aa00c2250 0x7f0aa00bbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9effd700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0aa00c2630 0x7f0aa014e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 -- 172.21.15.93:0/2397316185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0aa00c2630 msgr2=0x7f0aa014e1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0aa00c2630 0x7f0aa014e1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 -- 172.21.15.93:0/2397316185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0aa00c2250 msgr2=0x7f0aa00bbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:46.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0aa00c2250 0x7f0aa00bbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:46.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 -- 172.21.15.93:0/2397316185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa0154770 con 0x7f0aa0150770 2020-11-20T12:14:46.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9f7fe700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0aa00c2250 0x7f0aa00bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:46.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9effd700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0aa00c2630 0x7f0aa014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:46.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a9ffff700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa0150770 0x7f0aa013d790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0a9800ed50 tx=0x7f0a98009220).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a7f7fe700 1 -- 172.21.15.93:0/2397316185 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a9800cc70 con 0x7f0aa0150770 2020-11-20T12:14:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a7f7fe700 1 -- 172.21.15.93:0/2397316185 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a9800cdd0 con 0x7f0aa0150770 2020-11-20T12:14:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0aa013f050 con 0x7f0aa0150770 2020-11-20T12:14:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0a7f7fe700 1 -- 172.21.15.93:0/2397316185 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a98012620 con 0x7f0aa0150770 2020-11-20T12:14:46.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.900+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0aa0160e60 con 0x7f0aa0150770 2020-11-20T12:14:46.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.901+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0aa005c2e0 con 0x7f0aa0150770 2020-11-20T12:14:46.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.902+0000 7f0a7f7fe700 1 -- 172.21.15.93:0/2397316185 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f0a98022070 con 0x7f0aa0150770 2020-11-20T12:14:46.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.903+0000 7f0a7f7fe700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f0a78080670 0x7f0a78082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:46.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.903+0000 7f0a9f7fe700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f0a78080670 0x7f0a78082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:46.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.903+0000 7f0a7f7fe700 1 -- 172.21.15.93:0/2397316185 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f0a980a31c0 con 0x7f0aa0150770 2020-11-20T12:14:46.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.903+0000 7f0a9f7fe700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f0a78080670 0x7f0a78082b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0a90006f30 tx=0x7f0a90016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:46.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:46.906+0000 7f0a7f7fe700 1 -- 172.21.15.93:0/2397316185 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f0a98077bd0 con 0x7f0aa0150770 2020-11-20T12:14:47.048 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.045+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f0aa005cd50 con 0x7f0aa0150770 2020-11-20T12:14:47.048 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.045+0000 7f0a7f7fe700 1 -- 172.21.15.93:0/2397316185 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0a98016020 con 0x7f0aa0150770 2020-11-20T12:14:47.048 INFO:teuthology.orchestra.run.smithi093.stdout:73014444037 2020-11-20T12:14:47.050 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f0a78080670 msgr2=0x7f0a78082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.050 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f0a78080670 0x7f0a78082b30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f0a90006f30 tx=0x7f0a90016000).stop 2020-11-20T12:14:47.050 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa0150770 msgr2=0x7f0aa013d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.050 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa0150770 0x7f0aa013d790 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f0a9800ed50 tx=0x7f0a98009220).stop 2020-11-20T12:14:47.051 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 shutdown_connections 2020-11-20T12:14:47.051 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f0aa0150770 0x7f0aa013d790 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.051 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f0a78080670 0x7f0a78082b30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.051 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f0aa00c2250 0x7f0aa00bbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.051 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 --2- 172.21.15.93:0/2397316185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0aa00c2630 0x7f0aa014e1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.052 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 >> 172.21.15.93:0/2397316185 conn(0x7f0aa00bb880 msgr2=0x7f0aa00c36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:47.052 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 shutdown_connections 2020-11-20T12:14:47.052 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.046+0000 7f0aa5d3b700 1 -- 172.21.15.93:0/2397316185 wait complete. 2020-11-20T12:14:47.061 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444037 got 73014444037 for osd.3 2020-11-20T12:14:47.061 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2020-11-20T12:14:47.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.174+0000 7f128f80a700 1 Processor -- start 2020-11-20T12:14:47.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.174+0000 7f128f80a700 1 -- start start 2020-11-20T12:14:47.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128f80a700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1288066d50 0x7f12880c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128f80a700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12881549d0 con 0x7f12880c2250 2020-11-20T12:14:47.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128f80a700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1288154c70 con 0x7f1288150770 2020-11-20T12:14:47.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128f80a700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12880671c0 con 0x7f1288066d50 2020-11-20T12:14:47.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128cda5700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1288066d50 0x7f12880c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.180 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128cda5700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f1288066d50 0x7f12880c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39372/0 (socket says 172.21.15.93:39372) 2020-11-20T12:14:47.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128cda5700 1 -- 172.21.15.93:0/80024850 learned_addr learned my addr 172.21.15.93:0/80024850 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:47.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128cda5700 1 -- 172.21.15.93:0/80024850 >> v1:172.21.15.132:6789/0 conn(0x7f1288150770 legacy=0x7f1288150bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:47.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128cda5700 1 -- 172.21.15.93:0/80024850 >> v1:172.21.15.66:6789/0 conn(0x7f12880c2250 legacy=0x7f1288064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:47.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.175+0000 7f128cda5700 1 -- 172.21.15.93:0/80024850 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1288154f10 con 0x7f1288066d50 2020-11-20T12:14:47.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128cda5700 1 --2- 172.21.15.93:0/80024850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12880c2630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1278009a10 tx=0x7f1278006ef0).ready entity=mon.1 client_cookie=342ad59a7fb086f8 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f1277fff700 1 -- 172.21.15.93:0/80024850 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800b8b0 con 0x7f1288066d50 2020-11-20T12:14:47.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f1277fff700 1 -- 172.21.15.93:0/80024850 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1278000e90 con 0x7f1288066d50 2020-11-20T12:14:47.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f1277fff700 1 -- 172.21.15.93:0/80024850 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f127800bc20 con 0x7f1288066d50 2020-11-20T12:14:47.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128f80a700 1 -- 172.21.15.93:0/80024850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 msgr2=0x7f12880c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128f80a700 1 --2- 172.21.15.93:0/80024850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12880c2630 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f1278009a10 tx=0x7f1278006ef0).stop 2020-11-20T12:14:47.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128f80a700 1 -- 172.21.15.93:0/80024850 shutdown_connections 2020-11-20T12:14:47.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128f80a700 1 --2- 172.21.15.93:0/80024850 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12880c2630 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128f80a700 1 -- 172.21.15.93:0/80024850 >> 172.21.15.93:0/80024850 conn(0x7f12880bb880 msgr2=0x7f12880bbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:47.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128f80a700 1 -- 172.21.15.93:0/80024850 shutdown_connections 2020-11-20T12:14:47.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.176+0000 7f128f80a700 1 -- 172.21.15.93:0/80024850 wait complete. 2020-11-20T12:14:47.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.177+0000 7f128f80a700 1 Processor -- start 2020-11-20T12:14:47.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.177+0000 7f128f80a700 1 -- start start 2020-11-20T12:14:47.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128f80a700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12881648a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.186 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128f80a700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12880c2250 0x7f128814d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128f80a700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1288150770 0x7f1288157de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128f80a700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1288164d90 con 0x7f12880c2250 2020-11-20T12:14:47.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128f80a700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12880bd2b0 con 0x7f1288066d50 2020-11-20T12:14:47.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128f80a700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f128814c960 con 0x7f1288150770 2020-11-20T12:14:47.187 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128d5a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12881648a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128d5a6700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12881648a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39376/0 (socket says 172.21.15.93:39376) 2020-11-20T12:14:47.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128d5a6700 1 -- 172.21.15.93:0/1744301941 learned_addr learned my addr 172.21.15.93:0/1744301941 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:47.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128cda5700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12880c2250 0x7f128814d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.178+0000 7f128dda7700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1288150770 0x7f1288157de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128d5a6700 1 -- 172.21.15.93:0/1744301941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1288150770 msgr2=0x7f1288157de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128d5a6700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1288150770 0x7f1288157de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128d5a6700 1 -- 172.21.15.93:0/1744301941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12880c2250 msgr2=0x7f128814d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128d5a6700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12880c2250 0x7f128814d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128d5a6700 1 -- 172.21.15.93:0/1744301941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f128814cc00 con 0x7f1288066d50 2020-11-20T12:14:47.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128dda7700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1288150770 0x7f1288157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:47.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128d5a6700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12881648a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f128400c6e0 tx=0x7f1284007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f12757fa700 1 -- 172.21.15.93:0/1744301941 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284010510 con 0x7f1288066d50 2020-11-20T12:14:47.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f12757fa700 1 -- 172.21.15.93:0/1744301941 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1284010670 con 0x7f1288066d50 2020-11-20T12:14:47.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f128814cea0 con 0x7f1288066d50 2020-11-20T12:14:47.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f12757fa700 1 -- 172.21.15.93:0/1744301941 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1284010a10 con 0x7f1288066d50 2020-11-20T12:14:47.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.179+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12880bd7b0 con 0x7f1288066d50 2020-11-20T12:14:47.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.180+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f128805c2e0 con 0x7f1288066d50 2020-11-20T12:14:47.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.180+0000 7f12757fa700 1 -- 172.21.15.93:0/1744301941 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f1284010070 con 0x7f1288066d50 2020-11-20T12:14:47.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.181+0000 7f12757fa700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1260080670 0x7f1260082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.181+0000 7f128cda5700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1260080670 0x7f1260082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.181+0000 7f12757fa700 1 -- 172.21.15.93:0/1744301941 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f12840a25b0 con 0x7f1288066d50 2020-11-20T12:14:47.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.181+0000 7f128cda5700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1260080670 0x7f1260082b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1278006f30 tx=0x7f1278016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.184+0000 7f12757fa700 1 -- 172.21.15.93:0/1744301941 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f1284076f40 con 0x7f1288066d50 2020-11-20T12:14:47.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.324+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f128805cd50 con 0x7f1288066d50 2020-11-20T12:14:47.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.324+0000 7f12757fa700 1 -- 172.21.15.93:0/1744301941 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1284007d70 con 0x7f1288066d50 2020-11-20T12:14:47.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1260080670 msgr2=0x7f1260082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1260080670 0x7f1260082b30 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f1278006f30 tx=0x7f1278016000).stop 2020-11-20T12:14:47.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 msgr2=0x7f12881648a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12881648a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f128400c6e0 tx=0x7f1284007c50).stop 2020-11-20T12:14:47.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 shutdown_connections 2020-11-20T12:14:47.334 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1288150770 0x7f1288157de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.335 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f1288066d50 0x7f12881648a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.335 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f1260080670 0x7f1260082b30 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.336 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 --2- 172.21.15.93:0/1744301941 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f12880c2250 0x7f128814d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.336 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 >> 172.21.15.93:0/1744301941 conn(0x7f12880bb880 msgr2=0x7f12880c00e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:47.336 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 shutdown_connections 2020-11-20T12:14:47.337 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.326+0000 7f128f80a700 1 -- 172.21.15.93:0/1744301941 wait complete. 2020-11-20T12:14:47.337 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:47.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.4 2020-11-20T12:14:47.342 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2020-11-20T12:14:47.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.450+0000 7f888923b700 1 Processor -- start 2020-11-20T12:14:47.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.450+0000 7f888923b700 1 -- start start 2020-11-20T12:14:47.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.451+0000 7f888923b700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88840c0230 con 0x7f88840c43c0 2020-11-20T12:14:47.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.451+0000 7f888923b700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8884151510 con 0x7f8884063890 2020-11-20T12:14:47.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.451+0000 7f888923b700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88841517b0 con 0x7f88840c1010 2020-11-20T12:14:47.462 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.451+0000 7f888359e700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8884063890 0x7f8884150a60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40082/0 (socket says 172.21.15.93:40082) 2020-11-20T12:14:47.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.451+0000 7f888359e700 1 -- 172.21.15.93:0/1909271340 learned_addr learned my addr 172.21.15.93:0/1909271340 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:47.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.451+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1458829130 0 0) 0x7f8884151510 con 0x7f8884063890 2020-11-20T12:14:47.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.451+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8870003280 con 0x7f8884063890 2020-11-20T12:14:47.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3187081155 0 0) 0x7f8870003280 con 0x7f8884063890 2020-11-20T12:14:47.463 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 >> v1:172.21.15.132:6789/0 conn(0x7f88840c1010 legacy=0x7f8884150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 >> v1:172.21.15.66:6789/0 conn(0x7f88840c43c0 legacy=0x7f88840c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8884151a50 con 0x7f8884063890 2020-11-20T12:14:47.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f887c0018a0 con 0x7f8884063890 2020-11-20T12:14:47.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 >> v1:172.21.15.93:6789/0 conn(0x7f8884063890 legacy=0x7f8884150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88700037f0 0x7f8870003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f88700049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8870004e90 0x7f887000b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8870005340 con 0x7f88700037f0 2020-11-20T12:14:47.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887000bc60 con 0x7f8870004520 2020-11-20T12:14:47.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f887000bda0 con 0x7f8870004e90 2020-11-20T12:14:47.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888259c700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f88700049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8882d9d700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88700037f0 0x7f8870003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888359e700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8870004e90 0x7f887000b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888259c700 1 -- 172.21.15.93:0/1909271340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8870004e90 msgr2=0x7f887000b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:47.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888259c700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8870004e90 0x7f887000b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888259c700 1 -- 172.21.15.93:0/1909271340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88700037f0 msgr2=0x7f8870003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:47.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888259c700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88700037f0 0x7f8870003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888259c700 1 -- 172.21.15.93:0/1909271340 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8870003280 con 0x7f8870004520 2020-11-20T12:14:47.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888359e700 1 -- 172.21.15.93:0/1909271340 reap_dead start 2020-11-20T12:14:47.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8882d9d700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88700037f0 0x7f8870003c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:47.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f888259c700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f88700049a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f8878001990 tx=0x7f8878007bd0).ready entity=mon.1 client_cookie=1bf7200b8ad58429 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8878007020 con 0x7f8870004520 2020-11-20T12:14:47.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8878007180 con 0x7f8870004520 2020-11-20T12:14:47.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.452+0000 7f8881d9b700 1 -- 172.21.15.93:0/1909271340 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f887800c5a0 con 0x7f8870004520 2020-11-20T12:14:47.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.453+0000 7f888923b700 1 -- 172.21.15.93:0/1909271340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 msgr2=0x7f88700049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.453+0000 7f888923b700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f88700049a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f8878001990 tx=0x7f8878007bd0).stop 2020-11-20T12:14:47.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.453+0000 7f888923b700 1 -- 172.21.15.93:0/1909271340 shutdown_connections 2020-11-20T12:14:47.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.453+0000 7f888923b700 1 --2- 172.21.15.93:0/1909271340 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f88700049a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.453+0000 7f888923b700 1 -- 172.21.15.93:0/1909271340 >> 172.21.15.93:0/1909271340 conn(0x7f8884060130 msgr2=0x7f8884060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:47.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.453+0000 7f888923b700 1 -- 172.21.15.93:0/1909271340 shutdown_connections 2020-11-20T12:14:47.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.453+0000 7f888923b700 1 -- 172.21.15.93:0/1909271340 wait complete. 2020-11-20T12:14:47.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.454+0000 7f888923b700 1 Processor -- start 2020-11-20T12:14:47.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.454+0000 7f888923b700 1 -- start start 2020-11-20T12:14:47.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f8884164470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88841121b0 0x7f8884064660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8884064b50 0x7f888414b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8884164960 con 0x7f88841121b0 2020-11-20T12:14:47.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8884160680 con 0x7f8870004520 2020-11-20T12:14:47.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8884160920 con 0x7f8884064b50 2020-11-20T12:14:47.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f8884164470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f8884164470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39394/0 (socket says 172.21.15.93:39394) 2020-11-20T12:14:47.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 -- 172.21.15.93:0/1565957059 learned_addr learned my addr 172.21.15.93:0/1565957059 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:47.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888359e700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8884064b50 0x7f888414b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.472 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888259c700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88841121b0 0x7f8884064660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 -- 172.21.15.93:0/1565957059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8884064b50 msgr2=0x7f888414b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8884064b50 0x7f888414b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 -- 172.21.15.93:0/1565957059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88841121b0 msgr2=0x7f8884064660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88841121b0 0x7f8884064660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.473 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 -- 172.21.15.93:0/1565957059 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8884160bc0 con 0x7f8870004520 2020-11-20T12:14:47.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888259c700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88841121b0 0x7f8884064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:47.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f8882d9d700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f8884164470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f887400e760 tx=0x7f8874009040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f886affd700 1 -- 172.21.15.93:0/1565957059 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874007020 con 0x7f8870004520 2020-11-20T12:14:47.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f886affd700 1 -- 172.21.15.93:0/1565957059 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8874007180 con 0x7f8870004520 2020-11-20T12:14:47.474 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8884160e60 con 0x7f8870004520 2020-11-20T12:14:47.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f886affd700 1 -- 172.21.15.93:0/1565957059 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8874006530 con 0x7f8870004520 2020-11-20T12:14:47.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.455+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8884152b60 con 0x7f8870004520 2020-11-20T12:14:47.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.456+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88841612c0 con 0x7f8870004520 2020-11-20T12:14:47.475 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.457+0000 7f886affd700 1 -- 172.21.15.93:0/1565957059 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f88740068a0 con 0x7f8870004520 2020-11-20T12:14:47.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.457+0000 7f886affd700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8860080670 0x7f8860082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.458+0000 7f886affd700 1 -- 172.21.15.93:0/1565957059 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f88740a2910 con 0x7f8870004520 2020-11-20T12:14:47.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.458+0000 7f888259c700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8860080670 0x7f8860082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.476 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.458+0000 7f888259c700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8860080670 0x7f8860082b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8884067b40 tx=0x7f8878015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.477 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.461+0000 7f886affd700 1 -- 172.21.15.93:0/1565957059 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8874077320 con 0x7f8870004520 2020-11-20T12:14:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.606+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f88840674d0 con 0x7f8870004520 2020-11-20T12:14:47.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.606+0000 7f886affd700 1 -- 172.21.15.93:0/1565957059 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f887407a940 con 0x7f8870004520 2020-11-20T12:14:47.609 INFO:teuthology.orchestra.run.smithi093.stdout:73014444039 2020-11-20T12:14:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8860080670 msgr2=0x7f8860082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8860080670 0x7f8860082b30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f8884067b40 tx=0x7f8878015000).stop 2020-11-20T12:14:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 msgr2=0x7f8884164470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f8884164470 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f887400e760 tx=0x7f8874009040).stop 2020-11-20T12:14:47.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 shutdown_connections 2020-11-20T12:14:47.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8884064b50 0x7f888414b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8870004520 0x7f8884164470 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.607+0000 7f888923b700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8860080670 0x7f8860082b30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.612 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.608+0000 7f888923b700 1 --2- 172.21.15.93:0/1565957059 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f88841121b0 0x7f8884064660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.608+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 >> 172.21.15.93:0/1565957059 conn(0x7f8884060130 msgr2=0x7f88840c36b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:47.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.608+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 shutdown_connections 2020-11-20T12:14:47.613 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.608+0000 7f888923b700 1 -- 172.21.15.93:0/1565957059 wait complete. 2020-11-20T12:14:47.622 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.5 2020-11-20T12:14:47.623 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2020-11-20T12:14:47.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.733+0000 7fa03ab48700 1 Processor -- start 2020-11-20T12:14:47.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.733+0000 7fa03ab48700 1 -- start start 2020-11-20T12:14:47.739 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa03ab48700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fa0340c43c0 0x7fa034063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa03ab48700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0340c0230 con 0x7fa0340c47a0 2020-11-20T12:14:47.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa03ab48700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa034151510 con 0x7fa0340c1010 2020-11-20T12:14:47.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa03ab48700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa0341517b0 con 0x7fa0340c43c0 2020-11-20T12:14:47.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0390e5700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fa0340c1010 0x7fa034150350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40104/0 (socket says 172.21.15.93:40104) 2020-11-20T12:14:47.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0390e5700 1 -- 172.21.15.93:0/699982296 learned_addr learned my addr 172.21.15.93:0/699982296 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:47.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200982305 0 0) 0x7fa034151510 con 0x7fa0340c1010 2020-11-20T12:14:47.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0388e4700 1 --2- 172.21.15.93:0/699982296 >> v2:172.21.15.66:3300/0 conn(0x7fa0340c43c0 0x7fa034063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa018003280 con 0x7fa0340c1010 2020-11-20T12:14:47.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3246457821 0 0) 0x7fa018003280 con 0x7fa0340c1010 2020-11-20T12:14:47.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 >> v2:172.21.15.66:3300/0 conn(0x7fa0340c43c0 msgr2=0x7fa034063890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:47.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 --2- 172.21.15.93:0/699982296 >> v2:172.21.15.66:3300/0 conn(0x7fa0340c43c0 0x7fa034063890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 >> v1:172.21.15.66:6789/0 conn(0x7fa0340c47a0 legacy=0x7fa0340c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034151a50 con 0x7fa0340c1010 2020-11-20T12:14:47.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7fa02c0018a0 con 0x7fa0340c1010 2020-11-20T12:14:47.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 >> v1:172.21.15.93:6789/0 conn(0x7fa0340c1010 legacy=0x7fa034150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0180037c0 0x7fa018003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa018004520 0x7fa0180049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa018004e90 0x7fa01800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341517b0 con 0x7fa018004e90 2020-11-20T12:14:47.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa018005340 con 0x7fa0180037c0 2020-11-20T12:14:47.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01800bc60 con 0x7fa018004520 2020-11-20T12:14:47.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.734+0000 7fa0388e4700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0180037c0 0x7fa018003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0390e5700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa018004e90 0x7fa01800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa033fff700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa018004520 0x7fa0180049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0388e4700 1 -- 172.21.15.93:0/699982296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa018004520 msgr2=0x7fa0180049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:47.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0388e4700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa018004520 0x7fa0180049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0388e4700 1 -- 172.21.15.93:0/699982296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa018004e90 msgr2=0x7fa01800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:47.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0388e4700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa018004e90 0x7fa01800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0388e4700 1 -- 172.21.15.93:0/699982296 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa018003280 con 0x7fa0180037c0 2020-11-20T12:14:47.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0390e5700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa018004e90 0x7fa01800b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:47.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa033fff700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa018004520 0x7fa0180049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:47.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0390e5700 1 -- 172.21.15.93:0/699982296 reap_dead start 2020-11-20T12:14:47.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0388e4700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0180037c0 0x7fa018003be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa02800bc40 tx=0x7fa028006e30).ready entity=mon.1 client_cookie=5a6ad947d0140a28 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800b350 con 0x7fa0180037c0 2020-11-20T12:14:47.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02800eab0 con 0x7fa0180037c0 2020-11-20T12:14:47.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa0337fe700 1 -- 172.21.15.93:0/699982296 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02800ee30 con 0x7fa0180037c0 2020-11-20T12:14:47.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa03ab48700 1 -- 172.21.15.93:0/699982296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0180037c0 msgr2=0x7fa018003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa03ab48700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0180037c0 0x7fa018003be0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa02800bc40 tx=0x7fa028006e30).stop 2020-11-20T12:14:47.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa03ab48700 1 -- 172.21.15.93:0/699982296 shutdown_connections 2020-11-20T12:14:47.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa03ab48700 1 --2- 172.21.15.93:0/699982296 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa0180037c0 0x7fa018003be0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa03ab48700 1 -- 172.21.15.93:0/699982296 >> 172.21.15.93:0/699982296 conn(0x7fa034060130 msgr2=0x7fa034060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:47.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa03ab48700 1 -- 172.21.15.93:0/699982296 shutdown_connections 2020-11-20T12:14:47.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.735+0000 7fa03ab48700 1 -- 172.21.15.93:0/699982296 wait complete. 2020-11-20T12:14:47.748 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.736+0000 7fa03ab48700 1 Processor -- start 2020-11-20T12:14:47.749 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa03ab48700 1 -- start start 2020-11-20T12:14:47.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa03ab48700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0180037c0 0x7fa034152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.751 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa03ab48700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa034112250 0x7fa034157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa03ab48700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa034157d50 0x7fa034152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa03ab48700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341126d0 con 0x7fa0180037c0 2020-11-20T12:14:47.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa03ab48700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa034112b70 con 0x7fa034157d50 2020-11-20T12:14:47.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa03ab48700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0341128d0 con 0x7fa034112250 2020-11-20T12:14:47.752 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa0390e5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa034157d50 0x7fa034152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa0390e5700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa034157d50 0x7fa034152fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39418/0 (socket says 172.21.15.93:39418) 2020-11-20T12:14:47.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.737+0000 7fa0390e5700 1 -- 172.21.15.93:0/812104440 learned_addr learned my addr 172.21.15.93:0/812104440 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:47.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa033fff700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa034112250 0x7fa034157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0388e4700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0180037c0 0x7fa034152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.753 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0390e5700 1 -- 172.21.15.93:0/812104440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa034112250 msgr2=0x7fa034157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0390e5700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa034112250 0x7fa034157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0390e5700 1 -- 172.21.15.93:0/812104440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0180037c0 msgr2=0x7fa034152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0390e5700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0180037c0 0x7fa034152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0390e5700 1 -- 172.21.15.93:0/812104440 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0341607c0 con 0x7fa034157d50 2020-11-20T12:14:47.754 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0388e4700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0180037c0 0x7fa034152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:47.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa0390e5700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa034157d50 0x7fa034152fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fa034062990 tx=0x7fa0340c03c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa030ff9700 1 -- 172.21.15.93:0/812104440 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c00ea40 con 0x7fa034157d50 2020-11-20T12:14:47.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa030ff9700 1 -- 172.21.15.93:0/812104440 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c00eba0 con 0x7fa034157d50 2020-11-20T12:14:47.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa034160a60 con 0x7fa034157d50 2020-11-20T12:14:47.755 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa030ff9700 1 -- 172.21.15.93:0/812104440 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c014430 con 0x7fa034157d50 2020-11-20T12:14:47.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.738+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa034160fa0 con 0x7fa034157d50 2020-11-20T12:14:47.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.739+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa034161160 con 0x7fa034157d50 2020-11-20T12:14:47.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.739+0000 7fa030ff9700 1 -- 172.21.15.93:0/812104440 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fa02c014820 con 0x7fa034157d50 2020-11-20T12:14:47.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.740+0000 7fa030ff9700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa00c0806a0 0x7fa00c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:47.756 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.740+0000 7fa0388e4700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa00c0806a0 0x7fa00c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:47.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.740+0000 7fa030ff9700 1 -- 172.21.15.93:0/812104440 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fa02c0a29c0 con 0x7fa034157d50 2020-11-20T12:14:47.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.740+0000 7fa0388e4700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa00c0806a0 0x7fa00c082b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa028006e70 tx=0x7fa028019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:47.757 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.743+0000 7fa030ff9700 1 -- 172.21.15.93:0/812104440 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fa02c0773d0 con 0x7fa034157d50 2020-11-20T12:14:47.885 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.882+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa0340674d0 con 0x7fa034157d50 2020-11-20T12:14:47.886 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.882+0000 7fa030ff9700 1 -- 172.21.15.93:0/812104440 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa02c07a9f0 con 0x7fa034157d50 2020-11-20T12:14:47.886 INFO:teuthology.orchestra.run.smithi093.stdout:73014444039 2020-11-20T12:14:47.887 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa00c0806a0 msgr2=0x7fa00c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.887 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa00c0806a0 0x7fa00c082b60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fa028006e70 tx=0x7fa028019000).stop 2020-11-20T12:14:47.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa034157d50 msgr2=0x7fa034152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:47.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa034157d50 0x7fa034152fc0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fa034062990 tx=0x7fa0340c03c0).stop 2020-11-20T12:14:47.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 shutdown_connections 2020-11-20T12:14:47.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fa034157d50 0x7fa034152fc0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.888 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fa00c0806a0 0x7fa00c082b60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fa0180037c0 0x7fa034152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 --2- 172.21.15.93:0/812104440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa034112250 0x7fa034157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:47.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 >> 172.21.15.93:0/812104440 conn(0x7fa034060130 msgr2=0x7fa0340bfa50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:47.889 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 shutdown_connections 2020-11-20T12:14:47.890 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:47.884+0000 7fa03ab48700 1 -- 172.21.15.93:0/812104440 wait complete. 2020-11-20T12:14:47.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.6 2020-11-20T12:14:47.899 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2020-11-20T12:14:48.011 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.008+0000 7f2f8aa77700 1 Processor -- start 2020-11-20T12:14:48.012 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.008+0000 7f2f8aa77700 1 -- start start 2020-11-20T12:14:48.018 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f8aa77700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2f840c1010 0x7f2f84063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f8aa77700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f840c0230 con 0x7f2f840c43c0 2020-11-20T12:14:48.019 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f8aa77700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f84151510 con 0x7f2f840c47a0 2020-11-20T12:14:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f8aa77700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f840c4bf0 con 0x7f2f840c1010 2020-11-20T12:14:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f83fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2f840c1010 0x7f2f84063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.020 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f83fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f2f840c1010 0x7f2f84063890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39426/0 (socket says 172.21.15.93:39426) 2020-11-20T12:14:48.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f83fff700 1 -- 172.21.15.93:0/2669263038 learned_addr learned my addr 172.21.15.93:0/2669263038 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:48.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f83fff700 1 -- 172.21.15.93:0/2669263038 >> v1:172.21.15.132:6789/0 conn(0x7f2f840c47a0 legacy=0x7f2f84150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.021 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f83fff700 1 -- 172.21.15.93:0/2669263038 >> v1:172.21.15.66:6789/0 conn(0x7f2f840c43c0 legacy=0x7f2f840c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f83fff700 1 -- 172.21.15.93:0/2669263038 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f841517b0 con 0x7f2f840c1010 2020-11-20T12:14:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.009+0000 7f2f83fff700 1 --2- 172.21.15.93:0/2669263038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c1010 0x7f2f84063890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2f70009a40 tx=0x7f2f70006ef0).ready entity=mon.1 client_cookie=6b98561b8e1aad0f server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f837fe700 1 -- 172.21.15.93:0/2669263038 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000b820 con 0x7f2f840c1010 2020-11-20T12:14:48.022 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f837fe700 1 -- 172.21.15.93:0/2669263038 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f70000e90 con 0x7f2f840c1010 2020-11-20T12:14:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f837fe700 1 -- 172.21.15.93:0/2669263038 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7000bb90 con 0x7f2f840c1010 2020-11-20T12:14:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f8aa77700 1 -- 172.21.15.93:0/2669263038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c1010 msgr2=0x7f2f84063890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.023 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/2669263038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c1010 0x7f2f84063890 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f2f70009a40 tx=0x7f2f70006ef0).stop 2020-11-20T12:14:48.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f8aa77700 1 -- 172.21.15.93:0/2669263038 shutdown_connections 2020-11-20T12:14:48.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/2669263038 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c1010 0x7f2f84063890 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.024 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f8aa77700 1 -- 172.21.15.93:0/2669263038 >> 172.21.15.93:0/2669263038 conn(0x7f2f84060130 msgr2=0x7f2f84060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f8aa77700 1 -- 172.21.15.93:0/2669263038 shutdown_connections 2020-11-20T12:14:48.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.010+0000 7f2f8aa77700 1 -- 172.21.15.93:0/2669263038 wait complete. 2020-11-20T12:14:48.025 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.011+0000 7f2f8aa77700 1 Processor -- start 2020-11-20T12:14:48.026 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.011+0000 7f2f8aa77700 1 -- start start 2020-11-20T12:14:48.026 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f8aa77700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f840c1010 0x7f2f84161150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.026 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f8aa77700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c43c0 0x7f2f840c6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f8aa77700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f840c47a0 0x7f2f84157e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f8aa77700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84161640 con 0x7f2f840c47a0 2020-11-20T12:14:48.027 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f8aa77700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84112b40 con 0x7f2f840c43c0 2020-11-20T12:14:48.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f8aa77700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f84112de0 con 0x7f2f840c1010 2020-11-20T12:14:48.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c43c0 0x7f2f840c6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.028 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c43c0 0x7f2f840c6bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39430/0 (socket says 172.21.15.93:39430) 2020-11-20T12:14:48.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 -- 172.21.15.93:0/619478645 learned_addr learned my addr 172.21.15.93:0/619478645 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:48.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f88813700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f840c1010 0x7f2f84161150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.029 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f89014700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f840c47a0 0x7f2f84157e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 -- 172.21.15.93:0/619478645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f840c1010 msgr2=0x7f2f84161150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f840c1010 0x7f2f84161150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 -- 172.21.15.93:0/619478645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f840c47a0 msgr2=0x7f2f84157e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.030 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f840c47a0 0x7f2f84157e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f83fff700 1 -- 172.21.15.93:0/619478645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84113080 con 0x7f2f840c43c0 2020-11-20T12:14:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.012+0000 7f2f88813700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f840c1010 0x7f2f84161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:48.031 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.013+0000 7f2f83fff700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c43c0 0x7f2f840c6bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f2f7000c010 tx=0x7f2f70016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.013+0000 7f2f80ff9700 1 -- 172.21.15.93:0/619478645 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7001d480 con 0x7f2f840c43c0 2020-11-20T12:14:48.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.013+0000 7f2f80ff9700 1 -- 172.21.15.93:0/619478645 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7001d5e0 con 0x7f2f840c43c0 2020-11-20T12:14:48.032 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.013+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f84161b70 con 0x7f2f840c43c0 2020-11-20T12:14:48.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.013+0000 7f2f80ff9700 1 -- 172.21.15.93:0/619478645 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7001d960 con 0x7f2f840c43c0 2020-11-20T12:14:48.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.013+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f841620b0 con 0x7f2f840c43c0 2020-11-20T12:14:48.033 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.014+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f840674d0 con 0x7f2f840c43c0 2020-11-20T12:14:48.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.014+0000 7f2f80ff9700 1 -- 172.21.15.93:0/619478645 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f2f70017070 con 0x7f2f840c43c0 2020-11-20T12:14:48.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.015+0000 7f2f80ff9700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f2f5c080670 0x7f2f5c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.034 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.015+0000 7f2f80ff9700 1 -- 172.21.15.93:0/619478645 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f2f700a5520 con 0x7f2f840c43c0 2020-11-20T12:14:48.035 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.015+0000 7f2f88813700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f2f5c080670 0x7f2f5c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.035 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.015+0000 7f2f88813700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f2f5c080670 0x7f2f5c082b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2f78007fd0 tx=0x7f2f78009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.036 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.018+0000 7f2f80ff9700 1 -- 172.21.15.93:0/619478645 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f2f70079f30 con 0x7f2f840c43c0 2020-11-20T12:14:48.165 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.157+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f2f8405cd50 con 0x7f2f840c43c0 2020-11-20T12:14:48.173 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.157+0000 7f2f80ff9700 1 -- 172.21.15.93:0/619478645 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2f70015020 con 0x7f2f840c43c0 2020-11-20T12:14:48.175 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f2f5c080670 msgr2=0x7f2f5c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.176 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f2f5c080670 0x7f2f5c082b30 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f2f78007fd0 tx=0x7f2f78009040).stop 2020-11-20T12:14:48.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c43c0 msgr2=0x7f2f840c6bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c43c0 0x7f2f840c6bd0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f2f7000c010 tx=0x7f2f70016000).stop 2020-11-20T12:14:48.177 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 shutdown_connections 2020-11-20T12:14:48.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f2f5c080670 0x7f2f5c082b30 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f2f840c47a0 0x7f2f84157e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2f840c1010 0x7f2f84161150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 --2- 172.21.15.93:0/619478645 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f2f840c43c0 0x7f2f840c6bd0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.158+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 >> 172.21.15.93:0/619478645 conn(0x7f2f84060130 msgr2=0x7f2f8414d7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.159+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 shutdown_connections 2020-11-20T12:14:48.179 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.159+0000 7f2f8aa77700 1 -- 172.21.15.93:0/619478645 wait complete. 2020-11-20T12:14:48.179 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:48.180 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.7 2020-11-20T12:14:48.181 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.8 2020-11-20T12:14:48.290 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.287+0000 7f3e6a438700 1 Processor -- start 2020-11-20T12:14:48.291 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.287+0000 7f3e6a438700 1 -- start start 2020-11-20T12:14:48.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e6a438700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3e640c2250 0x7f3e64066d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.293 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e6a438700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3e640c2630 0x7f3e64064130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e6a438700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3e64064620 0x7f3e64150770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e6a438700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e64064a60 con 0x7f3e64064620 2020-11-20T12:14:48.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e6a438700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e640c2aa0 con 0x7f3e640c2250 2020-11-20T12:14:48.294 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e6a438700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e641549d0 con 0x7f3e640c2630 2020-11-20T12:14:48.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e63fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3e640c2250 0x7f3e64066d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e63fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f3e640c2250 0x7f3e64066d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39436/0 (socket says 172.21.15.93:39436) 2020-11-20T12:14:48.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e63fff700 1 -- 172.21.15.93:0/3546365760 learned_addr learned my addr 172.21.15.93:0/3546365760 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:48.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.288+0000 7f3e637fe700 1 --2- 172.21.15.93:0/3546365760 >> v2:172.21.15.132:3300/0 conn(0x7f3e640c2630 0x7f3e64064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.295 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e689d5700 1 --2- 172.21.15.93:0/3546365760 >> v2:172.21.15.66:3300/0 conn(0x7f3e64064620 0x7f3e64150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e63fff700 1 -- 172.21.15.93:0/3546365760 >> v2:172.21.15.132:3300/0 conn(0x7f3e640c2630 msgr2=0x7f3e64064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:48.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e63fff700 1 --2- 172.21.15.93:0/3546365760 >> v2:172.21.15.132:3300/0 conn(0x7f3e640c2630 0x7f3e64064130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e63fff700 1 -- 172.21.15.93:0/3546365760 >> v2:172.21.15.66:3300/0 conn(0x7f3e64064620 msgr2=0x7f3e64150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:48.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e63fff700 1 --2- 172.21.15.93:0/3546365760 >> v2:172.21.15.66:3300/0 conn(0x7f3e64064620 0x7f3e64150770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.296 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e63fff700 1 -- 172.21.15.93:0/3546365760 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64154c70 con 0x7f3e640c2250 2020-11-20T12:14:48.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e63fff700 1 --2- 172.21.15.93:0/3546365760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e64066d50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f3e64061140 tx=0x7f3e54006ef0).ready entity=mon.1 client_cookie=3e3039c427810364 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e62ffd700 1 -- 172.21.15.93:0/3546365760 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5400b8c0 con 0x7f3e640c2250 2020-11-20T12:14:48.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e62ffd700 1 -- 172.21.15.93:0/3546365760 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e54000e90 con 0x7f3e640c2250 2020-11-20T12:14:48.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e62ffd700 1 -- 172.21.15.93:0/3546365760 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5400bc30 con 0x7f3e640c2250 2020-11-20T12:14:48.297 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 -- 172.21.15.93:0/3546365760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 msgr2=0x7f3e64066d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3546365760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e64066d50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f3e64061140 tx=0x7f3e54006ef0).stop 2020-11-20T12:14:48.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 -- 172.21.15.93:0/3546365760 shutdown_connections 2020-11-20T12:14:48.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3546365760 >> v2:172.21.15.66:3300/0 conn(0x7f3e64064620 0x7f3e64150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3546365760 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e64066d50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.298 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3546365760 >> v2:172.21.15.132:3300/0 conn(0x7f3e640c2630 0x7f3e64064130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 -- 172.21.15.93:0/3546365760 >> 172.21.15.93:0/3546365760 conn(0x7f3e640bb880 msgr2=0x7f3e640bbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 -- 172.21.15.93:0/3546365760 shutdown_connections 2020-11-20T12:14:48.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.289+0000 7f3e6a438700 1 -- 172.21.15.93:0/3546365760 wait complete. 2020-11-20T12:14:48.299 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.290+0000 7f3e6a438700 1 Processor -- start 2020-11-20T12:14:48.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.291+0000 7f3e6a438700 1 -- start start 2020-11-20T12:14:48.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.291+0000 7f3e6a438700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64064620 0x7f3e64160770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.291+0000 7f3e6a438700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e640bc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.302 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.291+0000 7f3e6a438700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e640c2630 0x7f3e6414f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.291+0000 7f3e6a438700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6414c3d0 con 0x7f3e640c2630 2020-11-20T12:14:48.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.291+0000 7f3e6a438700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64160d50 con 0x7f3e640c2250 2020-11-20T12:14:48.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.291+0000 7f3e6a438700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64160ff0 con 0x7f3e64064620 2020-11-20T12:14:48.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e640bc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.303 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e640bc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39444/0 (socket says 172.21.15.93:39444) 2020-11-20T12:14:48.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 -- 172.21.15.93:0/3471511961 learned_addr learned my addr 172.21.15.93:0/3471511961 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:48.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e63fff700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64064620 0x7f3e64160770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e689d5700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e640c2630 0x7f3e6414f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 -- 172.21.15.93:0/3471511961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64064620 msgr2=0x7f3e64160770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.304 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64064620 0x7f3e64160770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 -- 172.21.15.93:0/3471511961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e640c2630 msgr2=0x7f3e6414f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e640c2630 0x7f3e6414f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 -- 172.21.15.93:0/3471511961 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e64161290 con 0x7f3e640c2250 2020-11-20T12:14:48.305 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e63fff700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64064620 0x7f3e64160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:48.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e637fe700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e640bc5b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3e5800d960 tx=0x7f3e58008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e43fff700 1 -- 172.21.15.93:0/3471511961 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5800dea0 con 0x7f3e640c2250 2020-11-20T12:14:48.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e43fff700 1 -- 172.21.15.93:0/3471511961 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e580097c0 con 0x7f3e640c2250 2020-11-20T12:14:48.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e64161530 con 0x7f3e640c2250 2020-11-20T12:14:48.306 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e43fff700 1 -- 172.21.15.93:0/3471511961 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e58009b80 con 0x7f3e640c2250 2020-11-20T12:14:48.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.292+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e640bf740 con 0x7f3e640c2250 2020-11-20T12:14:48.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.293+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e641547a0 con 0x7f3e640c2250 2020-11-20T12:14:48.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.294+0000 7f3e43fff700 1 -- 172.21.15.93:0/3471511961 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3e58013480 con 0x7f3e640c2250 2020-11-20T12:14:48.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.294+0000 7f3e43fff700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3e3c080670 0x7f3e3c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.307 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.294+0000 7f3e63fff700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3e3c080670 0x7f3e3c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.294+0000 7f3e43fff700 1 -- 172.21.15.93:0/3471511961 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3e580a2ce0 con 0x7f3e640c2250 2020-11-20T12:14:48.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.295+0000 7f3e63fff700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3e3c080670 0x7f3e3c082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3e54006f30 tx=0x7f3e54016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.308 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.298+0000 7f3e43fff700 1 -- 172.21.15.93:0/3471511961 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3e58077690 con 0x7f3e640c2250 2020-11-20T12:14:48.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.437+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) v1 -- 0x7f3e6405c2e0 con 0x7f3e640c2250 2020-11-20T12:14:48.440 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.437+0000 7f3e43fff700 1 -- 172.21.15.93:0/3471511961 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3e5807acb0 con 0x7f3e640c2250 2020-11-20T12:14:48.441 INFO:teuthology.orchestra.run.smithi093.stdout:73014444040 2020-11-20T12:14:48.442 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3e3c080670 msgr2=0x7f3e3c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.442 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3e3c080670 0x7f3e3c082b30 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f3e54006f30 tx=0x7f3e54016000).stop 2020-11-20T12:14:48.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 msgr2=0x7f3e640bc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e640bc5b0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f3e5800d960 tx=0x7f3e58008040).stop 2020-11-20T12:14:48.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 shutdown_connections 2020-11-20T12:14:48.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3e3c080670 0x7f3e3c082b30 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.443 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3e640c2630 0x7f3e6414f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e64064620 0x7f3e64160770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 --2- 172.21.15.93:0/3471511961 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3e640c2250 0x7f3e640bc5b0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 >> 172.21.15.93:0/3471511961 conn(0x7f3e640bb880 msgr2=0x7f3e640c5710 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 shutdown_connections 2020-11-20T12:14:48.444 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.439+0000 7f3e6a438700 1 -- 172.21.15.93:0/3471511961 wait complete. 2020-11-20T12:14:48.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.8 2020-11-20T12:14:48.453 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.9 2020-11-20T12:14:48.566 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.563+0000 7f3d6c880700 1 Processor -- start 2020-11-20T12:14:48.567 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.563+0000 7f3d6c880700 1 -- start start 2020-11-20T12:14:48.570 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d6c880700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f3d680c1010 0x7f3d68063890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.571 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d6c880700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d680c0230 con 0x7f3d680c47a0 2020-11-20T12:14:48.572 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d6c880700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d68151510 con 0x7f3d680c43c0 2020-11-20T12:14:48.572 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d6c880700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d680c4bf0 con 0x7f3d680c1010 2020-11-20T12:14:48.572 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d66d9d700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f3d680c47a0 0x7f3d68150350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40152/0 (socket says 172.21.15.93:40152) 2020-11-20T12:14:48.573 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d66d9d700 1 -- 172.21.15.93:0/2463786550 learned_addr learned my addr 172.21.15.93:0/2463786550 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:48.573 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d5ffff700 1 --2- 172.21.15.93:0/2463786550 >> v2:172.21.15.66:3300/0 conn(0x7f3d680c1010 0x7f3d68063890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.573 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d65d9b700 1 -- 172.21.15.93:0/2463786550 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2605957025 0 0) 0x7f3d680c0230 con 0x7f3d680c47a0 2020-11-20T12:14:48.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.564+0000 7f3d65d9b700 1 -- 172.21.15.93:0/2463786550 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d48003280 con 0x7f3d680c47a0 2020-11-20T12:14:48.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d5ffff700 1 -- 172.21.15.93:0/2463786550 >> v1:172.21.15.132:6789/0 conn(0x7f3d680c43c0 legacy=0x7f3d680c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.574 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d65d9b700 1 -- 172.21.15.93:0/2463786550 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 54341252 0 0) 0x7f3d68151510 con 0x7f3d680c43c0 2020-11-20T12:14:48.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d5ffff700 1 -- 172.21.15.93:0/2463786550 >> v1:172.21.15.93:6789/0 conn(0x7f3d680c47a0 legacy=0x7f3d68150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d5ffff700 1 -- 172.21.15.93:0/2463786550 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d681517b0 con 0x7f3d680c1010 2020-11-20T12:14:48.575 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d5ffff700 1 --2- 172.21.15.93:0/2463786550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c1010 0x7f3d68063890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3d5000ba00 tx=0x7f3d50006e30).ready entity=mon.0 client_cookie=9bc992faae7d58e6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d65d9b700 1 -- 172.21.15.93:0/2463786550 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d500097a0 con 0x7f3d680c1010 2020-11-20T12:14:48.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d65d9b700 1 -- 172.21.15.93:0/2463786550 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50000e90 con 0x7f3d680c1010 2020-11-20T12:14:48.576 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d65d9b700 1 -- 172.21.15.93:0/2463786550 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50009b10 con 0x7f3d680c1010 2020-11-20T12:14:48.577 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d6c880700 1 -- 172.21.15.93:0/2463786550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c1010 msgr2=0x7f3d68063890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.577 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d6c880700 1 --2- 172.21.15.93:0/2463786550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c1010 0x7f3d68063890 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f3d5000ba00 tx=0x7f3d50006e30).stop 2020-11-20T12:14:48.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d6c880700 1 -- 172.21.15.93:0/2463786550 shutdown_connections 2020-11-20T12:14:48.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d6c880700 1 --2- 172.21.15.93:0/2463786550 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c1010 0x7f3d68063890 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.578 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.565+0000 7f3d6c880700 1 -- 172.21.15.93:0/2463786550 >> 172.21.15.93:0/2463786550 conn(0x7f3d68060130 msgr2=0x7f3d68060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.566+0000 7f3d6c880700 1 -- 172.21.15.93:0/2463786550 shutdown_connections 2020-11-20T12:14:48.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.566+0000 7f3d6c880700 1 -- 172.21.15.93:0/2463786550 wait complete. 2020-11-20T12:14:48.579 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 Processor -- start 2020-11-20T12:14:48.580 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 -- start start 2020-11-20T12:14:48.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680c1010 0x7f3d68164310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.585 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d680c43c0 0x7f3d68156230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c47a0 0x7f3d68156fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6814c920 con 0x7f3d680c47a0 2020-11-20T12:14:48.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68152b30 con 0x7f3d680c43c0 2020-11-20T12:14:48.586 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d6c880700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68112450 con 0x7f3d680c1010 2020-11-20T12:14:48.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.567+0000 7f3d5ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d680c43c0 0x7f3d68156230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d680c43c0 0x7f3d68156230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39458/0 (socket says 172.21.15.93:39458) 2020-11-20T12:14:48.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 -- 172.21.15.93:0/1429630068 learned_addr learned my addr 172.21.15.93:0/1429630068 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:48.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d6659c700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680c1010 0x7f3d68164310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.587 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d66d9d700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c47a0 0x7f3d68156fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 -- 172.21.15.93:0/1429630068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680c1010 msgr2=0x7f3d68164310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680c1010 0x7f3d68164310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 -- 172.21.15.93:0/1429630068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c47a0 msgr2=0x7f3d68156fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.588 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c47a0 0x7f3d68156fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 -- 172.21.15.93:0/1429630068 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d681126f0 con 0x7f3d680c43c0 2020-11-20T12:14:48.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5ffff700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d680c43c0 0x7f3d68156230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f3d68066400 tx=0x7f3d50015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5e7fc700 1 -- 172.21.15.93:0/1429630068 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d50021070 con 0x7f3d680c43c0 2020-11-20T12:14:48.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5e7fc700 1 -- 172.21.15.93:0/1429630068 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d50011b40 con 0x7f3d680c43c0 2020-11-20T12:14:48.589 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d68112990 con 0x7f3d680c43c0 2020-11-20T12:14:48.590 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d5e7fc700 1 -- 172.21.15.93:0/1429630068 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d5001d450 con 0x7f3d680c43c0 2020-11-20T12:14:48.590 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.568+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d68155d90 con 0x7f3d680c43c0 2020-11-20T12:14:48.590 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.569+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d680674d0 con 0x7f3d680c43c0 2020-11-20T12:14:48.590 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.569+0000 7f3d5e7fc700 1 -- 172.21.15.93:0/1429630068 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3d5000f070 con 0x7f3d680c43c0 2020-11-20T12:14:48.590 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.570+0000 7f3d5e7fc700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3d44080670 0x7f3d44082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.591 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.570+0000 7f3d5e7fc700 1 -- 172.21.15.93:0/1429630068 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f3d500a3fb0 con 0x7f3d680c43c0 2020-11-20T12:14:48.591 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.570+0000 7f3d6659c700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3d44080670 0x7f3d44082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.591 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.570+0000 7f3d6659c700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3d44080670 0x7f3d44082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3d580011e0 tx=0x7f3d580079f0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.591 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.573+0000 7f3d5e7fc700 1 -- 172.21.15.93:0/1429630068 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3d500789c0 con 0x7f3d680c43c0 2020-11-20T12:14:48.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.712+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) v1 -- 0x7f3d681121a0 con 0x7f3d680c43c0 2020-11-20T12:14:48.715 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.712+0000 7f3d5e7fc700 1 -- 172.21.15.93:0/1429630068 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3d5007bfe0 con 0x7f3d680c43c0 2020-11-20T12:14:48.715 INFO:teuthology.orchestra.run.smithi093.stdout:73014444039 2020-11-20T12:14:48.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.713+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3d44080670 msgr2=0x7f3d44082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3d44080670 0x7f3d44082b30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f3d580011e0 tx=0x7f3d580079f0).stop 2020-11-20T12:14:48.717 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d680c43c0 msgr2=0x7f3d68156230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d680c43c0 0x7f3d68156230 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f3d68066400 tx=0x7f3d50015000).stop 2020-11-20T12:14:48.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 shutdown_connections 2020-11-20T12:14:48.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f3d44080670 0x7f3d44082b30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.718 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f3d680c47a0 0x7f3d68156fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.719 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d680c1010 0x7f3d68164310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.719 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 --2- 172.21.15.93:0/1429630068 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f3d680c43c0 0x7f3d68156230 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.719 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 >> 172.21.15.93:0/1429630068 conn(0x7f3d68060130 msgr2=0x7f3d68060510 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.719 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 shutdown_connections 2020-11-20T12:14:48.719 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.714+0000 7f3d6c880700 1 -- 172.21.15.93:0/1429630068 wait complete. 2020-11-20T12:14:48.728 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444039 got 73014444039 for osd.9 2020-11-20T12:14:48.728 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.10 2020-11-20T12:14:48.838 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.835+0000 7f43b0f34700 1 Processor -- start 2020-11-20T12:14:48.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.835+0000 7f43b0f34700 1 -- start start 2020-11-20T12:14:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43b0f34700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f43ac063890 0x7f43ac0c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43b0f34700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac0c0230 con 0x7f43ac0c43c0 2020-11-20T12:14:48.842 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43b0f34700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43ac151510 con 0x7f43ac0c1010 2020-11-20T12:14:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43b0f34700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43ac1517b0 con 0x7f43ac063890 2020-11-20T12:14:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43aa59c700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f43ac0c43c0 0x7f43ac0c0900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40162/0 (socket says 172.21.15.93:40162) 2020-11-20T12:14:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43aa59c700 1 -- 172.21.15.93:0/3895119976 learned_addr learned my addr 172.21.15.93:0/3895119976 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4205053726 0 0) 0x7f43ac0c0230 con 0x7f43ac0c43c0 2020-11-20T12:14:48.843 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f438c003280 con 0x7f43ac0c43c0 2020-11-20T12:14:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.836+0000 7f43aad9d700 1 --2- 172.21.15.93:0/3895119976 >> v2:172.21.15.66:3300/0 conn(0x7f43ac063890 0x7f43ac0c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1124997205 0 0) 0x7f438c003280 con 0x7f43ac0c43c0 2020-11-20T12:14:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 >> v2:172.21.15.66:3300/0 conn(0x7f43ac063890 msgr2=0x7f43ac0c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:48.844 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 --2- 172.21.15.93:0/3895119976 >> v2:172.21.15.66:3300/0 conn(0x7f43ac063890 0x7f43ac0c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 >> v1:172.21.15.132:6789/0 conn(0x7f43ac0c1010 legacy=0x7f43ac150350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac151a50 con 0x7f43ac0c43c0 2020-11-20T12:14:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f439c001520 con 0x7f43ac0c43c0 2020-11-20T12:14:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 >> v1:172.21.15.93:6789/0 conn(0x7f43ac0c43c0 legacy=0x7f43ac0c0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.845 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c0037c0 0x7f438c003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f438c004520 0x7f438c0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f438c004e90 0x7f438c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1517b0 con 0x7f438c0037c0 2020-11-20T12:14:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c005340 con 0x7f438c004520 2020-11-20T12:14:48.846 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f438c00bc60 con 0x7f438c004e90 2020-11-20T12:14:48.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a3fff700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f438c004520 0x7f438c0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43aa59c700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c0037c0 0x7f438c003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43aad9d700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f438c004e90 0x7f438c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a3fff700 1 -- 172.21.15.93:0/3895119976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f438c004e90 msgr2=0x7f438c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:48.847 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a3fff700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f438c004e90 0x7f438c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a3fff700 1 -- 172.21.15.93:0/3895119976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c0037c0 msgr2=0x7f438c003be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a3fff700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c0037c0 0x7f438c003be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43aad9d700 1 -- 172.21.15.93:0/3895119976 reap_dead start 2020-11-20T12:14:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a3fff700 1 -- 172.21.15.93:0/3895119976 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f438c003280 con 0x7f438c004520 2020-11-20T12:14:48.848 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a3fff700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f438c004520 0x7f438c0049a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f4394001960 tx=0x7f4394007bd0).ready entity=mon.1 client_cookie=28618514134a6080 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4394007020 con 0x7f438c004520 2020-11-20T12:14:48.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4394007180 con 0x7f438c004520 2020-11-20T12:14:48.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.837+0000 7f43a9d9b700 1 -- 172.21.15.93:0/3895119976 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f439400c860 con 0x7f438c004520 2020-11-20T12:14:48.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.838+0000 7f43b0f34700 1 -- 172.21.15.93:0/3895119976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f438c004520 msgr2=0x7f438c0049a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.849 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.838+0000 7f43b0f34700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f438c004520 0x7f438c0049a0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f4394001960 tx=0x7f4394007bd0).stop 2020-11-20T12:14:48.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.838+0000 7f43b0f34700 1 -- 172.21.15.93:0/3895119976 shutdown_connections 2020-11-20T12:14:48.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.838+0000 7f43b0f34700 1 --2- 172.21.15.93:0/3895119976 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f438c004520 0x7f438c0049a0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.838+0000 7f43b0f34700 1 -- 172.21.15.93:0/3895119976 >> 172.21.15.93:0/3895119976 conn(0x7f43ac060130 msgr2=0x7f43ac060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.838+0000 7f43b0f34700 1 -- 172.21.15.93:0/3895119976 shutdown_connections 2020-11-20T12:14:48.850 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.838+0000 7f43b0f34700 1 -- 172.21.15.93:0/3895119976 wait complete. 2020-11-20T12:14:48.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.839+0000 7f43b0f34700 1 Processor -- start 2020-11-20T12:14:48.851 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.839+0000 7f43b0f34700 1 -- start start 2020-11-20T12:14:48.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c004520 0x7f43ac160fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.853 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43ac112450 0x7f43ac0648f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43ac064de0 0x7f43ac14b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac1614b0 con 0x7f438c004520 2020-11-20T12:14:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac163cb0 con 0x7f43ac064de0 2020-11-20T12:14:48.854 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43ac163f50 con 0x7f43ac112450 2020-11-20T12:14:48.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43ac064de0 0x7f43ac14b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43ac064de0 0x7f43ac14b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39480/0 (socket says 172.21.15.93:39480) 2020-11-20T12:14:48.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 -- 172.21.15.93:0/23549989 learned_addr learned my addr 172.21.15.93:0/23549989 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:48.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aa59c700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c004520 0x7f43ac160fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.855 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43a3fff700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43ac112450 0x7f43ac0648f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 -- 172.21.15.93:0/23549989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43ac112450 msgr2=0x7f43ac0648f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43ac112450 0x7f43ac0648f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 -- 172.21.15.93:0/23549989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c004520 msgr2=0x7f43ac160fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c004520 0x7f43ac160fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.856 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 -- 172.21.15.93:0/23549989 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ac1641f0 con 0x7f43ac064de0 2020-11-20T12:14:48.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43aad9d700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43ac064de0 0x7f43ac14b3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f43ac062990 tx=0x7f43a4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43a27fc700 1 -- 172.21.15.93:0/23549989 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4015690 con 0x7f43ac064de0 2020-11-20T12:14:48.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43a27fc700 1 -- 172.21.15.93:0/23549989 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a40157f0 con 0x7f43ac064de0 2020-11-20T12:14:48.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43ac164490 con 0x7f43ac064de0 2020-11-20T12:14:48.857 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43a27fc700 1 -- 172.21.15.93:0/23549989 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f43a4015b90 con 0x7f43ac064de0 2020-11-20T12:14:48.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.840+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43ac152de0 con 0x7f43ac064de0 2020-11-20T12:14:48.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.841+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43ac1648f0 con 0x7f43ac064de0 2020-11-20T12:14:48.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.842+0000 7f43a27fc700 1 -- 172.21.15.93:0/23549989 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f43a4012040 con 0x7f43ac064de0 2020-11-20T12:14:48.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.842+0000 7f43a27fc700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f4388080670 0x7f4388082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:48.858 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.843+0000 7f43a27fc700 1 -- 172.21.15.93:0/23549989 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f43a40a2de0 con 0x7f43ac064de0 2020-11-20T12:14:48.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.843+0000 7f43aa59c700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f4388080670 0x7f4388082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:48.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.843+0000 7f43aa59c700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f4388080670 0x7f4388082b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f43ac026f10 tx=0x7f43ac1516a0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:48.859 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.846+0000 7f43a27fc700 1 -- 172.21.15.93:0/23549989 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f43a40777f0 con 0x7f43ac064de0 2020-11-20T12:14:48.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.987+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) v1 -- 0x7f43ac0674d0 con 0x7f43ac064de0 2020-11-20T12:14:48.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.987+0000 7f43a27fc700 1 -- 172.21.15.93:0/23549989 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f43a407ae10 con 0x7f43ac064de0 2020-11-20T12:14:48.991 INFO:teuthology.orchestra.run.smithi093.stdout:73014444040 2020-11-20T12:14:48.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f4388080670 msgr2=0x7f4388082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f4388080670 0x7f4388082b30 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f43ac026f10 tx=0x7f43ac1516a0).stop 2020-11-20T12:14:48.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43ac064de0 msgr2=0x7f43ac14b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:48.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43ac064de0 0x7f43ac14b3f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f43ac062990 tx=0x7f43a4008040).stop 2020-11-20T12:14:48.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 shutdown_connections 2020-11-20T12:14:48.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f43ac064de0 0x7f43ac14b3f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f4388080670 0x7f4388082b30 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f438c004520 0x7f43ac160fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 --2- 172.21.15.93:0/23549989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f43ac112450 0x7f43ac0648f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:48.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 >> 172.21.15.93:0/23549989 conn(0x7f43ac060130 msgr2=0x7f43ac0c37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:48.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 shutdown_connections 2020-11-20T12:14:48.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:48.989+0000 7f43b0f34700 1 -- 172.21.15.93:0/23549989 wait complete. 2020-11-20T12:14:49.003 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444040 got 73014444040 for osd.10 2020-11-20T12:14:49.003 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.11 2020-11-20T12:14:49.112 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.109+0000 7f85cb139700 1 Processor -- start 2020-11-20T12:14:49.113 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.109+0000 7f85cb139700 1 -- start start 2020-11-20T12:14:49.116 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.110+0000 7f85cb139700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85c4064810 0x7f85c4064bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.116 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.110+0000 7f85cb139700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f85c4067f90 0x7f85c40c2310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.110+0000 7f85cb139700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85c4068440 con 0x7f85c4060b10 2020-11-20T12:14:49.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.110+0000 7f85cb139700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c40c3f00 con 0x7f85c4067f90 2020-11-20T12:14:49.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.110+0000 7f85cb139700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85c40c2800 con 0x7f85c4064810 2020-11-20T12:14:49.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.110+0000 7f85ca938700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f85c4060b10 0x7f85c4154710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40184/0 (socket says 172.21.15.93:40184) 2020-11-20T12:14:49.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca938700 1 -- 172.21.15.93:0/605989384 learned_addr learned my addr 172.21.15.93:0/605989384 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:49.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9936700 1 --2- 172.21.15.93:0/605989384 >> v2:172.21.15.66:3300/0 conn(0x7f85c4067f90 0x7f85c40c2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca137700 1 --2- 172.21.15.93:0/605989384 >> v2:172.21.15.132:3300/0 conn(0x7f85c4064810 0x7f85c4064bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2187606178 0 0) 0x7f85c4068440 con 0x7f85c4060b10 2020-11-20T12:14:49.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85ac003280 con 0x7f85c4060b10 2020-11-20T12:14:49.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1644450267 0 0) 0x7f85ac003280 con 0x7f85c4060b10 2020-11-20T12:14:49.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 >> v2:172.21.15.132:3300/0 conn(0x7f85c4064810 msgr2=0x7f85c4064bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:49.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 --2- 172.21.15.93:0/605989384 >> v2:172.21.15.132:3300/0 conn(0x7f85c4064810 0x7f85c4064bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 >> v2:172.21.15.66:3300/0 conn(0x7f85c4067f90 msgr2=0x7f85c40c2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:49.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 --2- 172.21.15.93:0/605989384 >> v2:172.21.15.66:3300/0 conn(0x7f85c4067f90 0x7f85c40c2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c4154fd0 con 0x7f85c4060b10 2020-11-20T12:14:49.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f85bc0018f0 con 0x7f85c4060b10 2020-11-20T12:14:49.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 >> v1:172.21.15.93:6789/0 conn(0x7f85c4060b10 legacy=0x7f85c4154710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85ac003890 0x7f85ac003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.120 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac004520 0x7f85ac0049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85ac004e90 0x7f85ac00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40c3f00 con 0x7f85ac004520 2020-11-20T12:14:49.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c40c2800 con 0x7f85ac003890 2020-11-20T12:14:49.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85ac00bc60 con 0x7f85ac004e90 2020-11-20T12:14:49.121 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca137700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85ac003890 0x7f85ac003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca938700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85ac004e90 0x7f85ac00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9936700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac004520 0x7f85ac0049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca137700 1 -- 172.21.15.93:0/605989384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85ac004e90 msgr2=0x7f85ac00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca137700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85ac004e90 0x7f85ac00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.122 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca137700 1 -- 172.21.15.93:0/605989384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac004520 msgr2=0x7f85ac0049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:49.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca137700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac004520 0x7f85ac0049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca137700 1 -- 172.21.15.93:0/605989384 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ac003280 con 0x7f85ac003890 2020-11-20T12:14:49.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca938700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85ac004e90 0x7f85ac00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:49.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85c9936700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac004520 0x7f85ac0049a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:49.123 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.111+0000 7f85ca938700 1 -- 172.21.15.93:0/605989384 reap_dead start 2020-11-20T12:14:49.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85ca137700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85ac003890 0x7f85ac003cb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f85c000bc40 tx=0x7f85c0006e30).ready entity=mon.1 client_cookie=f229523ba50a023b server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000b350 con 0x7f85ac003890 2020-11-20T12:14:49.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c000eab0 con 0x7f85ac003890 2020-11-20T12:14:49.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85c9135700 1 -- 172.21.15.93:0/605989384 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c000ee30 con 0x7f85ac003890 2020-11-20T12:14:49.124 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85cb139700 1 -- 172.21.15.93:0/605989384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85ac003890 msgr2=0x7f85ac003cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85cb139700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85ac003890 0x7f85ac003cb0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f85c000bc40 tx=0x7f85c0006e30).stop 2020-11-20T12:14:49.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85cb139700 1 -- 172.21.15.93:0/605989384 shutdown_connections 2020-11-20T12:14:49.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85cb139700 1 --2- 172.21.15.93:0/605989384 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85ac003890 0x7f85ac003cb0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85cb139700 1 -- 172.21.15.93:0/605989384 >> 172.21.15.93:0/605989384 conn(0x7f85c40c7820 msgr2=0x7f85c40c7c30 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:49.125 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85cb139700 1 -- 172.21.15.93:0/605989384 shutdown_connections 2020-11-20T12:14:49.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.112+0000 7f85cb139700 1 -- 172.21.15.93:0/605989384 wait complete. 2020-11-20T12:14:49.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.113+0000 7f85cb139700 1 Processor -- start 2020-11-20T12:14:49.126 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.113+0000 7f85cb139700 1 -- start start 2020-11-20T12:14:49.128 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85cb139700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac003890 0x7f85c4067530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85cb139700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85c4067a20 0x7f85c40b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85cb139700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85c4153ea0 0x7f85c40b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85cb139700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4160260 con 0x7f85ac003890 2020-11-20T12:14:49.129 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85cb139700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4163b70 con 0x7f85c4067a20 2020-11-20T12:14:49.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85cb139700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85c4163e10 con 0x7f85c4153ea0 2020-11-20T12:14:49.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85c4067a20 0x7f85c40b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85c4067a20 0x7f85c40b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39500/0 (socket says 172.21.15.93:39500) 2020-11-20T12:14:49.130 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 -- 172.21.15.93:0/2551288939 learned_addr learned my addr 172.21.15.93:0/2551288939 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:49.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85ca137700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac003890 0x7f85c4067530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85ca938700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85c4153ea0 0x7f85c40b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 -- 172.21.15.93:0/2551288939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85c4153ea0 msgr2=0x7f85c40b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85c4153ea0 0x7f85c40b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.131 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 -- 172.21.15.93:0/2551288939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac003890 msgr2=0x7f85c4067530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac003890 0x7f85c4067530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85c9936700 1 -- 172.21.15.93:0/2551288939 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85c41640b0 con 0x7f85c4067a20 2020-11-20T12:14:49.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.114+0000 7f85ca938700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85c4153ea0 0x7f85c40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:49.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.115+0000 7f85c9936700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85c4067a20 0x7f85c40b0db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f85b4010c20 tx=0x7f85b4008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.132 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.115+0000 7f85b27fc700 1 -- 172.21.15.93:0/2551288939 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b400ea30 con 0x7f85c4067a20 2020-11-20T12:14:49.133 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.115+0000 7f85b27fc700 1 -- 172.21.15.93:0/2551288939 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85b400eb90 con 0x7f85c4067a20 2020-11-20T12:14:49.133 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.115+0000 7f85b27fc700 1 -- 172.21.15.93:0/2551288939 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85b4014470 con 0x7f85c4067a20 2020-11-20T12:14:49.133 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.115+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4164350 con 0x7f85c4067a20 2020-11-20T12:14:49.133 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.115+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85c41637c0 con 0x7f85c4067a20 2020-11-20T12:14:49.133 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.116+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85c41603d0 con 0x7f85c4067a20 2020-11-20T12:14:49.134 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.116+0000 7f85b27fc700 1 -- 172.21.15.93:0/2551288939 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f85b40148a0 con 0x7f85c4067a20 2020-11-20T12:14:49.134 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.117+0000 7f85b27fc700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f859c080670 0x7f859c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.134 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.117+0000 7f85b27fc700 1 -- 172.21.15.93:0/2551288939 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f85b40a2f70 con 0x7f85c4067a20 2020-11-20T12:14:49.134 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.117+0000 7f85ca137700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f859c080670 0x7f859c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.134 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.117+0000 7f85ca137700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f859c080670 0x7f859c082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f85c0006e70 tx=0x7f85c0019000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.135 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.120+0000 7f85b27fc700 1 -- 172.21.15.93:0/2551288939 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f85c41603d0 con 0x7f85c4067a20 2020-11-20T12:14:49.263 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.260+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) v1 -- 0x7f85c41603d0 con 0x7f85c4067a20 2020-11-20T12:14:49.264 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.261+0000 7f85b27fc700 1 -- 172.21.15.93:0/2551288939 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) v1 ==== 75+0+12 (secure 0 0 0) 0x7f85c41603d0 con 0x7f85c4067a20 2020-11-20T12:14:49.264 INFO:teuthology.orchestra.run.smithi093.stdout:73014444038 2020-11-20T12:14:49.265 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f859c080670 msgr2=0x7f859c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.265 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f859c080670 0x7f859c082b30 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f85c0006e70 tx=0x7f85c0019000).stop 2020-11-20T12:14:49.266 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85c4067a20 msgr2=0x7f85c40b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.266 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85c4067a20 0x7f85c40b0db0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f85b4010c20 tx=0x7f85b4008040).stop 2020-11-20T12:14:49.266 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 shutdown_connections 2020-11-20T12:14:49.266 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85c4153ea0 0x7f85c40b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.266 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f859c080670 0x7f859c082b30 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.267 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f85ac003890 0x7f85c4067530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.267 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 --2- 172.21.15.93:0/2551288939 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f85c4067a20 0x7f85c40b0db0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.267 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 >> 172.21.15.93:0/2551288939 conn(0x7f85c40c7820 msgr2=0x7f85c40c1540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:49.267 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 shutdown_connections 2020-11-20T12:14:49.267 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.262+0000 7f85cb139700 1 -- 172.21.15.93:0/2551288939 wait complete. 2020-11-20T12:14:49.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 73014444038 got 73014444038 for osd.11 2020-11-20T12:14:49.277 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-11-20T12:14:49.277 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:14:49.385 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.382+0000 7f03d565c700 1 Processor -- start 2020-11-20T12:14:49.385 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.382+0000 7f03d565c700 1 -- start start 2020-11-20T12:14:49.387 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03d565c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f03d0064500 0x7f03d014e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.387 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03d565c700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d00babf0 con 0x7f03d0064120 2020-11-20T12:14:49.388 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03d565c700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03d00c1220 con 0x7f03d00c0d50 2020-11-20T12:14:49.388 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03d565c700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03d00c14c0 con 0x7f03d0064500 2020-11-20T12:14:49.388 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03ceffd700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f03d0064120 0x7f03d00c0640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39736/0 (socket says 172.21.15.93:39736) 2020-11-20T12:14:49.388 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03ceffd700 1 -- 172.21.15.93:0/3852279612 learned_addr learned my addr 172.21.15.93:0/3852279612 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:49.388 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cf7fe700 1 --2- 172.21.15.93:0/3852279612 >> v2:172.21.15.132:3300/0 conn(0x7f03d0064500 0x7f03d014e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.389 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cdffb700 1 -- 172.21.15.93:0/3852279612 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 621844760 0 0) 0x7f03d00babf0 con 0x7f03d0064120 2020-11-20T12:14:49.389 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cdffb700 1 -- 172.21.15.93:0/3852279612 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f03bc003280 con 0x7f03d0064120 2020-11-20T12:14:49.389 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cf7fe700 1 -- 172.21.15.93:0/3852279612 >> v1:172.21.15.132:6789/0 conn(0x7f03d00c0d50 legacy=0x7f03d014e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.389 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cdffb700 1 -- 172.21.15.93:0/3852279612 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 5288983 0 0) 0x7f03d00c1220 con 0x7f03d00c0d50 2020-11-20T12:14:49.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cf7fe700 1 -- 172.21.15.93:0/3852279612 >> v1:172.21.15.66:6789/0 conn(0x7f03d0064120 legacy=0x7f03d00c0640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cf7fe700 1 -- 172.21.15.93:0/3852279612 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d00c1760 con 0x7f03d0064500 2020-11-20T12:14:49.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.383+0000 7f03cf7fe700 1 --2- 172.21.15.93:0/3852279612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064500 0x7f03d014e830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f03c8009d10 tx=0x7f03c8009220).ready entity=mon.2 client_cookie=441faaa3e57a4a3c server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03cdffb700 1 -- 172.21.15.93:0/3852279612 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8009e70 con 0x7f03d0064500 2020-11-20T12:14:49.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03cdffb700 1 -- 172.21.15.93:0/3852279612 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c800bc40 con 0x7f03d0064500 2020-11-20T12:14:49.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03cdffb700 1 -- 172.21.15.93:0/3852279612 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c8011400 con 0x7f03d0064500 2020-11-20T12:14:49.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03d565c700 1 -- 172.21.15.93:0/3852279612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064500 msgr2=0x7f03d014e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03d565c700 1 --2- 172.21.15.93:0/3852279612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064500 0x7f03d014e830 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f03c8009d10 tx=0x7f03c8009220).stop 2020-11-20T12:14:49.392 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03d565c700 1 -- 172.21.15.93:0/3852279612 shutdown_connections 2020-11-20T12:14:49.392 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03d565c700 1 --2- 172.21.15.93:0/3852279612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064500 0x7f03d014e830 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.392 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03d565c700 1 -- 172.21.15.93:0/3852279612 >> 172.21.15.93:0/3852279612 conn(0x7f03d0060c00 msgr2=0x7f03d00c5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:49.392 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03d565c700 1 -- 172.21.15.93:0/3852279612 shutdown_connections 2020-11-20T12:14:49.392 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.384+0000 7f03d565c700 1 -- 172.21.15.93:0/3852279612 wait complete. 2020-11-20T12:14:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.385+0000 7f03d565c700 1 Processor -- start 2020-11-20T12:14:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.385+0000 7f03d565c700 1 -- start start 2020-11-20T12:14:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03d565c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064120 0x7f03d0160d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.395 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03d565c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03d0064500 0x7f03d0066110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03d565c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03d00c0d50 0x7f03d014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03d565c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d0161260 con 0x7f03d0064500 2020-11-20T12:14:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03d565c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d0155a60 con 0x7f03d00c0d50 2020-11-20T12:14:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03d565c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03d0155d00 con 0x7f03d0064120 2020-11-20T12:14:49.396 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03cf7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03d00c0d50 0x7f03d014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03cf7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03d00c0d50 0x7f03d014efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39512/0 (socket says 172.21.15.93:39512) 2020-11-20T12:14:49.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03ceffd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064120 0x7f03d0160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03cf7fe700 1 -- 172.21.15.93:0/164363581 learned_addr learned my addr 172.21.15.93:0/164363581 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:49.397 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.386+0000 7f03ce7fc700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03d0064500 0x7f03d0066110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03cf7fe700 1 -- 172.21.15.93:0/164363581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064120 msgr2=0x7f03d0160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03cf7fe700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064120 0x7f03d0160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03cf7fe700 1 -- 172.21.15.93:0/164363581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03d0064500 msgr2=0x7f03d0066110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03cf7fe700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03d0064500 0x7f03d0066110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.398 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03cf7fe700 1 -- 172.21.15.93:0/164363581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0155fa0 con 0x7f03d00c0d50 2020-11-20T12:14:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03cf7fe700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03d00c0d50 0x7f03d014efc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f03c8006f70 tx=0x7f03c8016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03b6ffd700 1 -- 172.21.15.93:0/164363581 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c801b6b0 con 0x7f03d00c0d50 2020-11-20T12:14:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03b6ffd700 1 -- 172.21.15.93:0/164363581 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03c801b810 con 0x7f03d00c0d50 2020-11-20T12:14:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03d0156240 con 0x7f03d00c0d50 2020-11-20T12:14:49.399 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03b6ffd700 1 -- 172.21.15.93:0/164363581 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03c801bbb0 con 0x7f03d00c0d50 2020-11-20T12:14:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.387+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03d0156780 con 0x7f03d00c0d50 2020-11-20T12:14:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.388+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03d005cd50 con 0x7f03d00c0d50 2020-11-20T12:14:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.388+0000 7f03b6ffd700 1 -- 172.21.15.93:0/164363581 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f03c8017070 con 0x7f03d00c0d50 2020-11-20T12:14:49.400 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.389+0000 7f03b6ffd700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03ac0806a0 0x7f03ac082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.401 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.389+0000 7f03ceffd700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03ac0806a0 0x7f03ac082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.401 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.389+0000 7f03b6ffd700 1 -- 172.21.15.93:0/164363581 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f03c80a4db0 con 0x7f03d00c0d50 2020-11-20T12:14:49.401 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.389+0000 7f03ceffd700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03ac0806a0 0x7f03ac082b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f03c00055e0 tx=0x7f03c0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.401 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.392+0000 7f03b6ffd700 1 -- 172.21.15.93:0/164363581 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f03c80797c0 con 0x7f03d00c0d50 2020-11-20T12:14:49.531 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.528+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 --> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f03d0156fa0 con 0x7f03ac0806a0 2020-11-20T12:14:49.537 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.532+0000 7f03b6ffd700 1 -- 172.21.15.93:0/164363581 <== mgr.4105 v2:172.21.15.93:6800/22895 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+99805 (secure 0 0 0) 0x7f03c0001d50 con 0x7f03ac0806a0 2020-11-20T12:14:49.537 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:49.539 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03ac0806a0 msgr2=0x7f03ac082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.539 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03ac0806a0 0x7f03ac082b60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f03c00055e0 tx=0x7f03c0009040).stop 2020-11-20T12:14:49.540 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03d00c0d50 msgr2=0x7f03d014efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.540 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03d00c0d50 0x7f03d014efc0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f03c8006f70 tx=0x7f03c8016000).stop 2020-11-20T12:14:49.540 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 shutdown_connections 2020-11-20T12:14:49.541 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f03d00c0d50 0x7f03d014efc0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.541 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f03d0064120 0x7f03d0160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.542 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f03ac0806a0 0x7f03ac082b60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.542 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 --2- 172.21.15.93:0/164363581 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f03d0064500 0x7f03d0066110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.542 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.534+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 >> 172.21.15.93:0/164363581 conn(0x7f03d0060c00 msgr2=0x7f03d00c5830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:49.543 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.535+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 shutdown_connections 2020-11-20T12:14:49.543 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.535+0000 7f03d565c700 1 -- 172.21.15.93:0/164363581 wait complete. 2020-11-20T12:14:49.543 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2020-11-20T12:14:49.549 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2020-11-20T12:14:49.015326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61856,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":58240,"kb_avail":1132400224,"statfs":{"total":1159641169920,"available":1159577829376,"internally_reserved":0,"allocated":3604480,"data_stored":1636068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59637760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001979"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.896020+0000","last_change":"2020-11-20T12:14:38.894779+0000","last_active":"2020-11-20T12:14:38.896020+0000","last_peered":"2020-11-20T12:14:38.896020+0000","last_clean":"2020-11-20T12:14:38.896020+0000","last_became_active":"2020-11-20T12:14:38.894181+0000","last_became_peered":"2020-11-20T12:14:38.894181+0000","last_unstale":"2020-11-20T12:14:38.896020+0000","last_undegraded":"2020-11-20T12:14:38.896020+0000","last_fullsized":"2020-11-20T12:14:38.896020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.891388+0000","last_change":"2020-11-20T12:14:30.629679+0000","last_active":"2020-11-20T12:14:38.891388+0000","last_peered":"2020-11-20T12:14:38.891388+0000","last_clean":"2020-11-20T12:14:38.891388+0000","last_became_active":"2020-11-20T12:14:30.629388+0000","last_became_peered":"2020-11-20T12:14:30.629388+0000","last_unstale":"2020-11-20T12:14:38.891388+0000","last_undegraded":"2020-11-20T12:14:38.891388+0000","last_fullsized":"2020-11-20T12:14:38.891388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.063703+0000","last_change":"2020-11-20T12:14:35.694638+0000","last_active":"2020-11-20T12:14:39.063703+0000","last_peered":"2020-11-20T12:14:39.063703+0000","last_clean":"2020-11-20T12:14:39.063703+0000","last_became_active":"2020-11-20T12:14:35.694342+0000","last_became_peered":"2020-11-20T12:14:35.694342+0000","last_unstale":"2020-11-20T12:14:39.063703+0000","last_undegraded":"2020-11-20T12:14:39.063703+0000","last_fullsized":"2020-11-20T12:14:39.063703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893804+0000","last_change":"2020-11-20T12:14:38.892364+0000","last_active":"2020-11-20T12:14:38.893804+0000","last_peered":"2020-11-20T12:14:38.893804+0000","last_clean":"2020-11-20T12:14:38.893804+0000","last_became_active":"2020-11-20T12:14:38.891798+0000","last_became_peered":"2020-11-20T12:14:38.891798+0000","last_unstale":"2020-11-20T12:14:38.893804+0000","last_undegraded":"2020-11-20T12:14:38.893804+0000","last_fullsized":"2020-11-20T12:14:38.893804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.704036+0000","last_change":"2020-11-20T12:14:30.576822+0000","last_active":"2020-11-20T12:14:38.704036+0000","last_peered":"2020-11-20T12:14:38.704036+0000","last_clean":"2020-11-20T12:14:38.704036+0000","last_became_active":"2020-11-20T12:14:30.576478+0000","last_became_peered":"2020-11-20T12:14:30.576478+0000","last_unstale":"2020-11-20T12:14:38.704036+0000","last_undegraded":"2020-11-20T12:14:38.704036+0000","last_fullsized":"2020-11-20T12:14:38.704036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.058439+0000","last_change":"2020-11-20T12:14:35.997098+0000","last_active":"2020-11-20T12:14:39.058439+0000","last_peered":"2020-11-20T12:14:39.058439+0000","last_clean":"2020-11-20T12:14:39.058439+0000","last_became_active":"2020-11-20T12:14:35.996484+0000","last_became_peered":"2020-11-20T12:14:35.996484+0000","last_unstale":"2020-11-20T12:14:39.058439+0000","last_undegraded":"2020-11-20T12:14:39.058439+0000","last_fullsized":"2020-11-20T12:14:39.058439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893952+0000","last_change":"2020-11-20T12:14:38.893210+0000","last_active":"2020-11-20T12:14:38.893952+0000","last_peered":"2020-11-20T12:14:38.893952+0000","last_clean":"2020-11-20T12:14:38.893952+0000","last_became_active":"2020-11-20T12:14:38.892057+0000","last_became_peered":"2020-11-20T12:14:38.892057+0000","last_unstale":"2020-11-20T12:14:38.893952+0000","last_undegraded":"2020-11-20T12:14:38.893952+0000","last_fullsized":"2020-11-20T12:14:38.893952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.707840+0000","last_change":"2020-11-20T12:14:30.674846+0000","last_active":"2020-11-20T12:14:38.707840+0000","last_peered":"2020-11-20T12:14:38.707840+0000","last_clean":"2020-11-20T12:14:38.707840+0000","last_became_active":"2020-11-20T12:14:30.674379+0000","last_became_peered":"2020-11-20T12:14:30.674379+0000","last_unstale":"2020-11-20T12:14:38.707840+0000","last_undegraded":"2020-11-20T12:14:38.707840+0000","last_fullsized":"2020-11-20T12:14:38.707840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.059002+0000","last_change":"2020-11-20T12:14:35.995640+0000","last_active":"2020-11-20T12:14:39.059002+0000","last_peered":"2020-11-20T12:14:39.059002+0000","last_clean":"2020-11-20T12:14:39.059002+0000","last_became_active":"2020-11-20T12:14:35.995219+0000","last_became_peered":"2020-11-20T12:14:35.995219+0000","last_unstale":"2020-11-20T12:14:39.059002+0000","last_undegraded":"2020-11-20T12:14:39.059002+0000","last_fullsized":"2020-11-20T12:14:39.059002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.896228+0000","last_change":"2020-11-20T12:14:38.894187+0000","last_active":"2020-11-20T12:14:38.896228+0000","last_peered":"2020-11-20T12:14:38.896228+0000","last_clean":"2020-11-20T12:14:38.896228+0000","last_became_active":"2020-11-20T12:14:38.893520+0000","last_became_peered":"2020-11-20T12:14:38.893520+0000","last_unstale":"2020-11-20T12:14:38.896228+0000","last_undegraded":"2020-11-20T12:14:38.896228+0000","last_fullsized":"2020-11-20T12:14:38.896228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.890579+0000","last_change":"2020-11-20T12:14:30.694362+0000","last_active":"2020-11-20T12:14:38.890579+0000","last_peered":"2020-11-20T12:14:38.890579+0000","last_clean":"2020-11-20T12:14:38.890579+0000","last_became_active":"2020-11-20T12:14:30.693824+0000","last_became_peered":"2020-11-20T12:14:30.693824+0000","last_unstale":"2020-11-20T12:14:38.890579+0000","last_undegraded":"2020-11-20T12:14:38.890579+0000","last_fullsized":"2020-11-20T12:14:38.890579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"20","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.704040+0000","last_change":"2020-11-20T12:14:25.647039+0000","last_active":"2020-11-20T12:14:38.704040+0000","last_peered":"2020-11-20T12:14:38.704040+0000","last_clean":"2020-11-20T12:14:38.704040+0000","last_became_active":"2020-11-20T12:14:25.646288+0000","last_became_peered":"2020-11-20T12:14:25.646288+0000","last_unstale":"2020-11-20T12:14:38.704040+0000","last_undegraded":"2020-11-20T12:14:38.704040+0000","last_fullsized":"2020-11-20T12:14:38.704040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:19.416544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:19.416544+0000","last_clean_scrub_stamp":"2020-11-20T12:14:19.416544+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.052568+0000","last_change":"2020-11-20T12:14:35.694461+0000","last_active":"2020-11-20T12:14:39.052568+0000","last_peered":"2020-11-20T12:14:39.052568+0000","last_clean":"2020-11-20T12:14:39.052568+0000","last_became_active":"2020-11-20T12:14:35.694086+0000","last_became_peered":"2020-11-20T12:14:35.694086+0000","last_unstale":"2020-11-20T12:14:39.052568+0000","last_undegraded":"2020-11-20T12:14:39.052568+0000","last_fullsized":"2020-11-20T12:14:39.052568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.895971+0000","last_change":"2020-11-20T12:14:38.894200+0000","last_active":"2020-11-20T12:14:38.895971+0000","last_peered":"2020-11-20T12:14:38.895971+0000","last_clean":"2020-11-20T12:14:38.895971+0000","last_became_active":"2020-11-20T12:14:38.893439+0000","last_became_peered":"2020-11-20T12:14:38.893439+0000","last_unstale":"2020-11-20T12:14:38.895971+0000","last_undegraded":"2020-11-20T12:14:38.895971+0000","last_fullsized":"2020-11-20T12:14:38.895971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.704027+0000","last_change":"2020-11-20T12:14:30.575869+0000","last_active":"2020-11-20T12:14:38.704027+0000","last_peered":"2020-11-20T12:14:38.704027+0000","last_clean":"2020-11-20T12:14:38.704027+0000","last_became_active":"2020-11-20T12:14:30.575277+0000","last_became_peered":"2020-11-20T12:14:30.575277+0000","last_unstale":"2020-11-20T12:14:38.704027+0000","last_undegraded":"2020-11-20T12:14:38.704027+0000","last_fullsized":"2020-11-20T12:14:38.704027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.707633+0000","last_change":"2020-11-20T12:14:35.996762+0000","last_active":"2020-11-20T12:14:38.707633+0000","last_peered":"2020-11-20T12:14:38.707633+0000","last_clean":"2020-11-20T12:14:38.707633+0000","last_became_active":"2020-11-20T12:14:35.996476+0000","last_became_peered":"2020-11-20T12:14:35.996476+0000","last_unstale":"2020-11-20T12:14:38.707633+0000","last_undegraded":"2020-11-20T12:14:38.707633+0000","last_fullsized":"2020-11-20T12:14:38.707633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.711406+0000","last_change":"2020-11-20T12:14:38.710815+0000","last_active":"2020-11-20T12:14:38.711406+0000","last_peered":"2020-11-20T12:14:38.711406+0000","last_clean":"2020-11-20T12:14:38.711406+0000","last_became_active":"2020-11-20T12:14:38.709957+0000","last_became_peered":"2020-11-20T12:14:38.709957+0000","last_unstale":"2020-11-20T12:14:38.711406+0000","last_undegraded":"2020-11-20T12:14:38.711406+0000","last_fullsized":"2020-11-20T12:14:38.711406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.703590+0000","last_change":"2020-11-20T12:14:30.612290+0000","last_active":"2020-11-20T12:14:38.703590+0000","last_peered":"2020-11-20T12:14:38.703590+0000","last_clean":"2020-11-20T12:14:38.703590+0000","last_became_active":"2020-11-20T12:14:30.611933+0000","last_became_peered":"2020-11-20T12:14:30.611933+0000","last_unstale":"2020-11-20T12:14:38.703590+0000","last_undegraded":"2020-11-20T12:14:38.703590+0000","last_fullsized":"2020-11-20T12:14:38.703590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.063382+0000","last_change":"2020-11-20T12:14:35.995557+0000","last_active":"2020-11-20T12:14:39.063382+0000","last_peered":"2020-11-20T12:14:39.063382+0000","last_clean":"2020-11-20T12:14:39.063382+0000","last_became_active":"2020-11-20T12:14:35.995271+0000","last_became_peered":"2020-11-20T12:14:35.995271+0000","last_unstale":"2020-11-20T12:14:39.063382+0000","last_undegraded":"2020-11-20T12:14:39.063382+0000","last_fullsized":"2020-11-20T12:14:39.063382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893808+0000","last_change":"2020-11-20T12:14:38.892146+0000","last_active":"2020-11-20T12:14:38.893808+0000","last_peered":"2020-11-20T12:14:38.893808+0000","last_clean":"2020-11-20T12:14:38.893808+0000","last_became_active":"2020-11-20T12:14:38.891723+0000","last_became_peered":"2020-11-20T12:14:38.891723+0000","last_unstale":"2020-11-20T12:14:38.893808+0000","last_undegraded":"2020-11-20T12:14:38.893808+0000","last_fullsized":"2020-11-20T12:14:38.893808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.062908+0000","last_change":"2020-11-20T12:14:35.692667+0000","last_active":"2020-11-20T12:14:39.062908+0000","last_peered":"2020-11-20T12:14:39.062908+0000","last_clean":"2020-11-20T12:14:39.062908+0000","last_became_active":"2020-11-20T12:14:35.692314+0000","last_became_peered":"2020-11-20T12:14:35.692314+0000","last_unstale":"2020-11-20T12:14:39.062908+0000","last_undegraded":"2020-11-20T12:14:39.062908+0000","last_fullsized":"2020-11-20T12:14:39.062908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.891459+0000","last_change":"2020-11-20T12:14:30.578166+0000","last_active":"2020-11-20T12:14:38.891459+0000","last_peered":"2020-11-20T12:14:38.891459+0000","last_clean":"2020-11-20T12:14:38.891459+0000","last_became_active":"2020-11-20T12:14:30.577777+0000","last_became_peered":"2020-11-20T12:14:30.577777+0000","last_unstale":"2020-11-20T12:14:38.891459+0000","last_undegraded":"2020-11-20T12:14:38.891459+0000","last_fullsized":"2020-11-20T12:14:38.891459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893810+0000","last_change":"2020-11-20T12:14:38.892869+0000","last_active":"2020-11-20T12:14:38.893810+0000","last_peered":"2020-11-20T12:14:38.893810+0000","last_clean":"2020-11-20T12:14:38.893810+0000","last_became_active":"2020-11-20T12:14:38.892297+0000","last_became_peered":"2020-11-20T12:14:38.892297+0000","last_unstale":"2020-11-20T12:14:38.893810+0000","last_undegraded":"2020-11-20T12:14:38.893810+0000","last_fullsized":"2020-11-20T12:14:38.893810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.890579+0000","last_change":"2020-11-20T12:14:30.575709+0000","last_active":"2020-11-20T12:14:38.890579+0000","last_peered":"2020-11-20T12:14:38.890579+0000","last_clean":"2020-11-20T12:14:38.890579+0000","last_became_active":"2020-11-20T12:14:30.575221+0000","last_became_peered":"2020-11-20T12:14:30.575221+0000","last_unstale":"2020-11-20T12:14:38.890579+0000","last_undegraded":"2020-11-20T12:14:38.890579+0000","last_fullsized":"2020-11-20T12:14:38.890579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.062990+0000","last_change":"2020-11-20T12:14:35.695657+0000","last_active":"2020-11-20T12:14:39.062990+0000","last_peered":"2020-11-20T12:14:39.062990+0000","last_clean":"2020-11-20T12:14:39.062990+0000","last_became_active":"2020-11-20T12:14:35.695276+0000","last_became_peered":"2020-11-20T12:14:35.695276+0000","last_unstale":"2020-11-20T12:14:39.062990+0000","last_undegraded":"2020-11-20T12:14:39.062990+0000","last_fullsized":"2020-11-20T12:14:39.062990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]}]},{"osd":10,"up_from":17,"seq":73014444040,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":136149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]}]},{"osd":9,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":8,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.742}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]}]},{"osd":0,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.875}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]}]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.766}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8520000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7849999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]}]},{"osd":3,"up_from":17,"seq":73014444038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5176,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366664,"statfs":{"total":96636764160,"available":96631463936,"internally_reserved":0,"allocated":311296,"data_stored":136690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":135989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9299999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1360000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.77}]}]}]}} 2020-11-20T12:14:49.552 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2020-11-20T12:14:49.660 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.657+0000 7f13e76e1700 1 Processor -- start 2020-11-20T12:14:49.661 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.657+0000 7f13e76e1700 1 -- start start 2020-11-20T12:14:49.663 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.658+0000 7f13e76e1700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13e00676b0 0x7f13e0151370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.663 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.658+0000 7f13e76e1700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e00bdf60 con 0x7f13e0150f90 2020-11-20T12:14:49.663 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.658+0000 7f13e76e1700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13e0067bf0 con 0x7f13e0151860 2020-11-20T12:14:49.664 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.658+0000 7f13e76e1700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13e0067e90 con 0x7f13e00676b0 2020-11-20T12:14:49.664 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13e4c7c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13e00676b0 0x7f13e0151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.664 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13e547d700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7f13e0150f90 0x7f13e0062850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39748/0 (socket says 172.21.15.93:39748) 2020-11-20T12:14:49.664 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13e547d700 1 -- 172.21.15.93:0/1195498801 learned_addr learned my addr 172.21.15.93:0/1195498801 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:49.664 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13cffff700 1 -- 172.21.15.93:0/1195498801 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539755486 0 0) 0x7f13e0067bf0 con 0x7f13e0151860 2020-11-20T12:14:49.665 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13cffff700 1 -- 172.21.15.93:0/1195498801 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13c8003280 con 0x7f13e0151860 2020-11-20T12:14:49.665 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13cffff700 1 -- 172.21.15.93:0/1195498801 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162919890 0 0) 0x7f13e00bdf60 con 0x7f13e0150f90 2020-11-20T12:14:49.665 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13cffff700 1 -- 172.21.15.93:0/1195498801 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f13e0067bf0 con 0x7f13e0150f90 2020-11-20T12:14:49.665 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13e4c7c700 1 -- 172.21.15.93:0/1195498801 >> v1:172.21.15.132:6789/0 conn(0x7f13e0151860 legacy=0x7f13e014dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.665 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13e4c7c700 1 -- 172.21.15.93:0/1195498801 >> v1:172.21.15.66:6789/0 conn(0x7f13e0150f90 legacy=0x7f13e0062850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.666 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13e4c7c700 1 -- 172.21.15.93:0/1195498801 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e0068130 con 0x7f13e00676b0 2020-11-20T12:14:49.666 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13e4c7c700 1 --2- 172.21.15.93:0/1195498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e00676b0 0x7f13e0151370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f13d0006fd0 tx=0x7f13d0006e30).ready entity=mon.2 client_cookie=1379a8f4e2a08b73 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.666 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13cffff700 1 -- 172.21.15.93:0/1195498801 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d0009630 con 0x7f13e00676b0 2020-11-20T12:14:49.666 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13cffff700 1 -- 172.21.15.93:0/1195498801 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d0000e90 con 0x7f13e00676b0 2020-11-20T12:14:49.666 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.659+0000 7f13cffff700 1 -- 172.21.15.93:0/1195498801 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d00099a0 con 0x7f13e00676b0 2020-11-20T12:14:49.667 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.660+0000 7f13e76e1700 1 -- 172.21.15.93:0/1195498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e00676b0 msgr2=0x7f13e0151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.667 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.660+0000 7f13e76e1700 1 --2- 172.21.15.93:0/1195498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e00676b0 0x7f13e0151370 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f13d0006fd0 tx=0x7f13d0006e30).stop 2020-11-20T12:14:49.667 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.660+0000 7f13e76e1700 1 -- 172.21.15.93:0/1195498801 shutdown_connections 2020-11-20T12:14:49.667 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.660+0000 7f13e76e1700 1 --2- 172.21.15.93:0/1195498801 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e00676b0 0x7f13e0151370 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.667 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.660+0000 7f13e76e1700 1 -- 172.21.15.93:0/1195498801 >> 172.21.15.93:0/1195498801 conn(0x7f13e0060bc0 msgr2=0x7f13e00c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:49.668 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.660+0000 7f13e76e1700 1 -- 172.21.15.93:0/1195498801 shutdown_connections 2020-11-20T12:14:49.668 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.660+0000 7f13e76e1700 1 -- 172.21.15.93:0/1195498801 wait complete. 2020-11-20T12:14:49.670 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.661+0000 7f13e76e1700 1 Processor -- start 2020-11-20T12:14:49.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.661+0000 7f13e76e1700 1 -- start start 2020-11-20T12:14:49.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e76e1700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e00676b0 0x7f13e0160330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e76e1700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e0150f90 0x7f13e0148740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e76e1700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0151860 0x7f13e0091810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e76e1700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e0160820 con 0x7f13e00676b0 2020-11-20T12:14:49.672 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e76e1700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00badf0 con 0x7f13e0151860 2020-11-20T12:14:49.672 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e76e1700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13e00bb090 con 0x7f13e0150f90 2020-11-20T12:14:49.672 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0151860 0x7f13e0091810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.672 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0151860 0x7f13e0091810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39526/0 (socket says 172.21.15.93:39526) 2020-11-20T12:14:49.672 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 -- 172.21.15.93:0/3010175875 learned_addr learned my addr 172.21.15.93:0/3010175875 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:49.673 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e547d700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e00676b0 0x7f13e0160330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.673 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e4c7c700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e0150f90 0x7f13e0148740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.673 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 -- 172.21.15.93:0/3010175875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e0150f90 msgr2=0x7f13e0148740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.673 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e0150f90 0x7f13e0148740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 -- 172.21.15.93:0/3010175875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e00676b0 msgr2=0x7f13e0160330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e00676b0 0x7f13e0160330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 -- 172.21.15.93:0/3010175875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13e00bb330 con 0x7f13e0151860 2020-11-20T12:14:49.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e4c7c700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e0150f90 0x7f13e0148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:49.674 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.662+0000 7f13e5c7e700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0151860 0x7f13e0091810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f13d800ca90 tx=0x7f13d8007df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.663+0000 7f13cd7fa700 1 -- 172.21.15.93:0/3010175875 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8002240 con 0x7f13e0151860 2020-11-20T12:14:49.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.663+0000 7f13cd7fa700 1 -- 172.21.15.93:0/3010175875 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13d80023a0 con 0x7f13e0151860 2020-11-20T12:14:49.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.663+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13e00bb5d0 con 0x7f13e0151860 2020-11-20T12:14:49.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.663+0000 7f13cd7fa700 1 -- 172.21.15.93:0/3010175875 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13d8001690 con 0x7f13e0151860 2020-11-20T12:14:49.675 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.663+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13e00bbb10 con 0x7f13e0151860 2020-11-20T12:14:49.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.664+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13e005cd50 con 0x7f13e0151860 2020-11-20T12:14:49.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.664+0000 7f13cd7fa700 1 -- 172.21.15.93:0/3010175875 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f13d8019030 con 0x7f13e0151860 2020-11-20T12:14:49.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.665+0000 7f13cd7fa700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f13b8080670 0x7f13b8082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.665+0000 7f13cd7fa700 1 -- 172.21.15.93:0/3010175875 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f13d80a21b0 con 0x7f13e0151860 2020-11-20T12:14:49.676 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.665+0000 7f13e547d700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f13b8080670 0x7f13b8082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.677 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.665+0000 7f13e547d700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f13b8080670 0x7f13b8082b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f13dc0055e0 tx=0x7f13dc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.677 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.668+0000 7f13cd7fa700 1 -- 172.21.15.93:0/3010175875 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f13d8076bc0 con 0x7f13e0151860 2020-11-20T12:14:49.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.804+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 --> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f13e009c060 con 0x7f13b8080670 2020-11-20T12:14:49.812 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.808+0000 7f13cd7fa700 1 -- 172.21.15.93:0/3010175875 <== mgr.4105 v2:172.21.15.93:6800/22895 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+99805 (secure 0 0 0) 0x7f13e009c060 con 0x7f13b8080670 2020-11-20T12:14:49.812 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:49.814 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f13b8080670 msgr2=0x7f13b8082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.814 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f13b8080670 0x7f13b8082b30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f13dc0055e0 tx=0x7f13dc009040).stop 2020-11-20T12:14:49.814 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0151860 msgr2=0x7f13e0091810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.814 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0151860 0x7f13e0091810 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f13d800ca90 tx=0x7f13d8007df0).stop 2020-11-20T12:14:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 shutdown_connections 2020-11-20T12:14:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f13e0151860 0x7f13e0091810 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f13b8080670 0x7f13b8082b30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f13e00676b0 0x7f13e0160330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.815 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 --2- 172.21.15.93:0/3010175875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13e0150f90 0x7f13e0148740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 >> 172.21.15.93:0/3010175875 conn(0x7f13e0060bc0 msgr2=0x7f13e0061af0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 shutdown_connections 2020-11-20T12:14:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.810+0000 7f13e76e1700 1 -- 172.21.15.93:0/3010175875 wait complete. 2020-11-20T12:14:49.816 INFO:teuthology.orchestra.run.smithi093.stderr:dumped all 2020-11-20T12:14:49.824 INFO:teuthology.orchestra.run.smithi093.stdout:{"pg_ready":true,"pg_map":{"version":31,"stamp":"2020-11-20T12:14:49.015326+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2304,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":46,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":41,"ondisk_log_size":41,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":66,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1132462080,"kb_used":61856,"kb_used_data":3520,"kb_used_omap":0,"kb_used_meta":58240,"kb_avail":1132400224,"statfs":{"total":1159641169920,"available":1159577829376,"internally_reserved":0,"allocated":3604480,"data_stored":1636068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":59637760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001979"},"pg_stats":[{"pgid":"4.2","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.896020+0000","last_change":"2020-11-20T12:14:38.894779+0000","last_active":"2020-11-20T12:14:38.896020+0000","last_peered":"2020-11-20T12:14:38.896020+0000","last_clean":"2020-11-20T12:14:38.896020+0000","last_became_active":"2020-11-20T12:14:38.894181+0000","last_became_peered":"2020-11-20T12:14:38.894181+0000","last_unstale":"2020-11-20T12:14:38.896020+0000","last_undegraded":"2020-11-20T12:14:38.896020+0000","last_fullsized":"2020-11-20T12:14:38.896020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.891388+0000","last_change":"2020-11-20T12:14:30.629679+0000","last_active":"2020-11-20T12:14:38.891388+0000","last_peered":"2020-11-20T12:14:38.891388+0000","last_clean":"2020-11-20T12:14:38.891388+0000","last_became_active":"2020-11-20T12:14:30.629388+0000","last_became_peered":"2020-11-20T12:14:30.629388+0000","last_unstale":"2020-11-20T12:14:38.891388+0000","last_undegraded":"2020-11-20T12:14:38.891388+0000","last_fullsized":"2020-11-20T12:14:38.891388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2],"acting":[9,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"28'6","reported_seq":"17","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.063703+0000","last_change":"2020-11-20T12:14:35.694638+0000","last_active":"2020-11-20T12:14:39.063703+0000","last_peered":"2020-11-20T12:14:39.063703+0000","last_clean":"2020-11-20T12:14:39.063703+0000","last_became_active":"2020-11-20T12:14:35.694342+0000","last_became_peered":"2020-11-20T12:14:35.694342+0000","last_unstale":"2020-11-20T12:14:39.063703+0000","last_undegraded":"2020-11-20T12:14:39.063703+0000","last_fullsized":"2020-11-20T12:14:39.063703+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3],"acting":[10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893804+0000","last_change":"2020-11-20T12:14:38.892364+0000","last_active":"2020-11-20T12:14:38.893804+0000","last_peered":"2020-11-20T12:14:38.893804+0000","last_clean":"2020-11-20T12:14:38.893804+0000","last_became_active":"2020-11-20T12:14:38.891798+0000","last_became_peered":"2020-11-20T12:14:38.891798+0000","last_unstale":"2020-11-20T12:14:38.893804+0000","last_undegraded":"2020-11-20T12:14:38.893804+0000","last_fullsized":"2020-11-20T12:14:38.893804+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.704036+0000","last_change":"2020-11-20T12:14:30.576822+0000","last_active":"2020-11-20T12:14:38.704036+0000","last_peered":"2020-11-20T12:14:38.704036+0000","last_clean":"2020-11-20T12:14:38.704036+0000","last_became_active":"2020-11-20T12:14:30.576478+0000","last_became_peered":"2020-11-20T12:14:30.576478+0000","last_unstale":"2020-11-20T12:14:38.704036+0000","last_undegraded":"2020-11-20T12:14:38.704036+0000","last_fullsized":"2020-11-20T12:14:38.704036+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"28'5","reported_seq":"16","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.058439+0000","last_change":"2020-11-20T12:14:35.997098+0000","last_active":"2020-11-20T12:14:39.058439+0000","last_peered":"2020-11-20T12:14:39.058439+0000","last_clean":"2020-11-20T12:14:39.058439+0000","last_became_active":"2020-11-20T12:14:35.996484+0000","last_became_peered":"2020-11-20T12:14:35.996484+0000","last_unstale":"2020-11-20T12:14:39.058439+0000","last_undegraded":"2020-11-20T12:14:39.058439+0000","last_fullsized":"2020-11-20T12:14:39.058439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4],"acting":[10,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893952+0000","last_change":"2020-11-20T12:14:38.893210+0000","last_active":"2020-11-20T12:14:38.893952+0000","last_peered":"2020-11-20T12:14:38.893952+0000","last_clean":"2020-11-20T12:14:38.893952+0000","last_became_active":"2020-11-20T12:14:38.892057+0000","last_became_peered":"2020-11-20T12:14:38.892057+0000","last_unstale":"2020-11-20T12:14:38.893952+0000","last_undegraded":"2020-11-20T12:14:38.893952+0000","last_fullsized":"2020-11-20T12:14:38.893952+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.707840+0000","last_change":"2020-11-20T12:14:30.674846+0000","last_active":"2020-11-20T12:14:38.707840+0000","last_peered":"2020-11-20T12:14:38.707840+0000","last_clean":"2020-11-20T12:14:38.707840+0000","last_became_active":"2020-11-20T12:14:30.674379+0000","last_became_peered":"2020-11-20T12:14:30.674379+0000","last_unstale":"2020-11-20T12:14:38.707840+0000","last_undegraded":"2020-11-20T12:14:38.707840+0000","last_fullsized":"2020-11-20T12:14:38.707840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"28'8","reported_seq":"20","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.059002+0000","last_change":"2020-11-20T12:14:35.995640+0000","last_active":"2020-11-20T12:14:39.059002+0000","last_peered":"2020-11-20T12:14:39.059002+0000","last_clean":"2020-11-20T12:14:39.059002+0000","last_became_active":"2020-11-20T12:14:35.995219+0000","last_became_peered":"2020-11-20T12:14:35.995219+0000","last_unstale":"2020-11-20T12:14:39.059002+0000","last_undegraded":"2020-11-20T12:14:39.059002+0000","last_fullsized":"2020-11-20T12:14:39.059002+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.896228+0000","last_change":"2020-11-20T12:14:38.894187+0000","last_active":"2020-11-20T12:14:38.896228+0000","last_peered":"2020-11-20T12:14:38.896228+0000","last_clean":"2020-11-20T12:14:38.896228+0000","last_became_active":"2020-11-20T12:14:38.893520+0000","last_became_peered":"2020-11-20T12:14:38.893520+0000","last_unstale":"2020-11-20T12:14:38.896228+0000","last_undegraded":"2020-11-20T12:14:38.896228+0000","last_fullsized":"2020-11-20T12:14:38.896228+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.890579+0000","last_change":"2020-11-20T12:14:30.694362+0000","last_active":"2020-11-20T12:14:38.890579+0000","last_peered":"2020-11-20T12:14:38.890579+0000","last_clean":"2020-11-20T12:14:38.890579+0000","last_became_active":"2020-11-20T12:14:30.693824+0000","last_became_peered":"2020-11-20T12:14:30.693824+0000","last_unstale":"2020-11-20T12:14:38.890579+0000","last_undegraded":"2020-11-20T12:14:38.890579+0000","last_fullsized":"2020-11-20T12:14:38.890579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10],"acting":[4,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"18'3","reported_seq":"20","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.704040+0000","last_change":"2020-11-20T12:14:25.647039+0000","last_active":"2020-11-20T12:14:38.704040+0000","last_peered":"2020-11-20T12:14:38.704040+0000","last_clean":"2020-11-20T12:14:38.704040+0000","last_became_active":"2020-11-20T12:14:25.646288+0000","last_became_peered":"2020-11-20T12:14:25.646288+0000","last_unstale":"2020-11-20T12:14:38.704040+0000","last_undegraded":"2020-11-20T12:14:38.704040+0000","last_fullsized":"2020-11-20T12:14:38.704040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:19.416544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:19.416544+0000","last_clean_scrub_stamp":"2020-11-20T12:14:19.416544+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"28'1","reported_seq":"13","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.052568+0000","last_change":"2020-11-20T12:14:35.694461+0000","last_active":"2020-11-20T12:14:39.052568+0000","last_peered":"2020-11-20T12:14:39.052568+0000","last_clean":"2020-11-20T12:14:39.052568+0000","last_became_active":"2020-11-20T12:14:35.694086+0000","last_became_peered":"2020-11-20T12:14:35.694086+0000","last_unstale":"2020-11-20T12:14:39.052568+0000","last_undegraded":"2020-11-20T12:14:39.052568+0000","last_fullsized":"2020-11-20T12:14:39.052568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.895971+0000","last_change":"2020-11-20T12:14:38.894200+0000","last_active":"2020-11-20T12:14:38.895971+0000","last_peered":"2020-11-20T12:14:38.895971+0000","last_clean":"2020-11-20T12:14:38.895971+0000","last_became_active":"2020-11-20T12:14:38.893439+0000","last_became_peered":"2020-11-20T12:14:38.893439+0000","last_unstale":"2020-11-20T12:14:38.895971+0000","last_undegraded":"2020-11-20T12:14:38.895971+0000","last_fullsized":"2020-11-20T12:14:38.895971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.704027+0000","last_change":"2020-11-20T12:14:30.575869+0000","last_active":"2020-11-20T12:14:38.704027+0000","last_peered":"2020-11-20T12:14:38.704027+0000","last_clean":"2020-11-20T12:14:38.704027+0000","last_became_active":"2020-11-20T12:14:30.575277+0000","last_became_peered":"2020-11-20T12:14:30.575277+0000","last_unstale":"2020-11-20T12:14:38.704027+0000","last_undegraded":"2020-11-20T12:14:38.704027+0000","last_fullsized":"2020-11-20T12:14:38.704027+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.707633+0000","last_change":"2020-11-20T12:14:35.996762+0000","last_active":"2020-11-20T12:14:38.707633+0000","last_peered":"2020-11-20T12:14:38.707633+0000","last_clean":"2020-11-20T12:14:38.707633+0000","last_became_active":"2020-11-20T12:14:35.996476+0000","last_became_peered":"2020-11-20T12:14:35.996476+0000","last_unstale":"2020-11-20T12:14:38.707633+0000","last_undegraded":"2020-11-20T12:14:38.707633+0000","last_fullsized":"2020-11-20T12:14:38.707633+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.711406+0000","last_change":"2020-11-20T12:14:38.710815+0000","last_active":"2020-11-20T12:14:38.711406+0000","last_peered":"2020-11-20T12:14:38.711406+0000","last_clean":"2020-11-20T12:14:38.711406+0000","last_became_active":"2020-11-20T12:14:38.709957+0000","last_became_peered":"2020-11-20T12:14:38.709957+0000","last_unstale":"2020-11-20T12:14:38.711406+0000","last_undegraded":"2020-11-20T12:14:38.711406+0000","last_fullsized":"2020-11-20T12:14:38.711406+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.703590+0000","last_change":"2020-11-20T12:14:30.612290+0000","last_active":"2020-11-20T12:14:38.703590+0000","last_peered":"2020-11-20T12:14:38.703590+0000","last_clean":"2020-11-20T12:14:38.703590+0000","last_became_active":"2020-11-20T12:14:30.611933+0000","last_became_peered":"2020-11-20T12:14:30.611933+0000","last_unstale":"2020-11-20T12:14:38.703590+0000","last_undegraded":"2020-11-20T12:14:38.703590+0000","last_fullsized":"2020-11-20T12:14:38.703590+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0],"acting":[8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.4","version":"28'8","reported_seq":"19","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.063382+0000","last_change":"2020-11-20T12:14:35.995557+0000","last_active":"2020-11-20T12:14:39.063382+0000","last_peered":"2020-11-20T12:14:39.063382+0000","last_clean":"2020-11-20T12:14:39.063382+0000","last_became_active":"2020-11-20T12:14:35.995271+0000","last_became_peered":"2020-11-20T12:14:35.995271+0000","last_unstale":"2020-11-20T12:14:39.063382+0000","last_undegraded":"2020-11-20T12:14:39.063382+0000","last_fullsized":"2020-11-20T12:14:39.063382+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893808+0000","last_change":"2020-11-20T12:14:38.892146+0000","last_active":"2020-11-20T12:14:38.893808+0000","last_peered":"2020-11-20T12:14:38.893808+0000","last_clean":"2020-11-20T12:14:38.893808+0000","last_became_active":"2020-11-20T12:14:38.891723+0000","last_became_peered":"2020-11-20T12:14:38.891723+0000","last_unstale":"2020-11-20T12:14:38.893808+0000","last_undegraded":"2020-11-20T12:14:38.893808+0000","last_fullsized":"2020-11-20T12:14:38.893808+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"28'6","reported_seq":"18","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.062908+0000","last_change":"2020-11-20T12:14:35.692667+0000","last_active":"2020-11-20T12:14:39.062908+0000","last_peered":"2020-11-20T12:14:39.062908+0000","last_clean":"2020-11-20T12:14:39.062908+0000","last_became_active":"2020-11-20T12:14:35.692314+0000","last_became_peered":"2020-11-20T12:14:35.692314+0000","last_unstale":"2020-11-20T12:14:39.062908+0000","last_undegraded":"2020-11-20T12:14:39.062908+0000","last_fullsized":"2020-11-20T12:14:39.062908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":575,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11],"acting":[3,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.891459+0000","last_change":"2020-11-20T12:14:30.578166+0000","last_active":"2020-11-20T12:14:38.891459+0000","last_peered":"2020-11-20T12:14:38.891459+0000","last_clean":"2020-11-20T12:14:38.891459+0000","last_became_active":"2020-11-20T12:14:30.577777+0000","last_became_peered":"2020-11-20T12:14:30.577777+0000","last_unstale":"2020-11-20T12:14:38.891459+0000","last_undegraded":"2020-11-20T12:14:38.891459+0000","last_fullsized":"2020-11-20T12:14:38.891459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8],"acting":[9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":"11","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.893810+0000","last_change":"2020-11-20T12:14:38.892869+0000","last_active":"2020-11-20T12:14:38.893810+0000","last_peered":"2020-11-20T12:14:38.893810+0000","last_clean":"2020-11-20T12:14:38.893810+0000","last_became_active":"2020-11-20T12:14:38.892297+0000","last_became_peered":"2020-11-20T12:14:38.892297+0000","last_unstale":"2020-11-20T12:14:38.893810+0000","last_undegraded":"2020-11-20T12:14:38.893810+0000","last_fullsized":"2020-11-20T12:14:38.893810+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:37.691520+0000","last_clean_scrub_stamp":"2020-11-20T12:14:37.691520+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"14","reported_epoch":"27","state":"active+clean","last_fresh":"2020-11-20T12:14:38.890579+0000","last_change":"2020-11-20T12:14:30.575709+0000","last_active":"2020-11-20T12:14:38.890579+0000","last_peered":"2020-11-20T12:14:38.890579+0000","last_clean":"2020-11-20T12:14:38.890579+0000","last_became_active":"2020-11-20T12:14:30.575221+0000","last_became_peered":"2020-11-20T12:14:30.575221+0000","last_unstale":"2020-11-20T12:14:38.890579+0000","last_undegraded":"2020-11-20T12:14:38.890579+0000","last_fullsized":"2020-11-20T12:14:38.890579+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:29.561401+0000","last_clean_scrub_stamp":"2020-11-20T12:14:29.561401+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11],"acting":[4,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"28'4","reported_seq":"15","reported_epoch":"28","state":"active+clean","last_fresh":"2020-11-20T12:14:39.062990+0000","last_change":"2020-11-20T12:14:35.695657+0000","last_active":"2020-11-20T12:14:39.062990+0000","last_peered":"2020-11-20T12:14:39.062990+0000","last_clean":"2020-11-20T12:14:39.062990+0000","last_became_active":"2020-11-20T12:14:35.695276+0000","last_became_peered":"2020-11-20T12:14:35.695276+0000","last_unstale":"2020-11-20T12:14:39.062990+0000","last_undegraded":"2020-11-20T12:14:39.062990+0000","last_fullsized":"2020-11-20T12:14:39.062990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-20T12:14:34.674436+0000","last_clean_scrub_stamp":"2020-11-20T12:14:34.674436+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":12},{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":2304,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":43,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":11}],"osd_stats":[{"osd":11,"up_from":17,"seq":73014444038,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5168,"kb_used_data":296,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366672,"statfs":{"total":96636764160,"available":96631472128,"internally_reserved":0,"allocated":303104,"data_stored":136530,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.278}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.367}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9910000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6000000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.728}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.694}]}]},{"osd":10,"up_from":17,"seq":73014444040,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":136149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,6,7,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1890000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2330000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.276}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.874}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.909}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4990000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5289999999999999}]}]},{"osd":9,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67300000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1060000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98699999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2310000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96999999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.512}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4670000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]}]},{"osd":8,"up_from":17,"seq":73014444040,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85699999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.375}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.595}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.552}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5780000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6870000000000001}]}]},{"osd":7,"up_from":17,"seq":73014444038,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.427}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0369999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.256}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4039999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.212}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.492}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.593}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5229999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.742}]}]},{"osd":6,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.81599999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.006}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.339}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.51}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4650000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.032}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3759999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3979999999999999}]}]},{"osd":1,"up_from":17,"seq":73014444038,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5096,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4800,"kb_avail":94366744,"statfs":{"total":96636764160,"available":96631545856,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4915200},"hb_peers":[0,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82599999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.514}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3380000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5549999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.673}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8140000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.74}]}]},{"osd":0,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,2,3,4,5,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96499999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2410000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2230000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4359999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.875}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.556}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.641}]}]},{"osd":2,"up_from":17,"seq":73014444038,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5172,"kb_used_data":300,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366668,"statfs":{"total":96636764160,"available":96631468032,"internally_reserved":0,"allocated":307200,"data_stored":137490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.643}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1319999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.99399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.016}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2549999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.766}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.575}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8520000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7849999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0139999999999998}]}]},{"osd":3,"up_from":17,"seq":73014444038,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5176,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366664,"statfs":{"total":96636764160,"available":96631463936,"internally_reserved":0,"allocated":311296,"data_stored":136690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1970000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.107}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.92700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.407}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.282}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2969999999999999}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.232}]}]},{"osd":4,"up_from":17,"seq":73014444039,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5164,"kb_used_data":292,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366676,"statfs":{"total":96636764160,"available":96631476224,"internally_reserved":0,"allocated":299008,"data_stored":135989,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1910000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.306}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.363}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6559999999999999}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9299999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1360000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0910000000000002}]}]},{"osd":5,"up_from":17,"seq":73014444039,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5160,"kb_used_data":288,"kb_used_omap":0,"kb_used_meta":4864,"kb_avail":94366680,"statfs":{"total":96636764160,"available":96631480320,"internally_reserved":0,"allocated":294912,"data_stored":135955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4980736},"hb_peers":[0,1,2,4,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2050000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83699999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2669999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.288}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.458}]},{"osd":8,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5389999999999999}]},{"osd":9,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5900000000000001}]},{"osd":10,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7290000000000001}]},{"osd":11,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.77}]}]}]}} 2020-11-20T12:14:49.827 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-11-20T12:14:49.827 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-11-20T12:14:49.827 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-11-20T12:14:49.828 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2020-11-20T12:14:49.935 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.932+0000 7fbbbd464700 1 Processor -- start 2020-11-20T12:14:49.936 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.932+0000 7fbbbd464700 1 -- start start 2020-11-20T12:14:49.938 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbbd464700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbbb80c4640 0x7fbbb80c4a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.938 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbbd464700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fbbb8060c50 0x7fbbb80c3ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.938 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbbd464700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbb80c2a40 con 0x7fbbb8064cf0 2020-11-20T12:14:49.939 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbbd464700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80c2500 con 0x7fbbb8060c50 2020-11-20T12:14:49.939 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbbd464700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbb80c27a0 con 0x7fbbb80c4640 2020-11-20T12:14:49.939 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb6ffd700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fbbb80c4640 0x7fbbb80c4a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.939 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbaffff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7fbbb8064cf0 0x7fbbb8155140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40232/0 (socket says 172.21.15.93:40232) 2020-11-20T12:14:49.939 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbaffff700 1 -- 172.21.15.93:0/2726323152 learned_addr learned my addr 172.21.15.93:0/2726323152 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:49.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb77fe700 1 --2- 172.21.15.93:0/2726323152 >> v2:172.21.15.66:3300/0 conn(0x7fbbb8060c50 0x7fbbb80c3ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb6ffd700 1 -- 172.21.15.93:0/2726323152 >> v2:172.21.15.66:3300/0 conn(0x7fbbb8060c50 msgr2=0x7fbbb80c3ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:49.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb6ffd700 1 --2- 172.21.15.93:0/2726323152 >> v2:172.21.15.66:3300/0 conn(0x7fbbb8060c50 0x7fbbb80c3ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb6ffd700 1 -- 172.21.15.93:0/2726323152 >> v1:172.21.15.93:6789/0 conn(0x7fbbb8064cf0 legacy=0x7fbbb8155140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.940 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb67fc700 1 -- 172.21.15.93:0/2726323152 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1211562943 0 0) 0x7fbbb80c2a40 con 0x7fbbb8064cf0 2020-11-20T12:14:49.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb6ffd700 1 -- 172.21.15.93:0/2726323152 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8154a00 con 0x7fbbb80c4640 2020-11-20T12:14:49.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.933+0000 7fbbb77fe700 1 --2- 172.21.15.93:0/2726323152 >> v2:172.21.15.66:3300/0 conn(0x7fbbb8060c50 0x7fbbb80c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:49.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbb6ffd700 1 --2- 172.21.15.93:0/2726323152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb80c4640 0x7fbbb80c4a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fbbb80c4450 tx=0x7fbba8006e30).ready entity=mon.1 client_cookie=e7db4743badde3f9 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.941 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbb67fc700 1 -- 172.21.15.93:0/2726323152 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8009840 con 0x7fbbb80c4640 2020-11-20T12:14:49.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbb67fc700 1 -- 172.21.15.93:0/2726323152 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba8000e90 con 0x7fbbb80c4640 2020-11-20T12:14:49.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbb67fc700 1 -- 172.21.15.93:0/2726323152 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba8009bb0 con 0x7fbbb80c4640 2020-11-20T12:14:49.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 -- 172.21.15.93:0/2726323152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb80c4640 msgr2=0x7fbbb80c4a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 --2- 172.21.15.93:0/2726323152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb80c4640 0x7fbbb80c4a20 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7fbbb80c4450 tx=0x7fbba8006e30).stop 2020-11-20T12:14:49.942 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 -- 172.21.15.93:0/2726323152 shutdown_connections 2020-11-20T12:14:49.943 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 --2- 172.21.15.93:0/2726323152 >> v2:172.21.15.66:3300/0 conn(0x7fbbb8060c50 0x7fbbb80c3ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.943 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 --2- 172.21.15.93:0/2726323152 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb80c4640 0x7fbbb80c4a20 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.943 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 -- 172.21.15.93:0/2726323152 >> 172.21.15.93:0/2726323152 conn(0x7fbbb8060130 msgr2=0x7fbbb8060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:49.943 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 -- 172.21.15.93:0/2726323152 shutdown_connections 2020-11-20T12:14:49.943 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.934+0000 7fbbbd464700 1 -- 172.21.15.93:0/2726323152 wait complete. 2020-11-20T12:14:49.946 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.935+0000 7fbbbd464700 1 Processor -- start 2020-11-20T12:14:49.946 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.935+0000 7fbbbd464700 1 -- start start 2020-11-20T12:14:49.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbbd464700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb8060c50 0x7fbbb8153ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbbd464700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb8064cf0 0x7fbbb8150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbbd464700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbb80c4640 0x7fbbb8150c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbbd464700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81584a0 con 0x7fbbb80c4640 2020-11-20T12:14:49.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbbd464700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb8151110 con 0x7fbbb8064cf0 2020-11-20T12:14:49.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbbd464700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb81527b0 con 0x7fbbb8060c50 2020-11-20T12:14:49.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb8064cf0 0x7fbbb8150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb8064cf0 0x7fbbb8150730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39540/0 (socket says 172.21.15.93:39540) 2020-11-20T12:14:49.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 -- 172.21.15.93:0/3500174948 learned_addr learned my addr 172.21.15.93:0/3500174948 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:49.949 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbb77fe700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbb80c4640 0x7fbbb8150c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.949 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbb6ffd700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb8060c50 0x7fbbb8153ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.949 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 -- 172.21.15.93:0/3500174948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb8060c50 msgr2=0x7fbbb8153ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.949 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb8060c50 0x7fbbb8153ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.950 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 -- 172.21.15.93:0/3500174948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbb80c4640 msgr2=0x7fbbb8150c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:49.950 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbb80c4640 0x7fbbb8150c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:49.950 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbaffff700 1 -- 172.21.15.93:0/3500174948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb8152a50 con 0x7fbbb8064cf0 2020-11-20T12:14:49.950 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbb77fe700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbb80c4640 0x7fbbb8150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:49.950 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.936+0000 7fbbb6ffd700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb8060c50 0x7fbbb8153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:49.951 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.937+0000 7fbbaffff700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb8064cf0 0x7fbbb8150730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fbba000c750 tx=0x7fbba0007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.951 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.937+0000 7fbbaeffd700 1 -- 172.21.15.93:0/3500174948 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0007320 con 0x7fbbb8064cf0 2020-11-20T12:14:49.951 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.937+0000 7fbbaeffd700 1 -- 172.21.15.93:0/3500174948 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbba0007480 con 0x7fbbb8064cf0 2020-11-20T12:14:49.951 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.937+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbb814fd50 con 0x7fbbb8064cf0 2020-11-20T12:14:49.951 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.937+0000 7fbbaeffd700 1 -- 172.21.15.93:0/3500174948 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbba0005840 con 0x7fbbb8064cf0 2020-11-20T12:14:49.952 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.937+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbb8150290 con 0x7fbbb8064cf0 2020-11-20T12:14:49.952 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.938+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbb8150450 con 0x7fbbb8064cf0 2020-11-20T12:14:49.952 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.938+0000 7fbbaeffd700 1 -- 172.21.15.93:0/3500174948 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fbba0010030 con 0x7fbbb8064cf0 2020-11-20T12:14:49.952 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.939+0000 7fbbaeffd700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbb8c080670 0x7fbb8c082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:49.952 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.939+0000 7fbbaeffd700 1 -- 172.21.15.93:0/3500174948 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fbba00a2da0 con 0x7fbbb8064cf0 2020-11-20T12:14:49.953 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.939+0000 7fbbb6ffd700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbb8c080670 0x7fbb8c082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:49.953 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.939+0000 7fbbb6ffd700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbb8c080670 0x7fbb8c082b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fbba8009fd0 tx=0x7fbba8015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:49.953 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:49.942+0000 7fbbaeffd700 1 -- 172.21.15.93:0/3500174948 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fbba00777b0 con 0x7fbbb8064cf0 2020-11-20T12:14:50.137 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.134+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbbb805ca60 con 0x7fbbb8064cf0 2020-11-20T12:14:50.138 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.134+0000 7fbbaeffd700 1 -- 172.21.15.93:0/3500174948 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7fbba0007c00 con 0x7fbbb8064cf0 2020-11-20T12:14:50.138 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:50.139 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:50.140 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbb8c080670 msgr2=0x7fbb8c082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.140 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbb8c080670 0x7fbb8c082b30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fbba8009fd0 tx=0x7fbba8015000).stop 2020-11-20T12:14:50.140 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb8064cf0 msgr2=0x7fbbb8150730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.141 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb8064cf0 0x7fbbb8150730 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7fbba000c750 tx=0x7fbba0007ac0).stop 2020-11-20T12:14:50.141 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 shutdown_connections 2020-11-20T12:14:50.141 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fbb8c080670 0x7fbb8c082b30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.141 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fbbb80c4640 0x7fbbb8150c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.142 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbb8060c50 0x7fbbb8153ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.142 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 --2- 172.21.15.93:0/3500174948 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fbbb8064cf0 0x7fbbb8150730 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.142 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 >> 172.21.15.93:0/3500174948 conn(0x7fbbb8060130 msgr2=0x7fbbb80c14c0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:50.142 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 shutdown_connections 2020-11-20T12:14:50.142 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.136+0000 7fbbbd464700 1 -- 172.21.15.93:0/3500174948 wait complete. 2020-11-20T12:14:50.145 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:50.147 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:14:50.150 INFO:teuthology.orchestra.run.smithi093.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-11-20T12:14:50.150 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-11-20T12:14:50.151 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:50.339 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.336+0000 7f6771388700 1 Processor -- start 2020-11-20T12:14:50.339 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.336+0000 7f6771388700 1 -- start start 2020-11-20T12:14:50.341 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6771388700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f676c0be3e0 0x7f676c0bdd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.341 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6771388700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676c0bf3f0 con 0x7f676c14c610 2020-11-20T12:14:50.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6771388700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f676c0be970 con 0x7f676c0bd930 2020-11-20T12:14:50.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6771388700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f676c0bec10 con 0x7f676c0be3e0 2020-11-20T12:14:50.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6763fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f676c0be3e0 0x7f676c0bdd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f676affd700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f676c0bd930 0x7f676c14bf00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40242/0 (socket says 172.21.15.93:40242) 2020-11-20T12:14:50.342 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f676affd700 1 -- 172.21.15.93:0/2353774421 learned_addr learned my addr 172.21.15.93:0/2353774421 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:50.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6763fff700 1 -- 172.21.15.93:0/2353774421 >> v1:172.21.15.93:6789/0 conn(0x7f676c0bd930 legacy=0x7f676c14bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f676a7fc700 1 -- 172.21.15.93:0/2353774421 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220302180 0 0) 0x7f676c0be970 con 0x7f676c0bd930 2020-11-20T12:14:50.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6763fff700 1 -- 172.21.15.93:0/2353774421 >> v1:172.21.15.66:6789/0 conn(0x7f676c14c610 legacy=0x7f676c14f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:50.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6763fff700 1 -- 172.21.15.93:0/2353774421 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c0beeb0 con 0x7f676c0be3e0 2020-11-20T12:14:50.343 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f6763fff700 1 --2- 172.21.15.93:0/2353774421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0be3e0 0x7f676c0bdd10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6754006fd0 tx=0x7f6754006e30).ready entity=mon.1 client_cookie=551c586e9b737957 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f676a7fc700 1 -- 172.21.15.93:0/2353774421 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754009830 con 0x7f676c0be3e0 2020-11-20T12:14:50.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f676a7fc700 1 -- 172.21.15.93:0/2353774421 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6754000e90 con 0x7f676c0be3e0 2020-11-20T12:14:50.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.337+0000 7f676a7fc700 1 -- 172.21.15.93:0/2353774421 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6754009ba0 con 0x7f676c0be3e0 2020-11-20T12:14:50.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.338+0000 7f6771388700 1 -- 172.21.15.93:0/2353774421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0be3e0 msgr2=0x7f676c0bdd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.344 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.338+0000 7f6771388700 1 --2- 172.21.15.93:0/2353774421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0be3e0 0x7f676c0bdd10 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f6754006fd0 tx=0x7f6754006e30).stop 2020-11-20T12:14:50.345 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.338+0000 7f6771388700 1 -- 172.21.15.93:0/2353774421 shutdown_connections 2020-11-20T12:14:50.345 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.338+0000 7f6771388700 1 --2- 172.21.15.93:0/2353774421 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0be3e0 0x7f676c0bdd10 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.345 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.338+0000 7f6771388700 1 -- 172.21.15.93:0/2353774421 >> 172.21.15.93:0/2353774421 conn(0x7f676c060c00 msgr2=0x7f676c0c5720 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:50.345 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.338+0000 7f6771388700 1 -- 172.21.15.93:0/2353774421 shutdown_connections 2020-11-20T12:14:50.345 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.338+0000 7f6771388700 1 -- 172.21.15.93:0/2353774421 wait complete. 2020-11-20T12:14:50.348 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.339+0000 7f6771388700 1 Processor -- start 2020-11-20T12:14:50.348 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.339+0000 7f6771388700 1 -- start start 2020-11-20T12:14:50.348 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0bd930 0x7f676c1621d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.348 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f676c0be3e0 0x7f676c152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.349 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c14c610 0x7f676c0bfff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.350 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c154770 con 0x7f676c0be3e0 2020-11-20T12:14:50.350 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c153850 con 0x7f676c0bd930 2020-11-20T12:14:50.350 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f676c153af0 con 0x7f676c14c610 2020-11-20T12:14:50.350 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0bd930 0x7f676c1621d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.351 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0bd930 0x7f676c1621d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39550/0 (socket says 172.21.15.93:39550) 2020-11-20T12:14:50.351 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 -- 172.21.15.93:0/2470219184 learned_addr learned my addr 172.21.15.93:0/2470219184 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:50.351 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 -- 172.21.15.93:0/2470219184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c14c610 msgr2=0x7f676c0bfff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.351 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c14c610 0x7f676c0bfff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:50.351 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 -- 172.21.15.93:0/2470219184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f676c0be3e0 msgr2=0x7f676c152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.352 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f676c0be3e0 0x7f676c152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:50.352 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 -- 172.21.15.93:0/2470219184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f676c153d90 con 0x7f676c0bd930 2020-11-20T12:14:50.352 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f676affd700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0bd930 0x7f676c1621d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f675c00c7c0 tx=0x7f675c007b00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.352 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6762ffd700 1 -- 172.21.15.93:0/2470219184 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c007320 con 0x7f676c0bd930 2020-11-20T12:14:50.352 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6762ffd700 1 -- 172.21.15.93:0/2470219184 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f675c007480 con 0x7f676c0bd930 2020-11-20T12:14:50.353 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f676c154030 con 0x7f676c0bd930 2020-11-20T12:14:50.353 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6762ffd700 1 -- 172.21.15.93:0/2470219184 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f675c005840 con 0x7f676c0bd930 2020-11-20T12:14:50.353 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.340+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f676c1626c0 con 0x7f676c0bd930 2020-11-20T12:14:50.353 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.341+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f676c05cd50 con 0x7f676c0bd930 2020-11-20T12:14:50.353 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.342+0000 7f6762ffd700 1 -- 172.21.15.93:0/2470219184 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f675c010030 con 0x7f676c0bd930 2020-11-20T12:14:50.354 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.342+0000 7f6762ffd700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6748080670 0x7f6748082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.354 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.342+0000 7f6762ffd700 1 -- 172.21.15.93:0/2470219184 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f675c0a27f0 con 0x7f676c0bd930 2020-11-20T12:14:50.354 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.342+0000 7f6763fff700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6748080670 0x7f6748082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.354 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.343+0000 7f6763fff700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6748080670 0x7f6748082b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6754006fd0 tx=0x7f6754015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.355 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.346+0000 7f6762ffd700 1 -- 172.21.15.93:0/2470219184 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f675c077200 con 0x7f676c0bd930 2020-11-20T12:14:50.488 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.485+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f676c05c670 con 0x7f676c0bd930 2020-11-20T12:14:50.489 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.486+0000 7f6762ffd700 1 -- 172.21.15.93:0/2470219184 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7f675c07a820 con 0x7f676c0bd930 2020-11-20T12:14:50.490 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:50.490 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:50.491 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6748080670 msgr2=0x7f6748082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.491 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6748080670 0x7f6748082b30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f6754006fd0 tx=0x7f6754015000).stop 2020-11-20T12:14:50.492 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0bd930 msgr2=0x7f676c1621d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.492 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0bd930 0x7f676c1621d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f675c00c7c0 tx=0x7f675c007b00).stop 2020-11-20T12:14:50.492 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 shutdown_connections 2020-11-20T12:14:50.492 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f676c14c610 0x7f676c0bfff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f676c0bd930 0x7f676c1621d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f6748080670 0x7f6748082b30 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 --2- 172.21.15.93:0/2470219184 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f676c0be3e0 0x7f676c152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2020-11-20T12:14:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 >> 172.21.15.93:0/2470219184 conn(0x7f676c060c00 msgr2=0x7f676c148f50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:50.493 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 shutdown_connections 2020-11-20T12:14:50.494 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.488+0000 7f6771388700 1 -- 172.21.15.93:0/2470219184 wait complete. 2020-11-20T12:14:50.503 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:14:19.052710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:28.933013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T12:14:33.975801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T12:14:36.724824+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T12:14:50.504 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.613+0000 7fd88fc23700 1 Processor -- start 2020-11-20T12:14:50.616 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.613+0000 7fd88fc23700 1 -- start start 2020-11-20T12:14:50.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88fc23700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd88814ec00 0x7fd8880beed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88fc23700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd888151990 con 0x7fd88814efe0 2020-11-20T12:14:50.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88fc23700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8880c2620 con 0x7fd8881524d0 2020-11-20T12:14:50.619 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88fc23700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8880c28c0 con 0x7fd88814ec00 2020-11-20T12:14:50.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88d9bf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd88814ec00 0x7fd8880beed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88d1be700 1 --1- >> v1:172.21.15.66:6789/0 conn(0x7fd88814efe0 0x7fd888151dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39794/0 (socket says 172.21.15.93:39794) 2020-11-20T12:14:50.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88d9bf700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fd88814ec00 0x7fd8880beed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.66:3300/0 says I am v2:172.21.15.93:53734/0 (socket says 172.21.15.93:53734) 2020-11-20T12:14:50.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.614+0000 7fd88d9bf700 1 -- 172.21.15.93:0/708097979 learned_addr learned my addr 172.21.15.93:0/708097979 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:50.620 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88c9bd700 1 -- 172.21.15.93:0/708097979 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3436769625 0 0) 0x7fd8880c2620 con 0x7fd8881524d0 2020-11-20T12:14:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88c9bd700 1 -- 172.21.15.93:0/708097979 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd870003280 con 0x7fd8881524d0 2020-11-20T12:14:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88d9bf700 1 -- 172.21.15.93:0/708097979 >> v1:172.21.15.132:6789/0 conn(0x7fd8881524d0 legacy=0x7fd8880c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88d9bf700 1 -- 172.21.15.93:0/708097979 >> v1:172.21.15.66:6789/0 conn(0x7fd88814efe0 legacy=0x7fd888151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88d9bf700 1 -- 172.21.15.93:0/708097979 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8880c2b60 con 0x7fd88814ec00 2020-11-20T12:14:50.621 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88d9bf700 1 --2- 172.21.15.93:0/708097979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd8880beed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd884009a10 tx=0x7fd884006ef0).ready entity=mon.0 client_cookie=32bd55eb0db2ce46 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88c9bd700 1 -- 172.21.15.93:0/708097979 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400b8f0 con 0x7fd88814ec00 2020-11-20T12:14:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88c9bd700 1 -- 172.21.15.93:0/708097979 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd884000e90 con 0x7fd88814ec00 2020-11-20T12:14:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.615+0000 7fd88c9bd700 1 -- 172.21.15.93:0/708097979 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd88400bc60 con 0x7fd88814ec00 2020-11-20T12:14:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.616+0000 7fd88fc23700 1 -- 172.21.15.93:0/708097979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 msgr2=0x7fd8880beed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.622 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.616+0000 7fd88fc23700 1 --2- 172.21.15.93:0/708097979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd8880beed0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fd884009a10 tx=0x7fd884006ef0).stop 2020-11-20T12:14:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.616+0000 7fd88fc23700 1 -- 172.21.15.93:0/708097979 shutdown_connections 2020-11-20T12:14:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.616+0000 7fd88fc23700 1 --2- 172.21.15.93:0/708097979 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd8880beed0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.616+0000 7fd88fc23700 1 -- 172.21.15.93:0/708097979 >> 172.21.15.93:0/708097979 conn(0x7fd888060130 msgr2=0x7fd888060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.616+0000 7fd88fc23700 1 -- 172.21.15.93:0/708097979 shutdown_connections 2020-11-20T12:14:50.623 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.616+0000 7fd88fc23700 1 -- 172.21.15.93:0/708097979 wait complete. 2020-11-20T12:14:50.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 Processor -- start 2020-11-20T12:14:50.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 -- start start 2020-11-20T12:14:50.626 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd88814da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd88814efe0 0x7fd888152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8881524d0 0x7fd888153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88814d070 con 0x7fd88814ec00 2020-11-20T12:14:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88814c5f0 con 0x7fd88814efe0 2020-11-20T12:14:50.627 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.617+0000 7fd88fc23700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd88814c890 con 0x7fd8881524d0 2020-11-20T12:14:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd88814efe0 0x7fd888152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd88814efe0 0x7fd888152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39566/0 (socket says 172.21.15.93:39566) 2020-11-20T12:14:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 -- 172.21.15.93:0/2269323779 learned_addr learned my addr 172.21.15.93:0/2269323779 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d9bf700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd88814da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.628 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88e1c0700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8881524d0 0x7fd888153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.629 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 -- 172.21.15.93:0/2269323779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8881524d0 msgr2=0x7fd888153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.629 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8881524d0 0x7fd888153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.629 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 -- 172.21.15.93:0/2269323779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 msgr2=0x7fd88814da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.629 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd88814da80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.629 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 -- 172.21.15.93:0/2269323779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd88814cb30 con 0x7fd88814efe0 2020-11-20T12:14:50.630 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d9bf700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd88814da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:50.630 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88d1be700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd88814efe0 0x7fd888152f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd87800c710 tx=0x7fd878007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.630 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd875ffb700 1 -- 172.21.15.93:0/2269323779 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd878007320 con 0x7fd88814efe0 2020-11-20T12:14:50.630 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd875ffb700 1 -- 172.21.15.93:0/2269323779 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd878005570 con 0x7fd88814efe0 2020-11-20T12:14:50.630 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd88814cdd0 con 0x7fd88814efe0 2020-11-20T12:14:50.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.618+0000 7fd875ffb700 1 -- 172.21.15.93:0/2269323779 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8780058f0 con 0x7fd88814efe0 2020-11-20T12:14:50.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.619+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd88814a210 con 0x7fd88814efe0 2020-11-20T12:14:50.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.619+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8880c3000 con 0x7fd88814efe0 2020-11-20T12:14:50.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.620+0000 7fd875ffb700 1 -- 172.21.15.93:0/2269323779 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fd878010030 con 0x7fd88814efe0 2020-11-20T12:14:50.631 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.620+0000 7fd875ffb700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd860080670 0x7fd860082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.620+0000 7fd875ffb700 1 -- 172.21.15.93:0/2269323779 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fd8780a26f0 con 0x7fd88814efe0 2020-11-20T12:14:50.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.620+0000 7fd88d9bf700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd860080670 0x7fd860082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.621+0000 7fd88d9bf700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd860080670 0x7fd860082b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd884006f30 tx=0x7fd884016000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.632 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.624+0000 7fd875ffb700 1 -- 172.21.15.93:0/2269323779 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fd878077100 con 0x7fd88814efe0 2020-11-20T12:14:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.763+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fd888061a40 con 0x7fd88814efe0 2020-11-20T12:14:50.766 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.763+0000 7fd875ffb700 1 -- 172.21.15.93:0/2269323779 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7fd87807a720 con 0x7fd88814efe0 2020-11-20T12:14:50.766 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2020-11-20T12:14:50.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd860080670 msgr2=0x7fd860082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd860080670 0x7fd860082b30 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fd884006f30 tx=0x7fd884016000).stop 2020-11-20T12:14:50.768 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd88814efe0 msgr2=0x7fd888152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd88814efe0 0x7fd888152f20 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fd87800c710 tx=0x7fd878007c40).stop 2020-11-20T12:14:50.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 shutdown_connections 2020-11-20T12:14:50.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8881524d0 0x7fd888153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.769 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fd860080670 0x7fd860082b30 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fd88814ec00 0x7fd88814da80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 --2- 172.21.15.93:0/2269323779 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fd88814efe0 0x7fd888152f20 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 >> 172.21.15.93:0/2269323779 conn(0x7fd888060130 msgr2=0x7fd888151ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:50.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 shutdown_connections 2020-11-20T12:14:50.770 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.765+0000 7fd88fc23700 1 -- 172.21.15.93:0/2269323779 wait complete. 2020-11-20T12:14:50.779 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:50.902 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.899+0000 7f73c611c700 1 Processor -- start 2020-11-20T12:14:50.903 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.899+0000 7f73c611c700 1 -- start start 2020-11-20T12:14:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c611c700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f73c00606d0 0x7f73c00649c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.906 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c611c700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73c0151690 0x7f73c0151b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c611c700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c0154870 con 0x7f73c00602f0 2020-11-20T12:14:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c611c700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c0064eb0 con 0x7f73c00606d0 2020-11-20T12:14:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c611c700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c0154aa0 con 0x7f73c0151690 2020-11-20T12:14:50.907 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c511a700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f73c00602f0 0x7f73c00642b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40270/0 (socket says 172.21.15.93:40270) 2020-11-20T12:14:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c511a700 1 -- 172.21.15.93:0/3001784320 learned_addr learned my addr 172.21.15.93:0/3001784320 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c591b700 1 --2- 172.21.15.93:0/3001784320 >> v2:172.21.15.132:3300/0 conn(0x7f73c0151690 0x7f73c0151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.900+0000 7f73c4919700 1 --2- 172.21.15.93:0/3001784320 >> v2:172.21.15.66:3300/0 conn(0x7f73c00606d0 0x7f73c00649c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271534614 0 0) 0x7f73c0154870 con 0x7f73c00602f0 2020-11-20T12:14:50.908 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a8003280 con 0x7f73c00602f0 2020-11-20T12:14:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2984280102 0 0) 0x7f73a8003280 con 0x7f73c00602f0 2020-11-20T12:14:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 >> v2:172.21.15.132:3300/0 conn(0x7f73c0151690 msgr2=0x7f73c0151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 --2- 172.21.15.93:0/3001784320 >> v2:172.21.15.132:3300/0 conn(0x7f73c0151690 0x7f73c0151b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 >> v2:172.21.15.66:3300/0 conn(0x7f73c00606d0 msgr2=0x7f73c00649c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:50.909 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 --2- 172.21.15.93:0/3001784320 >> v2:172.21.15.66:3300/0 conn(0x7f73c00606d0 0x7f73c00649c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0154d40 con 0x7f73c00602f0 2020-11-20T12:14:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f73bc001520 con 0x7f73c00602f0 2020-11-20T12:14:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c4919700 1 --2- 172.21.15.93:0/3001784320 >> v2:172.21.15.66:3300/0 conn(0x7f73c00606d0 0x7f73c00649c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2020-11-20T12:14:50.910 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 >> v1:172.21.15.93:6789/0 conn(0x7f73c00602f0 legacy=0x7f73c00642b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73a80037c0 0x7f73a8003be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a8004520 0x7f73a80049a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a8004e90 0x7f73a800b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0064eb0 con 0x7f73a8004e90 2020-11-20T12:14:50.911 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0154aa0 con 0x7f73a80037c0 2020-11-20T12:14:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a8005340 con 0x7f73a8004520 2020-11-20T12:14:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c511a700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73a80037c0 0x7f73a8003be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c591b700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a8004e90 0x7f73a800b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.912 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c4919700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a8004520 0x7f73a80049a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c511a700 1 -- 172.21.15.93:0/3001784320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a8004520 msgr2=0x7f73a80049a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:50.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c511a700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a8004520 0x7f73a80049a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c511a700 1 -- 172.21.15.93:0/3001784320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a8004e90 msgr2=0x7f73a800b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:50.913 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c511a700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a8004e90 0x7f73a800b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c511a700 1 -- 172.21.15.93:0/3001784320 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73a8003280 con 0x7f73a80037c0 2020-11-20T12:14:50.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c591b700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73a8004e90 0x7f73a800b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:50.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c591b700 1 -- 172.21.15.93:0/3001784320 reap_dead start 2020-11-20T12:14:50.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73c511a700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73a80037c0 0x7f73a8003be0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f73bc00c440 tx=0x7f73c0154ed0).ready entity=mon.1 client_cookie=82e3babf5e660a03 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.914 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.901+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc00ce20 con 0x7f73a80037c0 2020-11-20T12:14:50.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73bc0072e0 con 0x7f73a80037c0 2020-11-20T12:14:50.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73affff700 1 -- 172.21.15.93:0/3001784320 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73bc005880 con 0x7f73a80037c0 2020-11-20T12:14:50.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73c611c700 1 -- 172.21.15.93:0/3001784320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73a80037c0 msgr2=0x7f73a8003be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73c611c700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73a80037c0 0x7f73a8003be0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f73bc00c440 tx=0x7f73c0154ed0).stop 2020-11-20T12:14:50.915 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73c611c700 1 -- 172.21.15.93:0/3001784320 shutdown_connections 2020-11-20T12:14:50.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73c611c700 1 --2- 172.21.15.93:0/3001784320 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73a80037c0 0x7f73a8003be0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73c611c700 1 -- 172.21.15.93:0/3001784320 >> 172.21.15.93:0/3001784320 conn(0x7f73c00c5590 msgr2=0x7f73c00c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:50.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73c611c700 1 -- 172.21.15.93:0/3001784320 shutdown_connections 2020-11-20T12:14:50.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.902+0000 7f73c611c700 1 -- 172.21.15.93:0/3001784320 wait complete. 2020-11-20T12:14:50.916 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.903+0000 7f73c611c700 1 Processor -- start 2020-11-20T12:14:50.917 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.903+0000 7f73c611c700 1 -- start start 2020-11-20T12:14:50.919 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c611c700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a80037c0 0x7f73c0149210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.919 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c611c700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c00bf630 0x7f73c0158090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.920 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c611c700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73c0158580 0x7f73c014bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.920 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c611c700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0155df0 con 0x7f73c00bf630 2020-11-20T12:14:50.920 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c611c700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0156090 con 0x7f73c0158580 2020-11-20T12:14:50.920 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c611c700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c0156330 con 0x7f73a80037c0 2020-11-20T12:14:50.920 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c591b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73c0158580 0x7f73c014bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.921 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c591b700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73c0158580 0x7f73c014bee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39588/0 (socket says 172.21.15.93:39588) 2020-11-20T12:14:50.921 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c591b700 1 -- 172.21.15.93:0/2113900157 learned_addr learned my addr 172.21.15.93:0/2113900157 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:50.921 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c511a700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a80037c0 0x7f73c0149210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.921 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.904+0000 7f73c4919700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c00bf630 0x7f73c0158090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.921 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c591b700 1 -- 172.21.15.93:0/2113900157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a80037c0 msgr2=0x7f73c0149210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c591b700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a80037c0 0x7f73c0149210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c591b700 1 -- 172.21.15.93:0/2113900157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c00bf630 msgr2=0x7f73c0158090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c591b700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c00bf630 0x7f73c0158090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c591b700 1 -- 172.21.15.93:0/2113900157 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c01565d0 con 0x7f73c0158580 2020-11-20T12:14:50.922 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c591b700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73c0158580 0x7f73c014bee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f73c00654d0 tx=0x7f73b8008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73ad7fa700 1 -- 172.21.15.93:0/2113900157 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8015690 con 0x7f73c0158580 2020-11-20T12:14:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73ad7fa700 1 -- 172.21.15.93:0/2113900157 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b80157f0 con 0x7f73c0158580 2020-11-20T12:14:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c0156870 con 0x7f73c0158580 2020-11-20T12:14:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73ad7fa700 1 -- 172.21.15.93:0/2113900157 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b8015bb0 con 0x7f73c0158580 2020-11-20T12:14:50.923 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.905+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c01559d0 con 0x7f73c0158580 2020-11-20T12:14:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.906+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c0155700 con 0x7f73c0158580 2020-11-20T12:14:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.906+0000 7f73ad7fa700 1 -- 172.21.15.93:0/2113900157 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f73b801e030 con 0x7f73c0158580 2020-11-20T12:14:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.907+0000 7f73ad7fa700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7398080670 0x7f7398082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.907+0000 7f73c511a700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7398080670 0x7f7398082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:50.924 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.907+0000 7f73ad7fa700 1 -- 172.21.15.93:0/2113900157 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f73b80a2c20 con 0x7f73c0158580 2020-11-20T12:14:50.925 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.907+0000 7f73c511a700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7398080670 0x7f7398082b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f73bc007a60 tx=0x7f73bc015000).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:50.925 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:50.910+0000 7f73ad7fa700 1 -- 172.21.15.93:0/2113900157 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f73b8077630 con 0x7f73c0158580 2020-11-20T12:14:51.052 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.049+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f73c0061960 con 0x7f73c0158580 2020-11-20T12:14:51.052 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.049+0000 7f73ad7fa700 1 -- 172.21.15.93:0/2113900157 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f73b807ac50 con 0x7f73c0158580 2020-11-20T12:14:51.052 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:51.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.050+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7398080670 msgr2=0x7f7398082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.050+0000 7f73c611c700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7398080670 0x7f7398082b30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f73bc007a60 tx=0x7f73bc015000).stop 2020-11-20T12:14:51.054 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.050+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73c0158580 msgr2=0x7f73c014bee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.050+0000 7f73c611c700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73c0158580 0x7f73c014bee0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f73c00654d0 tx=0x7f73b8008040).stop 2020-11-20T12:14:51.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 shutdown_connections 2020-11-20T12:14:51.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f73c0158580 0x7f73c014bee0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73a80037c0 0x7f73c0149210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.055 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7398080670 0x7f7398082b30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 --2- 172.21.15.93:0/2113900157 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f73c00bf630 0x7f73c0158090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 >> 172.21.15.93:0/2113900157 conn(0x7f73c00c5590 msgr2=0x7f73c0150590 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:51.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 shutdown_connections 2020-11-20T12:14:51.056 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.051+0000 7f73c611c700 1 -- 172.21.15.93:0/2113900157 wait complete. 2020-11-20T12:14:51.066 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T12:14:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.175+0000 7f8c07cfd700 1 Processor -- start 2020-11-20T12:14:51.178 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.175+0000 7f8c07cfd700 1 -- start start 2020-11-20T12:14:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c07cfd700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f8c000679a0 0x7f8c00067d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c07cfd700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000bc700 con 0x7f8c000bc270 2020-11-20T12:14:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c07cfd700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c000bccb0 con 0x7f8c000bbe10 2020-11-20T12:14:51.181 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c07cfd700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c000bcf50 con 0x7f8c000679a0 2020-11-20T12:14:51.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c05298700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f8c000bbe10 0x7f8c00063a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40290/0 (socket says 172.21.15.93:40290) 2020-11-20T12:14:51.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c05298700 1 -- 172.21.15.93:0/1624967695 learned_addr learned my addr 172.21.15.93:0/1624967695 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:51.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c05a99700 1 --2- 172.21.15.93:0/1624967695 >> v2:172.21.15.66:3300/0 conn(0x7f8c000679a0 0x7f8c00067d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c04a97700 1 -- 172.21.15.93:0/1624967695 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3040729979 0 0) 0x7f8c000bccb0 con 0x7f8c000bbe10 2020-11-20T12:14:51.182 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.176+0000 7f8c04a97700 1 -- 172.21.15.93:0/1624967695 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8be8003280 con 0x7f8c000bbe10 2020-11-20T12:14:51.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c04a97700 1 -- 172.21.15.93:0/1624967695 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2916851802 0 0) 0x7f8be8003280 con 0x7f8c000bbe10 2020-11-20T12:14:51.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c05a99700 1 -- 172.21.15.93:0/1624967695 >> v1:172.21.15.93:6789/0 conn(0x7f8c000bbe10 legacy=0x7f8c00063a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c05a99700 1 -- 172.21.15.93:0/1624967695 >> v1:172.21.15.66:6789/0 conn(0x7f8c000bc270 legacy=0x7f8c0014d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c05a99700 1 -- 172.21.15.93:0/1624967695 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c000bd1f0 con 0x7f8c000679a0 2020-11-20T12:14:51.183 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c05a99700 1 --2- 172.21.15.93:0/1624967695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c000679a0 0x7f8c00067d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8bfc006fd0 tx=0x7f8bfc006e30).ready entity=mon.0 client_cookie=2590af3ae57e403d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c04a97700 1 -- 172.21.15.93:0/1624967695 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf4001520 con 0x7f8c000679a0 2020-11-20T12:14:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c04a97700 1 -- 172.21.15.93:0/1624967695 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc000e90 con 0x7f8c000679a0 2020-11-20T12:14:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c04a97700 1 -- 172.21.15.93:0/1624967695 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc011610 con 0x7f8c000679a0 2020-11-20T12:14:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c07cfd700 1 -- 172.21.15.93:0/1624967695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c000679a0 msgr2=0x7f8c00067d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.184 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/1624967695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c000679a0 0x7f8c00067d80 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f8bfc006fd0 tx=0x7f8bfc006e30).stop 2020-11-20T12:14:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c07cfd700 1 -- 172.21.15.93:0/1624967695 shutdown_connections 2020-11-20T12:14:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/1624967695 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c000679a0 0x7f8c00067d80 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.177+0000 7f8c07cfd700 1 -- 172.21.15.93:0/1624967695 >> 172.21.15.93:0/1624967695 conn(0x7f8c00060130 msgr2=0x7f8c00060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.178+0000 7f8c07cfd700 1 -- 172.21.15.93:0/1624967695 shutdown_connections 2020-11-20T12:14:51.185 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.178+0000 7f8c07cfd700 1 -- 172.21.15.93:0/1624967695 wait complete. 2020-11-20T12:14:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 Processor -- start 2020-11-20T12:14:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 -- start start 2020-11-20T12:14:51.188 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c000679a0 0x7f8c0013a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c000bbe10 0x7f8c00162270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c0014c880 0x7f8c00137050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c00162760 con 0x7f8c0014c880 2020-11-20T12:14:51.189 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0013ad60 con 0x7f8c000679a0 2020-11-20T12:14:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c07cfd700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c0015e540 con 0x7f8c000bbe10 2020-11-20T12:14:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c05a99700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c000679a0 0x7f8c0013a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c05a99700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c000679a0 0x7f8c0013a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39598/0 (socket says 172.21.15.93:39598) 2020-11-20T12:14:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.179+0000 7f8c05a99700 1 -- 172.21.15.93:0/340421200 learned_addr learned my addr 172.21.15.93:0/340421200 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:51.190 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c05298700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c000bbe10 0x7f8c00162270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c05a99700 1 -- 172.21.15.93:0/340421200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c000bbe10 msgr2=0x7f8c00162270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c0629a700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c0014c880 0x7f8c00137050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c05a99700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c000bbe10 0x7f8c00162270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c05a99700 1 -- 172.21.15.93:0/340421200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c0014c880 msgr2=0x7f8c00137050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.191 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c05a99700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c0014c880 0x7f8c00137050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c05a99700 1 -- 172.21.15.93:0/340421200 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c0015e7e0 con 0x7f8c000679a0 2020-11-20T12:14:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c05a99700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c000679a0 0x7f8c0013a6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8bfc00b150 tx=0x7f8bfc015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8bf1ffb700 1 -- 172.21.15.93:0/340421200 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc010e60 con 0x7f8c000679a0 2020-11-20T12:14:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8bf1ffb700 1 -- 172.21.15.93:0/340421200 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bfc01e460 con 0x7f8c000679a0 2020-11-20T12:14:51.192 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c0015ea80 con 0x7f8c000679a0 2020-11-20T12:14:51.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8bf1ffb700 1 -- 172.21.15.93:0/340421200 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bfc01e7e0 con 0x7f8c000679a0 2020-11-20T12:14:51.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.180+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c0015f1c0 con 0x7f8c000679a0 2020-11-20T12:14:51.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.181+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c0015eee0 con 0x7f8c000679a0 2020-11-20T12:14:51.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.182+0000 7f8bf1ffb700 1 -- 172.21.15.93:0/340421200 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f8bfc025030 con 0x7f8c000679a0 2020-11-20T12:14:51.193 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.182+0000 7f8bf1ffb700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8bd80806a0 0x7f8bd8082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.182+0000 7f8bf1ffb700 1 -- 172.21.15.93:0/340421200 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f8bfc0a48e0 con 0x7f8c000679a0 2020-11-20T12:14:51.194 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.185+0000 7f8bf1ffb700 1 -- 172.21.15.93:0/340421200 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f8bfc079270 con 0x7f8c000679a0 2020-11-20T12:14:51.195 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.189+0000 7f8c05298700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8bd80806a0 0x7f8bd8082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.195 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.189+0000 7f8c05298700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8bd80806a0 0x7f8bd8082b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8c000c2b30 tx=0x7f8bf4009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.329 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.326+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8c0005cad0 con 0x7f8c000679a0 2020-11-20T12:14:51.330 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.326+0000 7f8bf1ffb700 1 -- 172.21.15.93:0/340421200 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7f8bfc02d070 con 0x7f8c000679a0 2020-11-20T12:14:51.330 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:51.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8bd80806a0 msgr2=0x7f8bd8082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8bd80806a0 0x7f8bd8082b60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f8c000c2b30 tx=0x7f8bf4009040).stop 2020-11-20T12:14:51.331 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c000679a0 msgr2=0x7f8c0013a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c000679a0 0x7f8c0013a6a0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f8bfc00b150 tx=0x7f8bfc015000).stop 2020-11-20T12:14:51.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 shutdown_connections 2020-11-20T12:14:51.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f8bd80806a0 0x7f8bd8082b60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f8c0014c880 0x7f8c00137050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.332 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f8c000679a0 0x7f8c0013a6a0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 --2- 172.21.15.93:0/340421200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c000bbe10 0x7f8c00162270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 >> 172.21.15.93:0/340421200 conn(0x7f8c00060130 msgr2=0x7f8c0014e100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:51.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 shutdown_connections 2020-11-20T12:14:51.333 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.328+0000 7f8c07cfd700 1 -- 172.21.15.93:0/340421200 wait complete. 2020-11-20T12:14:51.342 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T12:14:51.454 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.451+0000 7ff3b5250700 1 Processor -- start 2020-11-20T12:14:51.455 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.452+0000 7ff3b5250700 1 -- start start 2020-11-20T12:14:51.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.452+0000 7ff3b5250700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff3b014fc60 0x7ff3b00606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.452+0000 7ff3b5250700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b0152990 con 0x7ff3b00602f0 2020-11-20T12:14:51.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.452+0000 7ff3b5250700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff3b0152c30 con 0x7ff3b00664f0 2020-11-20T12:14:51.457 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.452+0000 7ff3b5250700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3b0152ed0 con 0x7ff3b014fc60 2020-11-20T12:14:51.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3af7fe700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7ff3b014fc60 0x7ff3b00606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3affff700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7ff3b00602f0 0x7ff3b014f550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40304/0 (socket says 172.21.15.93:40304) 2020-11-20T12:14:51.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3affff700 1 -- 172.21.15.93:0/1947089866 learned_addr learned my addr 172.21.15.93:0/1947089866 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:51.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3af7fe700 1 -- 172.21.15.93:0/1947089866 >> v1:172.21.15.132:6789/0 conn(0x7ff3b00664f0 legacy=0x7ff3b0066960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:51.458 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3af7fe700 1 -- 172.21.15.93:0/1947089866 >> v1:172.21.15.93:6789/0 conn(0x7ff3b00602f0 legacy=0x7ff3b014f550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3aeffd700 1 -- 172.21.15.93:0/1947089866 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2595933166 0 0) 0x7ff3b0152990 con 0x7ff3b00602f0 2020-11-20T12:14:51.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3af7fe700 1 -- 172.21.15.93:0/1947089866 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0153170 con 0x7ff3b014fc60 2020-11-20T12:14:51.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3af7fe700 1 --2- 172.21.15.93:0/1947089866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b014fc60 0x7ff3b00606d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff3a4006fd0 tx=0x7ff3a4006e30).ready entity=mon.1 client_cookie=86db9ea55daca091 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.459 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3aeffd700 1 -- 172.21.15.93:0/1947089866 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a40097e0 con 0x7ff3b014fc60 2020-11-20T12:14:51.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3aeffd700 1 -- 172.21.15.93:0/1947089866 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a4000e90 con 0x7ff3b014fc60 2020-11-20T12:14:51.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3aeffd700 1 -- 172.21.15.93:0/1947089866 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a4009b50 con 0x7ff3b014fc60 2020-11-20T12:14:51.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3b5250700 1 -- 172.21.15.93:0/1947089866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b014fc60 msgr2=0x7ff3b00606d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.453+0000 7ff3b5250700 1 --2- 172.21.15.93:0/1947089866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b014fc60 0x7ff3b00606d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7ff3a4006fd0 tx=0x7ff3a4006e30).stop 2020-11-20T12:14:51.460 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.454+0000 7ff3b5250700 1 -- 172.21.15.93:0/1947089866 shutdown_connections 2020-11-20T12:14:51.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.454+0000 7ff3b5250700 1 --2- 172.21.15.93:0/1947089866 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b014fc60 0x7ff3b00606d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.454+0000 7ff3b5250700 1 -- 172.21.15.93:0/1947089866 >> 172.21.15.93:0/1947089866 conn(0x7ff3b00c5590 msgr2=0x7ff3b00c59a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:51.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.454+0000 7ff3b5250700 1 -- 172.21.15.93:0/1947089866 shutdown_connections 2020-11-20T12:14:51.461 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.454+0000 7ff3b5250700 1 -- 172.21.15.93:0/1947089866 wait complete. 2020-11-20T12:14:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.455+0000 7ff3b5250700 1 Processor -- start 2020-11-20T12:14:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.455+0000 7ff3b5250700 1 -- start start 2020-11-20T12:14:51.464 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.455+0000 7ff3b5250700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3b00602f0 0x7ff3b0162800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b5250700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b00664f0 0x7ff3b014b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b5250700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b014fc60 0x7ff3b0148d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b5250700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b014c2d0 con 0x7ff3b014fc60 2020-11-20T12:14:51.465 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b5250700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b015fd60 con 0x7ff3b00664f0 2020-11-20T12:14:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b5250700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3b0110840 con 0x7ff3b00602f0 2020-11-20T12:14:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b00664f0 0x7ff3b014b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b00664f0 0x7ff3b014b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39614/0 (socket says 172.21.15.93:39614) 2020-11-20T12:14:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 -- 172.21.15.93:0/2212774513 learned_addr learned my addr 172.21.15.93:0/2212774513 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:51.466 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3affff700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3b00602f0 0x7ff3b0162800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 -- 172.21.15.93:0/2212774513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3b00602f0 msgr2=0x7ff3b0162800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3b00602f0 0x7ff3b0162800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 -- 172.21.15.93:0/2212774513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b014fc60 msgr2=0x7ff3b0148d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b4a4f700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b014fc60 0x7ff3b0148d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.467 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b014fc60 0x7ff3b0148d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 -- 172.21.15.93:0/2212774513 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3b0110aa0 con 0x7ff3b00664f0 2020-11-20T12:14:51.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b4a4f700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b014fc60 0x7ff3b0148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:51.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3af7fe700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b00664f0 0x7ff3b014b710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ff3a4010000 tx=0x7ff3a4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff38ffff700 1 -- 172.21.15.93:0/2212774513 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a401e460 con 0x7ff3b00664f0 2020-11-20T12:14:51.468 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff38ffff700 1 -- 172.21.15.93:0/2212774513 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3a401e5c0 con 0x7ff3b00664f0 2020-11-20T12:14:51.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3b0110d40 con 0x7ff3b00664f0 2020-11-20T12:14:51.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff38ffff700 1 -- 172.21.15.93:0/2212774513 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3a401e940 con 0x7ff3b00664f0 2020-11-20T12:14:51.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.456+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3b015ff90 con 0x7ff3b00664f0 2020-11-20T12:14:51.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.457+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3b0061960 con 0x7ff3b00664f0 2020-11-20T12:14:51.469 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.458+0000 7ff38ffff700 1 -- 172.21.15.93:0/2212774513 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7ff3a4025030 con 0x7ff3b00664f0 2020-11-20T12:14:51.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.458+0000 7ff38ffff700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff388080670 0x7ff388082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.458+0000 7ff3affff700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff388080670 0x7ff388082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.458+0000 7ff38ffff700 1 -- 172.21.15.93:0/2212774513 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7ff3a40a40e0 con 0x7ff3b00664f0 2020-11-20T12:14:51.470 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.459+0000 7ff3affff700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff388080670 0x7ff388082b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff3a00011e0 tx=0x7ff3a0009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.471 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.462+0000 7ff38ffff700 1 -- 172.21.15.93:0/2212774513 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7ff3a4078af0 con 0x7ff3b00664f0 2020-11-20T12:14:51.607 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.604+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff3b00bc140 con 0x7ff3b00664f0 2020-11-20T12:14:51.608 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.604+0000 7ff38ffff700 1 -- 172.21.15.93:0/2212774513 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7ff3a4023020 con 0x7ff3b00664f0 2020-11-20T12:14:51.608 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:51.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff388080670 msgr2=0x7ff388082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff388080670 0x7ff388082b30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7ff3a00011e0 tx=0x7ff3a0009040).stop 2020-11-20T12:14:51.609 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b00664f0 msgr2=0x7ff3b014b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b00664f0 0x7ff3b014b710 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7ff3a4010000 tx=0x7ff3a4015000).stop 2020-11-20T12:14:51.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 shutdown_connections 2020-11-20T12:14:51.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7ff388080670 0x7ff388082b30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.610 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7ff3b014fc60 0x7ff3b0148d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3b00602f0 0x7ff3b0162800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 --2- 172.21.15.93:0/2212774513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7ff3b00664f0 0x7ff3b014b710 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 >> 172.21.15.93:0/2212774513 conn(0x7ff3b00c5590 msgr2=0x7ff3b00be900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:51.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 shutdown_connections 2020-11-20T12:14:51.611 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.606+0000 7ff3b5250700 1 -- 172.21.15.93:0/2212774513 wait complete. 2020-11-20T12:14:51.621 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T12:14:51.730 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.727+0000 7f7be9bda700 1 Processor -- start 2020-11-20T12:14:51.731 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.727+0000 7f7be9bda700 1 -- start start 2020-11-20T12:14:51.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be9bda700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7be40c2870 0x7f7be4155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be9bda700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be4155a60 con 0x7f7be40bed70 2020-11-20T12:14:51.733 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be9bda700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be4151c40 con 0x7f7be40c2490 2020-11-20T12:14:51.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be9bda700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be4151ee0 con 0x7f7be40c2870 2020-11-20T12:14:51.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be3fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7be40c2870 0x7f7be4155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be3fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f7be40c2870 0x7f7be4155570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39624/0 (socket says 172.21.15.93:39624) 2020-11-20T12:14:51.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be37fe700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f7be40c2490 0x7f7be40c47d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40318/0 (socket says 172.21.15.93:40318) 2020-11-20T12:14:51.734 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.728+0000 7f7be3fff700 1 -- 172.21.15.93:0/2427619513 learned_addr learned my addr 172.21.15.93:0/2427619513 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:51.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be3fff700 1 -- 172.21.15.93:0/2427619513 >> v1:172.21.15.93:6789/0 conn(0x7f7be40c2490 legacy=0x7f7be40c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be3fff700 1 -- 172.21.15.93:0/2427619513 >> v1:172.21.15.66:6789/0 conn(0x7f7be40bed70 legacy=0x7f7be4150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be27fc700 1 -- 172.21.15.93:0/2427619513 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2085338215 0 0) 0x7f7be4151c40 con 0x7f7be40c2490 2020-11-20T12:14:51.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be3fff700 1 -- 172.21.15.93:0/2427619513 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4152180 con 0x7f7be40c2870 2020-11-20T12:14:51.735 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be3fff700 1 --2- 172.21.15.93:0/2427619513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2870 0x7f7be4155570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f7bdc009d90 tx=0x7f7bdc0092d0).ready entity=mon.1 client_cookie=35e4e090331395da server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be27fc700 1 -- 172.21.15.93:0/2427619513 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc00bbf0 con 0x7f7be40c2870 2020-11-20T12:14:51.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be27fc700 1 -- 172.21.15.93:0/2427619513 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc00bd50 con 0x7f7be40c2870 2020-11-20T12:14:51.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be27fc700 1 -- 172.21.15.93:0/2427619513 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bdc011610 con 0x7f7be40c2870 2020-11-20T12:14:51.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be9bda700 1 -- 172.21.15.93:0/2427619513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2870 msgr2=0x7f7be4155570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.736 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2427619513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2870 0x7f7be4155570 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f7bdc009d90 tx=0x7f7bdc0092d0).stop 2020-11-20T12:14:51.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be9bda700 1 -- 172.21.15.93:0/2427619513 shutdown_connections 2020-11-20T12:14:51.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2427619513 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2870 0x7f7be4155570 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be9bda700 1 -- 172.21.15.93:0/2427619513 >> 172.21.15.93:0/2427619513 conn(0x7f7be4060130 msgr2=0x7f7be4060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:51.737 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be9bda700 1 -- 172.21.15.93:0/2427619513 shutdown_connections 2020-11-20T12:14:51.738 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.729+0000 7f7be9bda700 1 -- 172.21.15.93:0/2427619513 wait complete. 2020-11-20T12:14:51.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 Processor -- start 2020-11-20T12:14:51.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 -- start start 2020-11-20T12:14:51.740 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be40bed70 0x7f7be414f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2490 0x7f7be40c7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be40c2870 0x7f7be40c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.741 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4154190 con 0x7f7be40c2870 2020-11-20T12:14:51.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4160830 con 0x7f7be40c2490 2020-11-20T12:14:51.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be9bda700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be4160ad0 con 0x7f7be40bed70 2020-11-20T12:14:51.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.731+0000 7f7be2ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2490 0x7f7be40c7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2490 0x7f7be40c7770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39628/0 (socket says 172.21.15.93:39628) 2020-11-20T12:14:51.742 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 -- 172.21.15.93:0/2191504250 learned_addr learned my addr 172.21.15.93:0/2191504250 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:51.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be3fff700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be40c2870 0x7f7be40c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be37fe700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be40bed70 0x7f7be414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 -- 172.21.15.93:0/2191504250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be40bed70 msgr2=0x7f7be414f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be40bed70 0x7f7be414f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.743 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 -- 172.21.15.93:0/2191504250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be40c2870 msgr2=0x7f7be40c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be40c2870 0x7f7be40c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 -- 172.21.15.93:0/2191504250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be4160d70 con 0x7f7be40c2490 2020-11-20T12:14:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be2ffd700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2490 0x7f7be40c7770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7bd8001eb0 tx=0x7f7bd8007c50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7bc37fe700 1 -- 172.21.15.93:0/2191504250 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800e4a0 con 0x7f7be40c2490 2020-11-20T12:14:51.744 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7bc37fe700 1 -- 172.21.15.93:0/2191504250 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd800e600 con 0x7f7be40c2490 2020-11-20T12:14:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be4161010 con 0x7f7be40c2490 2020-11-20T12:14:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7bc37fe700 1 -- 172.21.15.93:0/2191504250 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd800e9c0 con 0x7f7be40c2490 2020-11-20T12:14:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.732+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be4161550 con 0x7f7be40c2490 2020-11-20T12:14:51.745 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.733+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be405cd50 con 0x7f7be40c2490 2020-11-20T12:14:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.734+0000 7f7bc37fe700 1 -- 172.21.15.93:0/2191504250 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7bd8019030 con 0x7f7be40c2490 2020-11-20T12:14:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.734+0000 7f7bc37fe700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bbc080670 0x7f7bbc082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.734+0000 7f7bc37fe700 1 -- 172.21.15.93:0/2191504250 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f7bd80a1e60 con 0x7f7be40c2490 2020-11-20T12:14:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.734+0000 7f7be37fe700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bbc080670 0x7f7bbc082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:51.746 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.734+0000 7f7be37fe700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bbc080670 0x7f7bbc082b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7bd40011e0 tx=0x7f7bd4007a60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:51.747 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.737+0000 7f7bc37fe700 1 -- 172.21.15.93:0/2191504250 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7bd8076870 con 0x7f7be40c2490 2020-11-20T12:14:51.927 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.924+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7be40c1710 con 0x7f7be40c2490 2020-11-20T12:14:51.928 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.924+0000 7f7bc37fe700 1 -- 172.21.15.93:0/2191504250 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2480 (secure 0 0 0) 0x7f7bd8017030 con 0x7f7be40c2490 2020-11-20T12:14:51.928 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:51.928 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3224210757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3224210757},{"type":"v1","addr":"172.21.15.93:6835","nonce":3224210757}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/354762617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":354762617},{"type":"v1","addr":"172.21.15.66:6833","nonce":354762617}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T12:14:39.043063+0000","modified":"2020-11-20T12:14:41.045929+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4307":{"gid":4307,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/208815911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":208815911},{"type":"v1","addr":"172.21.15.132:6833","nonce":208815911}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T12:14:51.929 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bbc080670 msgr2=0x7f7bbc082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.930 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bbc080670 0x7f7bbc082b30 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f7bd40011e0 tx=0x7f7bd4007a60).stop 2020-11-20T12:14:51.930 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2490 msgr2=0x7f7be40c7770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:51.930 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2490 0x7f7be40c7770 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f7bd8001eb0 tx=0x7f7bd8007c50).stop 2020-11-20T12:14:51.930 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 shutdown_connections 2020-11-20T12:14:51.931 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bbc080670 0x7f7bbc082b30 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.931 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be40c2870 0x7f7be40c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.931 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be40bed70 0x7f7be414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.931 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 --2- 172.21.15.93:0/2191504250 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be40c2490 0x7f7be40c7770 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:51.931 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 >> 172.21.15.93:0/2191504250 conn(0x7f7be4060130 msgr2=0x7f7be40c0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:51.932 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 shutdown_connections 2020-11-20T12:14:51.932 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:51.926+0000 7f7be9bda700 1 -- 172.21.15.93:0/2191504250 wait complete. 2020-11-20T12:14:51.932 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 6 2020-11-20T12:14:52.244 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T12:14:39.043063+0000', 'modified': '2020-11-20T12:14:41.045929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4307}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4307': {'gid': 4307, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6833/208815911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6832', 'nonce': 208815911}, {'type': 'v1', 'addr': '172.21.15.132:6833', 'nonce': 208815911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T12:14:52.244 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T12:14:52.245 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-11-20T12:14:52.394 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","whoami":0,"id":4307,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":13.33737556,"mdsmap_epoch":6,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":19.731374148} 2020-11-20T12:14:52.395 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "c8cfafc9-773d-4a52-b4ca-518048ab7244", "fs_name": "cephfs", "id": 4307, "mdsmap_epoch": 6, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 13.33737556, "state": "up:active", "uptime": 19.731374148, "want_state": "up:active", "whoami": 0 } 2020-11-20T12:14:52.395 INFO:teuthology.run_tasks:Running task kclient... 2020-11-20T12:14:52.414 INFO:tasks.kclient:Mounting kernel clients... 2020-11-20T12:14:52.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:52.415 INFO:teuthology.orchestra.run.smithi093:> ip netns list 2020-11-20T12:14:52.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:52.434 INFO:teuthology.orchestra.run.smithi093:> sudo ip link delete ceph-brx 2020-11-20T12:14:52.507 INFO:teuthology.orchestra.run.smithi093.stderr:Cannot find device "ceph-brx" 2020-11-20T12:14:52.510 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-11-20T12:14:52.511 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2020-11-20T12:14:52.512 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi093.front.sepia.ceph.com 2020-11-20T12:14:52.513 INFO:tasks.cephfs.mount:self.client.name = client.0 2020-11-20T12:14:52.513 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:52.514 INFO:tasks.cephfs.mount:self.cephfs_name = None 2020-11-20T12:14:52.514 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2020-11-20T12:14:52.516 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2020-11-20T12:14:52.516 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2020-11-20T12:14:52.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:52.518 INFO:teuthology.orchestra.run.smithi093:> ip addr 2020-11-20T12:14:52.567 INFO:teuthology.orchestra.run.smithi093.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2020-11-20T12:14:52.568 INFO:teuthology.orchestra.run.smithi093.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2020-11-20T12:14:52.568 INFO:teuthology.orchestra.run.smithi093.stdout: inet 127.0.0.1/8 scope host lo 2020-11-20T12:14:52.568 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2020-11-20T12:14:52.568 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 ::1/128 scope host 2020-11-20T12:14:52.569 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2020-11-20T12:14:52.569 INFO:teuthology.orchestra.run.smithi093.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T12:14:52.569 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1c brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:52.569 INFO:teuthology.orchestra.run.smithi093.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T12:14:52.570 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:d8:da:1d brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:52.570 INFO:teuthology.orchestra.run.smithi093.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2020-11-20T12:14:52.570 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:34 brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:52.570 INFO:teuthology.orchestra.run.smithi093.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2020-11-20T12:14:52.570 INFO:teuthology.orchestra.run.smithi093.stdout: link/ether 0c:c4:7a:8f:d6:35 brd ff:ff:ff:ff:ff:ff 2020-11-20T12:14:52.571 INFO:teuthology.orchestra.run.smithi093.stdout: inet 172.21.15.93/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2020-11-20T12:14:52.571 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft 42771sec preferred_lft 42771sec 2020-11-20T12:14:52.571 INFO:teuthology.orchestra.run.smithi093.stdout: inet6 fe80::ec4:7aff:fe8f:d635/64 scope link 2020-11-20T12:14:52.571 INFO:teuthology.orchestra.run.smithi093.stdout: valid_lft forever preferred_lft forever 2020-11-20T12:14:52.572 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2020-11-20T12:14:52.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:52.573 INFO:teuthology.orchestra.run.smithi093:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:52.573 INFO:teuthology.orchestra.run.smithi093:> set -e 2020-11-20T12:14:52.573 INFO:teuthology.orchestra.run.smithi093:> sudo ip link add name ceph-brx type bridge 2020-11-20T12:14:52.574 INFO:teuthology.orchestra.run.smithi093:> sudo ip addr flush dev ceph-brx 2020-11-20T12:14:52.574 INFO:teuthology.orchestra.run.smithi093:> sudo ip link set ceph-brx up 2020-11-20T12:14:52.574 INFO:teuthology.orchestra.run.smithi093:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2020-11-20T12:14:52.575 INFO:teuthology.orchestra.run.smithi093:> ') 2020-11-20T12:14:52.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:52.725 INFO:teuthology.orchestra.run.smithi093:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2020-11-20T12:14:52.757 INFO:teuthology.orchestra.run.smithi093.stdout:1 2020-11-20T12:14:52.758 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:52.758 INFO:teuthology.orchestra.run.smithi093:> route 2020-11-20T12:14:52.832 INFO:teuthology.orchestra.run.smithi093.stdout:Kernel IP routing table 2020-11-20T12:14:52.833 INFO:teuthology.orchestra.run.smithi093.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2020-11-20T12:14:52.833 INFO:teuthology.orchestra.run.smithi093.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2020-11-20T12:14:52.833 INFO:teuthology.orchestra.run.smithi093.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2020-11-20T12:14:52.833 INFO:teuthology.orchestra.run.smithi093.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2020-11-20T12:14:52.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:52.834 INFO:teuthology.orchestra.run.smithi093:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:52.835 INFO:teuthology.orchestra.run.smithi093:> set -e 2020-11-20T12:14:52.835 INFO:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2020-11-20T12:14:52.835 INFO:teuthology.orchestra.run.smithi093:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2020-11-20T12:14:52.836 INFO:teuthology.orchestra.run.smithi093:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2020-11-20T12:14:52.836 INFO:teuthology.orchestra.run.smithi093:> ') 2020-11-20T12:14:53.073 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:53.074 INFO:teuthology.orchestra.run.smithi093:> ip netns list 2020-11-20T12:14:53.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:53.094 INFO:teuthology.orchestra.run.smithi093:> ip netns list-id 2020-11-20T12:14:53.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:53.151 INFO:teuthology.orchestra.run.smithi093:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:53.153 INFO:teuthology.orchestra.run.smithi093:> set -e 2020-11-20T12:14:53.154 INFO:teuthology.orchestra.run.smithi093:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2020-11-20T12:14:53.156 INFO:teuthology.orchestra.run.smithi093:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2020-11-20T12:14:53.157 INFO:teuthology.orchestra.run.smithi093:> ') 2020-11-20T12:14:53.244 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2020-11-20T12:14:53.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:53.245 INFO:teuthology.orchestra.run.smithi093:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:53.245 INFO:teuthology.orchestra.run.smithi093:> set -e 2020-11-20T12:14:53.245 INFO:teuthology.orchestra.run.smithi093:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2020-11-20T12:14:53.246 INFO:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2020-11-20T12:14:53.246 INFO:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2020-11-20T12:14:53.246 INFO:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2020-11-20T12:14:53.247 INFO:teuthology.orchestra.run.smithi093:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2020-11-20T12:14:53.247 INFO:teuthology.orchestra.run.smithi093:> ') 2020-11-20T12:14:53.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:53.476 INFO:teuthology.orchestra.run.smithi093:> (cd / && exec sudo bash -c ' 2020-11-20T12:14:53.476 INFO:teuthology.orchestra.run.smithi093:> set -e 2020-11-20T12:14:53.476 INFO:teuthology.orchestra.run.smithi093:> sudo ip link set brx.0 up 2020-11-20T12:14:53.477 INFO:teuthology.orchestra.run.smithi093:> sudo ip link set dev brx.0 master ceph-brx 2020-11-20T12:14:53.477 INFO:teuthology.orchestra.run.smithi093:> ') 2020-11-20T12:14:53.571 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2020-11-20T12:14:53.685 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.682+0000 7f7beee70700 1 Processor -- start 2020-11-20T12:14:53.686 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.682+0000 7f7beee70700 1 -- start start 2020-11-20T12:14:53.687 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7beee70700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7be80676b0 0x7f7be8151370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.687 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7beee70700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7be8151860 0x7f7be814dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.687 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7beee70700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7be80bdf60 con 0x7f7be8150f90 2020-11-20T12:14:53.688 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7beee70700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be8067bf0 con 0x7f7be8151860 2020-11-20T12:14:53.688 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7beee70700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7be8067e90 con 0x7f7be80676b0 2020-11-20T12:14:53.688 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7be7fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7be80676b0 0x7f7be8151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.688 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7bed40d700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f7be8151860 0x7f7be814dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.688 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7be7fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7be80676b0 0x7f7be8151370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.93:51284/0 (socket says 172.21.15.93:51284) 2020-11-20T12:14:53.689 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.683+0000 7f7be7fff700 1 -- 172.21.15.93:0/962116851 learned_addr learned my addr 172.21.15.93:0/962116851 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:53.689 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be7fff700 1 -- 172.21.15.93:0/962116851 >> v2:172.21.15.66:3300/0 conn(0x7f7be8151860 msgr2=0x7f7be814dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:53.689 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be7fff700 1 --2- 172.21.15.93:0/962116851 >> v2:172.21.15.66:3300/0 conn(0x7f7be8151860 0x7f7be814dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.689 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be7fff700 1 -- 172.21.15.93:0/962116851 >> v1:172.21.15.66:6789/0 conn(0x7f7be8150f90 legacy=0x7f7be8062850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.689 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be7fff700 1 -- 172.21.15.93:0/962116851 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8068130 con 0x7f7be80676b0 2020-11-20T12:14:53.693 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be7fff700 1 --2- 172.21.15.93:0/962116851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be8151370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7be809c030 tx=0x7f7bd4006ef0).ready entity=mon.2 client_cookie=e36d354f1fdc9141 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:53.693 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be77fe700 1 -- 172.21.15.93:0/962116851 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400b860 con 0x7f7be80676b0 2020-11-20T12:14:53.693 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be77fe700 1 -- 172.21.15.93:0/962116851 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4000e90 con 0x7f7be80676b0 2020-11-20T12:14:53.694 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.684+0000 7f7be77fe700 1 -- 172.21.15.93:0/962116851 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd400bbd0 con 0x7f7be80676b0 2020-11-20T12:14:53.694 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 -- 172.21.15.93:0/962116851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 msgr2=0x7f7be8151370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.694 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 --2- 172.21.15.93:0/962116851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be8151370 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f7be809c030 tx=0x7f7bd4006ef0).stop 2020-11-20T12:14:53.694 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 -- 172.21.15.93:0/962116851 shutdown_connections 2020-11-20T12:14:53.694 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 --2- 172.21.15.93:0/962116851 >> v2:172.21.15.66:3300/0 conn(0x7f7be8151860 0x7f7be814dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.695 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 --2- 172.21.15.93:0/962116851 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be8151370 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.695 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 -- 172.21.15.93:0/962116851 >> 172.21.15.93:0/962116851 conn(0x7f7be8060bc0 msgr2=0x7f7be80c3520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:53.695 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 -- 172.21.15.93:0/962116851 shutdown_connections 2020-11-20T12:14:53.695 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.685+0000 7f7beee70700 1 -- 172.21.15.93:0/962116851 wait complete. 2020-11-20T12:14:53.696 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.686+0000 7f7beee70700 1 Processor -- start 2020-11-20T12:14:53.696 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.686+0000 7f7beee70700 1 -- start start 2020-11-20T12:14:53.696 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be813c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.696 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be8150f90 0x7f7be814de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.696 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be8151860 0x7f7be814e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8160d20 con 0x7f7be8151860 2020-11-20T12:14:53.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8160fc0 con 0x7f7be8150f90 2020-11-20T12:14:53.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8161260 con 0x7f7be80676b0 2020-11-20T12:14:53.697 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be8150f90 0x7f7be814de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be8150f90 0x7f7be814de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39642/0 (socket says 172.21.15.93:39642) 2020-11-20T12:14:53.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 -- 172.21.15.93:0/3506996616 learned_addr learned my addr 172.21.15.93:0/3506996616 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:53.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7bed40d700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be8151860 0x7f7be814e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7becc0c700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be813c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.698 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 -- 172.21.15.93:0/3506996616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 msgr2=0x7f7be813c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.699 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be813c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.699 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 -- 172.21.15.93:0/3506996616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be8151860 msgr2=0x7f7be814e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.699 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be8151860 0x7f7be814e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.699 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 -- 172.21.15.93:0/3506996616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7be8161500 con 0x7f7be8150f90 2020-11-20T12:14:53.699 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7becc0c700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be813c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:53.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be7fff700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be8150f90 0x7f7be814de40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7bd400c010 tx=0x7f7bd4016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:53.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be4ff9700 1 -- 172.21.15.93:0/3506996616 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd4011b70 con 0x7f7be8150f90 2020-11-20T12:14:53.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be4ff9700 1 -- 172.21.15.93:0/3506996616 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bd4011cd0 con 0x7f7be8150f90 2020-11-20T12:14:53.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be81617a0 con 0x7f7be8150f90 2020-11-20T12:14:53.700 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7be4ff9700 1 -- 172.21.15.93:0/3506996616 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bd401c690 con 0x7f7be8150f90 2020-11-20T12:14:53.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.687+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be813cbc0 con 0x7f7be8150f90 2020-11-20T12:14:53.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.688+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be813ce70 con 0x7f7be8150f90 2020-11-20T12:14:53.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.689+0000 7f7be4ff9700 1 -- 172.21.15.93:0/3506996616 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7bd4017040 con 0x7f7be8150f90 2020-11-20T12:14:53.701 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.690+0000 7f7be4ff9700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bc0080670 0x7f7bc0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.690+0000 7f7be4ff9700 1 -- 172.21.15.93:0/3506996616 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f7bd40a43c0 con 0x7f7be8150f90 2020-11-20T12:14:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.690+0000 7f7becc0c700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bc0080670 0x7f7bc0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.702 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.690+0000 7f7becc0c700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bc0080670 0x7f7bc0082b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7bdc007fd0 tx=0x7f7bdc009040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:53.703 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.693+0000 7f7be4ff9700 1 -- 172.21.15.93:0/3506996616 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7bd4078d50 con 0x7f7be8150f90 2020-11-20T12:14:53.836 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.833+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7be805cd50 con 0x7f7be8150f90 2020-11-20T12:14:53.837 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.834+0000 7f7be4ff9700 1 -- 172.21.15.93:0/3506996616 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+21747 (secure 0 0 0) 0x7f7bd4015030 con 0x7f7be8150f90 2020-11-20T12:14:53.837 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:53.837 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":28,"fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","created":"2020-11-20T12:14:15.799721+0000","modified":"2020-11-20T12:14:39.042820+0000","last_up_change":"2020-11-20T12:14:24.027731+0000","last_in_change":"2020-11-20T12:14:24.027731+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2020-11-20T12:14:19.052710+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2020-11-20T12:14:28.933013+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2020-11-20T12:14:33.975801+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2020-11-20T12:14:36.724824+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"d2c363e4-268b-4d95-888d-c6a61fc5cb16","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6802","nonce":23172},{"type":"v1","addr":"172.21.15.93:6803","nonce":23172}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6804","nonce":23172},{"type":"v1","addr":"172.21.15.93:6805","nonce":23172}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6811","nonce":23172},{"type":"v1","addr":"172.21.15.93:6813","nonce":23172}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6807","nonce":23172},{"type":"v1","addr":"172.21.15.93:6809","nonce":23172}]},"public_addr":"172.21.15.93:6803/23172","cluster_addr":"172.21.15.93:6805/23172","heartbeat_back_addr":"172.21.15.93:6813/23172","heartbeat_front_addr":"172.21.15.93:6809/23172","state":["exists","up"]},{"osd":1,"uuid":"12e02fba-6dfe-4adc-8945-d655124e5142","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6800","nonce":22843},{"type":"v1","addr":"172.21.15.66:6801","nonce":22843}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6802","nonce":22843},{"type":"v1","addr":"172.21.15.66:6803","nonce":22843}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6806","nonce":22843},{"type":"v1","addr":"172.21.15.66:6807","nonce":22843}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6804","nonce":22843},{"type":"v1","addr":"172.21.15.66:6805","nonce":22843}]},"public_addr":"172.21.15.66:6801/22843","cluster_addr":"172.21.15.66:6803/22843","heartbeat_back_addr":"172.21.15.66:6807/22843","heartbeat_front_addr":"172.21.15.66:6805/22843","state":["exists","up"]},{"osd":2,"uuid":"83f6f89f-569f-4dfe-880b-e88d6d993dc0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6805","nonce":23325},{"type":"v1","addr":"172.21.15.132:6807","nonce":23325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6809","nonce":23325},{"type":"v1","addr":"172.21.15.132:6811","nonce":23325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":23325},{"type":"v1","addr":"172.21.15.132:6815","nonce":23325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":23325},{"type":"v1","addr":"172.21.15.132:6813","nonce":23325}]},"public_addr":"172.21.15.132:6807/23325","cluster_addr":"172.21.15.132:6811/23325","heartbeat_back_addr":"172.21.15.132:6815/23325","heartbeat_front_addr":"172.21.15.132:6813/23325","state":["exists","up"]},{"osd":3,"uuid":"fa90cb08-95e5-499c-b684-6feeba97c8b3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6806","nonce":23173},{"type":"v1","addr":"172.21.15.93:6808","nonce":23173}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6810","nonce":23173},{"type":"v1","addr":"172.21.15.93:6812","nonce":23173}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6816","nonce":23173},{"type":"v1","addr":"172.21.15.93:6817","nonce":23173}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6814","nonce":23173},{"type":"v1","addr":"172.21.15.93:6815","nonce":23173}]},"public_addr":"172.21.15.93:6808/23173","cluster_addr":"172.21.15.93:6812/23173","heartbeat_back_addr":"172.21.15.93:6817/23173","heartbeat_front_addr":"172.21.15.93:6815/23173","state":["exists","up"]},{"osd":4,"uuid":"7c9773f0-38d6-4ab3-8d2f-6f2d887d1c12","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6808","nonce":22844},{"type":"v1","addr":"172.21.15.66:6809","nonce":22844}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6810","nonce":22844},{"type":"v1","addr":"172.21.15.66:6811","nonce":22844}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6814","nonce":22844},{"type":"v1","addr":"172.21.15.66:6815","nonce":22844}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6812","nonce":22844},{"type":"v1","addr":"172.21.15.66:6813","nonce":22844}]},"public_addr":"172.21.15.66:6809/22844","cluster_addr":"172.21.15.66:6811/22844","heartbeat_back_addr":"172.21.15.66:6815/22844","heartbeat_front_addr":"172.21.15.66:6813/22844","state":["exists","up"]},{"osd":5,"uuid":"edc6f7d0-4df0-4493-9122-6203686c3ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":23326},{"type":"v1","addr":"172.21.15.132:6801","nonce":23326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":23326},{"type":"v1","addr":"172.21.15.132:6803","nonce":23326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":23326},{"type":"v1","addr":"172.21.15.132:6810","nonce":23326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":23326},{"type":"v1","addr":"172.21.15.132:6806","nonce":23326}]},"public_addr":"172.21.15.132:6801/23326","cluster_addr":"172.21.15.132:6803/23326","heartbeat_back_addr":"172.21.15.132:6810/23326","heartbeat_front_addr":"172.21.15.132:6806/23326","state":["exists","up"]},{"osd":6,"uuid":"2a8fa279-a52a-444a-8346-c393fb303f9c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6826","nonce":23174},{"type":"v1","addr":"172.21.15.93:6827","nonce":23174}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6828","nonce":23174},{"type":"v1","addr":"172.21.15.93:6829","nonce":23174}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6832","nonce":23174},{"type":"v1","addr":"172.21.15.93:6833","nonce":23174}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6830","nonce":23174},{"type":"v1","addr":"172.21.15.93:6831","nonce":23174}]},"public_addr":"172.21.15.93:6827/23174","cluster_addr":"172.21.15.93:6829/23174","heartbeat_back_addr":"172.21.15.93:6833/23174","heartbeat_front_addr":"172.21.15.93:6831/23174","state":["exists","up"]},{"osd":7,"uuid":"b4ad2429-191b-4dd5-91f2-7cf116eecbbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6824","nonce":22845},{"type":"v1","addr":"172.21.15.66:6825","nonce":22845}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6826","nonce":22845},{"type":"v1","addr":"172.21.15.66:6827","nonce":22845}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6830","nonce":22845},{"type":"v1","addr":"172.21.15.66:6831","nonce":22845}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6828","nonce":22845},{"type":"v1","addr":"172.21.15.66:6829","nonce":22845}]},"public_addr":"172.21.15.66:6825/22845","cluster_addr":"172.21.15.66:6827/22845","heartbeat_back_addr":"172.21.15.66:6831/22845","heartbeat_front_addr":"172.21.15.66:6829/22845","state":["exists","up"]},{"osd":8,"uuid":"4daadfa9-1117-4187-acfb-1372c3219ad4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":23327},{"type":"v1","addr":"172.21.15.132:6817","nonce":23327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":23327},{"type":"v1","addr":"172.21.15.132:6819","nonce":23327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":23327},{"type":"v1","addr":"172.21.15.132:6825","nonce":23327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6820","nonce":23327},{"type":"v1","addr":"172.21.15.132:6821","nonce":23327}]},"public_addr":"172.21.15.132:6817/23327","cluster_addr":"172.21.15.132:6819/23327","heartbeat_back_addr":"172.21.15.132:6825/23327","heartbeat_front_addr":"172.21.15.132:6821/23327","state":["exists","up"]},{"osd":9,"uuid":"dfe2ddc2-c164-4ac9-9ee4-c22e66f08cf1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6818","nonce":23175},{"type":"v1","addr":"172.21.15.93:6819","nonce":23175}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6820","nonce":23175},{"type":"v1","addr":"172.21.15.93:6821","nonce":23175}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6824","nonce":23175},{"type":"v1","addr":"172.21.15.93:6825","nonce":23175}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6822","nonce":23175},{"type":"v1","addr":"172.21.15.93:6823","nonce":23175}]},"public_addr":"172.21.15.93:6819/23175","cluster_addr":"172.21.15.93:6821/23175","heartbeat_back_addr":"172.21.15.93:6825/23175","heartbeat_front_addr":"172.21.15.93:6823/23175","state":["exists","up"]},{"osd":10,"uuid":"fa0e6ec4-a5cb-4c10-bf34-6e43d80f1904","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6816","nonce":22848},{"type":"v1","addr":"172.21.15.66:6817","nonce":22848}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6818","nonce":22848},{"type":"v1","addr":"172.21.15.66:6819","nonce":22848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6822","nonce":22848},{"type":"v1","addr":"172.21.15.66:6823","nonce":22848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6820","nonce":22848},{"type":"v1","addr":"172.21.15.66:6821","nonce":22848}]},"public_addr":"172.21.15.66:6817/22848","cluster_addr":"172.21.15.66:6819/22848","heartbeat_back_addr":"172.21.15.66:6823/22848","heartbeat_front_addr":"172.21.15.66:6821/22848","state":["exists","up"]},{"osd":11,"uuid":"3432a17e-4237-43a6-b105-1d2839995444","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":17,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":23328},{"type":"v1","addr":"172.21.15.132:6824","nonce":23328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":23328},{"type":"v1","addr":"172.21.15.132:6827","nonce":23328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":23328},{"type":"v1","addr":"172.21.15.132:6831","nonce":23328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6828","nonce":23328},{"type":"v1","addr":"172.21.15.132:6829","nonce":23328}]},"public_addr":"172.21.15.132:6824/23328","cluster_addr":"172.21.15.132:6827/23328","heartbeat_back_addr":"172.21.15.132:6831/23328","heartbeat_front_addr":"172.21.15.132:6829/23328","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.540067+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.556842+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.623328+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.581734+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.602412+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.609503+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.630612+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.665500+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.586766+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.573230+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.645292+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138297136906239,"old_weight":0,"last_purged_snaps_scrub":"2020-11-20T12:14:22.604508+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2020-11-20T12:14:53.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bc0080670 msgr2=0x7f7bc0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bc0080670 0x7f7bc0082b30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f7bdc007fd0 tx=0x7f7bdc009040).stop 2020-11-20T12:14:53.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be8150f90 msgr2=0x7f7be814de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.839 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be8150f90 0x7f7be814de40 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f7bd400c010 tx=0x7f7bd4016000).stop 2020-11-20T12:14:53.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 shutdown_connections 2020-11-20T12:14:53.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f7bc0080670 0x7f7bc0082b30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f7be8151860 0x7f7be814e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7be80676b0 0x7f7be813c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.840 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 --2- 172.21.15.93:0/3506996616 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f7be8150f90 0x7f7be814de40 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.835+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 >> 172.21.15.93:0/3506996616 conn(0x7f7be8060bc0 msgr2=0x7f7be814c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:53.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.836+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 shutdown_connections 2020-11-20T12:14:53.841 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.836+0000 7f7beee70700 1 -- 172.21.15.93:0/3506996616 wait complete. 2020-11-20T12:14:53.850 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2020-11-20T12:14:19.052710+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2020-11-20T12:14:28.933013+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2020-11-20T12:14:33.975801+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2020-11-20T12:14:36.724824+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2020-11-20T12:14:53.851 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2020-11-20T12:14:53.964 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.961+0000 7f329bf55700 1 Processor -- start 2020-11-20T12:14:53.965 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.961+0000 7f329bf55700 1 -- start start 2020-11-20T12:14:53.973 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.962+0000 7f329bf55700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3294151990 con 0x7f329414ec00 2020-11-20T12:14:53.973 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.962+0000 7f329bf55700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32940c2620 con 0x7f329414efe0 2020-11-20T12:14:53.973 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.962+0000 7f329bf55700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32940c28c0 con 0x7f32940bf5e0 2020-11-20T12:14:53.974 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.962+0000 7f32994f0700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f329414efe0 0x7f3294151dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40346/0 (socket says 172.21.15.93:40346) 2020-11-20T12:14:53.974 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.962+0000 7f32994f0700 1 -- 172.21.15.93:0/1754231484 learned_addr learned my addr 172.21.15.93:0/1754231484 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:53.974 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.962+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012666181 0 0) 0x7f32940c2620 con 0x7f329414efe0 2020-11-20T12:14:53.975 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.962+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f327c003280 con 0x7f329414efe0 2020-11-20T12:14:53.975 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 670774945 0 0) 0x7f3294151990 con 0x7f329414ec00 2020-11-20T12:14:53.975 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32940c2620 con 0x7f329414ec00 2020-11-20T12:14:53.976 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1227606714 0 0) 0x7f32940c28c0 con 0x7f32940bf5e0 2020-11-20T12:14:53.976 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3294151990 con 0x7f32940bf5e0 2020-11-20T12:14:53.976 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3189077827 0 0) 0x7f327c003280 con 0x7f329414efe0 2020-11-20T12:14:53.977 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 >> v1:172.21.15.132:6789/0 conn(0x7f32940bf5e0 legacy=0x7f32940c4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.977 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 >> v1:172.21.15.66:6789/0 conn(0x7f329414ec00 legacy=0x7f32940beed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.977 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 --> v1:172.21.15.93:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32940c2b60 con 0x7f329414efe0 2020-11-20T12:14:53.977 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.1 v1:172.21.15.93:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2479127578 0 0) 0x7f3284001520 con 0x7f329414efe0 2020-11-20T12:14:53.978 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 >> v1:172.21.15.93:6789/0 conn(0x7f329414efe0 legacy=0x7f3294151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.978 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c003b60 0x7f327c003f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.978 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f327c0045c0 0x7f327c004a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f327c005020 0x7f327c00b770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00bd30 con 0x7f327c003b60 2020-11-20T12:14:53.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00bea0 con 0x7f327c0045c0 2020-11-20T12:14:53.979 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327c00c060 con 0x7f327c005020 2020-11-20T12:14:53.980 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f32994f0700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f327c0045c0 0x7f327c004a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.980 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3299cf1700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c003b60 0x7f327c003f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.980 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f329a4f2700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f327c005020 0x7f327c00b770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.981 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f32994f0700 1 -- 172.21.15.93:0/1754231484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f327c005020 msgr2=0x7f327c00b770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:53.981 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f32994f0700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f327c005020 0x7f327c00b770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.981 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f32994f0700 1 -- 172.21.15.93:0/1754231484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c003b60 msgr2=0x7f327c003f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:53.982 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f32994f0700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c003b60 0x7f327c003f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.982 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f32994f0700 1 -- 172.21.15.93:0/1754231484 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c003280 con 0x7f327c0045c0 2020-11-20T12:14:53.982 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f329a4f2700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f327c005020 0x7f327c00b770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:53.982 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f329a4f2700 1 -- 172.21.15.93:0/1754231484 reap_dead start 2020-11-20T12:14:53.983 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f32994f0700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f327c0045c0 0x7f327c004a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f328400c440 tx=0x7f32840077c0).ready entity=mon.1 client_cookie=3ab22780a1b72dcc server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:53.983 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840070d0 con 0x7f327c0045c0 2020-11-20T12:14:53.983 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284007230 con 0x7f327c0045c0 2020-11-20T12:14:53.984 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.963+0000 7f3298cef700 1 -- 172.21.15.93:0/1754231484 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284005630 con 0x7f327c0045c0 2020-11-20T12:14:53.984 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.964+0000 7f329bf55700 1 -- 172.21.15.93:0/1754231484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f327c0045c0 msgr2=0x7f327c004a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.984 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.964+0000 7f329bf55700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f327c0045c0 0x7f327c004a40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f328400c440 tx=0x7f32840077c0).stop 2020-11-20T12:14:53.985 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.964+0000 7f329bf55700 1 -- 172.21.15.93:0/1754231484 shutdown_connections 2020-11-20T12:14:53.985 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.964+0000 7f329bf55700 1 --2- 172.21.15.93:0/1754231484 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f327c0045c0 0x7f327c004a40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.985 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.964+0000 7f329bf55700 1 -- 172.21.15.93:0/1754231484 >> 172.21.15.93:0/1754231484 conn(0x7f3294060130 msgr2=0x7f3294060540 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:53.985 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.964+0000 7f329bf55700 1 -- 172.21.15.93:0/1754231484 shutdown_connections 2020-11-20T12:14:53.986 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.964+0000 7f329bf55700 1 -- 172.21.15.93:0/1754231484 wait complete. 2020-11-20T12:14:53.986 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.965+0000 7f329bf55700 1 Processor -- start 2020-11-20T12:14:53.986 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.965+0000 7f329bf55700 1 -- start start 2020-11-20T12:14:53.987 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329bf55700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c0045c0 0x7f3294165100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.987 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329bf55700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32940c6f40 0x7f3294152c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.987 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329bf55700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3294153170 0x7f329414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.988 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329bf55700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3294142ea0 con 0x7f327c0045c0 2020-11-20T12:14:53.988 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329bf55700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32940c0220 con 0x7f32940c6f40 2020-11-20T12:14:53.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329bf55700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32941613c0 con 0x7f3294153170 2020-11-20T12:14:53.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32940c6f40 0x7f3294152c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.989 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32940c6f40 0x7f3294152c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39660/0 (socket says 172.21.15.93:39660) 2020-11-20T12:14:53.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 -- 172.21.15.93:0/2543603245 learned_addr learned my addr 172.21.15.93:0/2543603245 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:53.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f3299cf1700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c0045c0 0x7f3294165100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329a4f2700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3294153170 0x7f329414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.990 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 -- 172.21.15.93:0/2543603245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3294153170 msgr2=0x7f329414b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3294153170 0x7f329414b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 -- 172.21.15.93:0/2543603245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c0045c0 msgr2=0x7f3294165100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:53.991 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c0045c0 0x7f3294165100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:53.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 -- 172.21.15.93:0/2543603245 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3294161660 con 0x7f32940c6f40 2020-11-20T12:14:53.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f32994f0700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32940c6f40 0x7f3294152c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f327c00c030 tx=0x7f3284015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:53.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f3281ffb700 1 -- 172.21.15.93:0/2543603245 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32840073a0 con 0x7f32940c6f40 2020-11-20T12:14:53.992 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3294161900 con 0x7f32940c6f40 2020-11-20T12:14:53.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f3281ffb700 1 -- 172.21.15.93:0/2543603245 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3284001420 con 0x7f32940c6f40 2020-11-20T12:14:53.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.966+0000 7f3281ffb700 1 -- 172.21.15.93:0/2543603245 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3284005260 con 0x7f32940c6f40 2020-11-20T12:14:53.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.967+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3294161e40 con 0x7f32940c6f40 2020-11-20T12:14:53.993 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.967+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3294061a40 con 0x7f32940c6f40 2020-11-20T12:14:53.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.968+0000 7f3281ffb700 1 -- 172.21.15.93:0/2543603245 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f3284026070 con 0x7f32940c6f40 2020-11-20T12:14:53.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.969+0000 7f3281ffb700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f326c0806a0 0x7f326c082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:53.994 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.969+0000 7f3281ffb700 1 -- 172.21.15.93:0/2543603245 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f32840a2fd0 con 0x7f32940c6f40 2020-11-20T12:14:53.995 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.969+0000 7f3299cf1700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f326c0806a0 0x7f326c082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:53.995 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.969+0000 7f3299cf1700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f326c0806a0 0x7f326c082b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3290007fd0 tx=0x7f3290007bb0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:53.996 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:53.972+0000 7f3281ffb700 1 -- 172.21.15.93:0/2543603245 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f3284077a70 con 0x7f32940c6f40 2020-11-20T12:14:54.115 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.112+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3294150620 con 0x7f32940c6f40 2020-11-20T12:14:54.115 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.112+0000 7f3281ffb700 1 -- 172.21.15.93:0/2543603245 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v28) v1 ==== 110+0+10 (secure 0 0 0) 0x7f328401a030 con 0x7f32940c6f40 2020-11-20T12:14:54.115 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 1 2020-11-20T12:14:54.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f326c0806a0 msgr2=0x7f326c082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f326c0806a0 0x7f326c082b60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f3290007fd0 tx=0x7f3290007bb0).stop 2020-11-20T12:14:54.117 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32940c6f40 msgr2=0x7f3294152c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32940c6f40 0x7f3294152c80 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f327c00c030 tx=0x7f3284015000).stop 2020-11-20T12:14:54.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 shutdown_connections 2020-11-20T12:14:54.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3294153170 0x7f329414b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f326c0806a0 0x7f326c082b60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.118 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f327c0045c0 0x7f3294165100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 --2- 172.21.15.93:0/2543603245 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f32940c6f40 0x7f3294152c80 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 >> 172.21.15.93:0/2543603245 conn(0x7f3294060130 msgr2=0x7f3294067d20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:54.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 shutdown_connections 2020-11-20T12:14:54.119 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.114+0000 7f329bf55700 1 -- 172.21.15.93:0/2543603245 wait complete. 2020-11-20T12:14:54.128 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2020-11-20T12:14:54.239 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.236+0000 7f56f759e700 1 Processor -- start 2020-11-20T12:14:54.240 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.236+0000 7f56f759e700 1 -- start start 2020-11-20T12:14:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f759e700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56f80602f0 0x7f56f80606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f759e700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f56f8068580 0x7f56f80c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f759e700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f56f80c2620 0x7f56f8064130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.242 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f759e700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f8067660 con 0x7f56f8068580 2020-11-20T12:14:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f759e700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f8067900 con 0x7f56f80c2620 2020-11-20T12:14:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f759e700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56f8067ba0 con 0x7f56f80602f0 2020-11-20T12:14:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f6d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f56f80c2620 0x7f56f8064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.243 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f6d9d700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7f56f80c2620 0x7f56f8064130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39670/0 (socket says 172.21.15.93:39670) 2020-11-20T12:14:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56f6d9d700 1 -- 172.21.15.93:0/1884079723 learned_addr learned my addr 172.21.15.93:0/1884079723 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.237+0000 7f56effff700 1 --2- 172.21.15.93:0/1884079723 >> v2:172.21.15.66:3300/0 conn(0x7f56f8068580 0x7f56f80c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f659c700 1 --2- 172.21.15.93:0/1884079723 >> v2:172.21.15.132:3300/0 conn(0x7f56f80602f0 0x7f56f80606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f6d9d700 1 -- 172.21.15.93:0/1884079723 >> v2:172.21.15.132:3300/0 conn(0x7f56f80602f0 msgr2=0x7f56f80606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:54.244 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f6d9d700 1 --2- 172.21.15.93:0/1884079723 >> v2:172.21.15.132:3300/0 conn(0x7f56f80602f0 0x7f56f80606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.245 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f6d9d700 1 -- 172.21.15.93:0/1884079723 >> v2:172.21.15.66:3300/0 conn(0x7f56f8068580 msgr2=0x7f56f80c2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:54.245 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f6d9d700 1 --2- 172.21.15.93:0/1884079723 >> v2:172.21.15.66:3300/0 conn(0x7f56f8068580 0x7f56f80c2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.245 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f6d9d700 1 -- 172.21.15.93:0/1884079723 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f8067e40 con 0x7f56f80c2620 2020-11-20T12:14:54.245 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f6d9d700 1 --2- 172.21.15.93:0/1884079723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f8064130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f56f80633f0 tx=0x7f56f00092d0).ready entity=mon.1 client_cookie=63cfb75b24e03fee server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.245 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f5d9b700 1 -- 172.21.15.93:0/1884079723 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f000bbc0 con 0x7f56f80c2620 2020-11-20T12:14:54.246 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f5d9b700 1 -- 172.21.15.93:0/1884079723 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f000bd20 con 0x7f56f80c2620 2020-11-20T12:14:54.246 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f5d9b700 1 -- 172.21.15.93:0/1884079723 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f0011610 con 0x7f56f80c2620 2020-11-20T12:14:54.246 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 -- 172.21.15.93:0/1884079723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 msgr2=0x7f56f8064130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.246 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 --2- 172.21.15.93:0/1884079723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f8064130 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f56f80633f0 tx=0x7f56f00092d0).stop 2020-11-20T12:14:54.246 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 -- 172.21.15.93:0/1884079723 shutdown_connections 2020-11-20T12:14:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 --2- 172.21.15.93:0/1884079723 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f8064130 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 --2- 172.21.15.93:0/1884079723 >> v2:172.21.15.132:3300/0 conn(0x7f56f80602f0 0x7f56f80606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 --2- 172.21.15.93:0/1884079723 >> v2:172.21.15.66:3300/0 conn(0x7f56f8068580 0x7f56f80c2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 -- 172.21.15.93:0/1884079723 >> 172.21.15.93:0/1884079723 conn(0x7f56f80c7790 msgr2=0x7f56f80c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:54.247 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 -- 172.21.15.93:0/1884079723 shutdown_connections 2020-11-20T12:14:54.248 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.238+0000 7f56f759e700 1 -- 172.21.15.93:0/1884079723 wait complete. 2020-11-20T12:14:54.250 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.239+0000 7f56f759e700 1 Processor -- start 2020-11-20T12:14:54.250 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.239+0000 7f56f759e700 1 -- start start 2020-11-20T12:14:54.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f759e700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f80602f0 0x7f56f81643a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f759e700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56f8068580 0x7f56f8160e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f759e700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f80c1830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f759e700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f8161320 con 0x7f56f8068580 2020-11-20T12:14:54.251 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f759e700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80be2a0 con 0x7f56f80c2620 2020-11-20T12:14:54.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f759e700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f80b2f20 con 0x7f56f80602f0 2020-11-20T12:14:54.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f6d9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f80c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f6d9d700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f80c1830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39674/0 (socket says 172.21.15.93:39674) 2020-11-20T12:14:54.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f6d9d700 1 -- 172.21.15.93:0/3971355906 learned_addr learned my addr 172.21.15.93:0/3971355906 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:54.252 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56f659c700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f80602f0 0x7f56f81643a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.253 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.240+0000 7f56effff700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56f8068580 0x7f56f8160e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.253 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f6d9d700 1 -- 172.21.15.93:0/3971355906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f80602f0 msgr2=0x7f56f81643a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.253 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f6d9d700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f80602f0 0x7f56f81643a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.253 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f6d9d700 1 -- 172.21.15.93:0/3971355906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56f8068580 msgr2=0x7f56f8160e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.254 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f6d9d700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56f8068580 0x7f56f8160e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.254 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f6d9d700 1 -- 172.21.15.93:0/3971355906 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f80b31c0 con 0x7f56f80c2620 2020-11-20T12:14:54.254 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f6d9d700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f80c1830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f56f8044cc0 tx=0x7f56f0016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.254 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56ee7fc700 1 -- 172.21.15.93:0/3971355906 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f001b5e0 con 0x7f56f80c2620 2020-11-20T12:14:54.254 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56ee7fc700 1 -- 172.21.15.93:0/3971355906 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f001b740 con 0x7f56f80c2620 2020-11-20T12:14:54.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f80b3460 con 0x7f56f80c2620 2020-11-20T12:14:54.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56ee7fc700 1 -- 172.21.15.93:0/3971355906 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f001bac0 con 0x7f56f80c2620 2020-11-20T12:14:54.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.241+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f8163c60 con 0x7f56f80c2620 2020-11-20T12:14:54.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.242+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f8061760 con 0x7f56f80c2620 2020-11-20T12:14:54.255 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.242+0000 7f56ee7fc700 1 -- 172.21.15.93:0/3971355906 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f56f0017070 con 0x7f56f80c2620 2020-11-20T12:14:54.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.243+0000 7f56ee7fc700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f56d40806a0 0x7f56d4082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.243+0000 7f56ee7fc700 1 -- 172.21.15.93:0/3971355906 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f56f00a4a50 con 0x7f56f80c2620 2020-11-20T12:14:54.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.243+0000 7f56f659c700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f56d40806a0 0x7f56d4082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.243+0000 7f56f659c700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f56d40806a0 0x7f56d4082b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f56e800ba40 tx=0x7f56e8008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.256 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.246+0000 7f56ee7fc700 1 -- 172.21.15.93:0/3971355906 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f56f0079460 con 0x7f56f80c2620 2020-11-20T12:14:54.387 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.384+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f56f8069c70 con 0x7f56f80c2620 2020-11-20T12:14:54.388 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.384+0000 7f56ee7fc700 1 -- 172.21.15.93:0/3971355906 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v28) v1 ==== 92+0+10 (secure 0 0 0) 0x7f56f0015030 con 0x7f56f80c2620 2020-11-20T12:14:54.388 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:54.389 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f56d40806a0 msgr2=0x7f56d4082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.389 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f56d40806a0 0x7f56d4082b60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f56e800ba40 tx=0x7f56e8008040).stop 2020-11-20T12:14:54.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 msgr2=0x7f56f80c1830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f80c1830 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f56f8044cc0 tx=0x7f56f0016000).stop 2020-11-20T12:14:54.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 shutdown_connections 2020-11-20T12:14:54.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f56f80c2620 0x7f56f80c1830 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.390 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56f80602f0 0x7f56f81643a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f56d40806a0 0x7f56d4082b60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 --2- 172.21.15.93:0/3971355906 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f56f8068580 0x7f56f8160e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 >> 172.21.15.93:0/3971355906 conn(0x7f56f80c7790 msgr2=0x7f56f814d570 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 shutdown_connections 2020-11-20T12:14:54.391 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.386+0000 7f56f759e700 1 -- 172.21.15.93:0/3971355906 wait complete. 2020-11-20T12:14:54.400 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2020-11-20T12:14:54.512 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 Processor -- start 2020-11-20T12:14:54.512 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 -- start start 2020-11-20T12:14:54.515 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7fcbd40602f0 0x7fcbd40606d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.515 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcbd4068580 0x7fcbd40c2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.515 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcbd40c2620 0x7fcbd4064130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.515 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd4067660 con 0x7fcbd40602f0 2020-11-20T12:14:54.516 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 -- --> v2:172.21.15.93:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd4067900 con 0x7fcbd4068580 2020-11-20T12:14:54.516 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.509+0000 7fcbd3fff700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd4067ba0 con 0x7fcbd40c2620 2020-11-20T12:14:54.516 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcbd4068580 0x7fcbd40c2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.516 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 --2- >> v2:172.21.15.93:3300/0 conn(0x7fcbd4068580 0x7fcbd40c2130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39684/0 (socket says 172.21.15.93:39684) 2020-11-20T12:14:54.517 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 -- 172.21.15.93:0/3210821670 learned_addr learned my addr 172.21.15.93:0/3210821670 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:54.517 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbd2ffd700 1 --2- 172.21.15.93:0/3210821670 >> v2:172.21.15.66:3300/0 conn(0x7fcbd40602f0 0x7fcbd40606d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.517 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbd37fe700 1 --2- 172.21.15.93:0/3210821670 >> v2:172.21.15.132:3300/0 conn(0x7fcbd40c2620 0x7fcbd4064130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.517 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 -- 172.21.15.93:0/3210821670 >> v2:172.21.15.132:3300/0 conn(0x7fcbd40c2620 msgr2=0x7fcbd4064130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:54.517 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 --2- 172.21.15.93:0/3210821670 >> v2:172.21.15.132:3300/0 conn(0x7fcbd40c2620 0x7fcbd4064130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.518 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 -- 172.21.15.93:0/3210821670 >> v2:172.21.15.66:3300/0 conn(0x7fcbd40602f0 msgr2=0x7fcbd40606d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-11-20T12:14:54.518 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 --2- 172.21.15.93:0/3210821670 >> v2:172.21.15.66:3300/0 conn(0x7fcbd40602f0 0x7fcbd40606d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.518 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 -- 172.21.15.93:0/3210821670 --> v2:172.21.15.93:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4067e40 con 0x7fcbd4068580 2020-11-20T12:14:54.519 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbcbfff700 1 --2- 172.21.15.93:0/3210821670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd4068580 0x7fcbd40c2130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fcbd4060bc0 tx=0x7fcbbc006e90).ready entity=mon.1 client_cookie=6885973693004cb6 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.519 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbd27fc700 1 -- 172.21.15.93:0/3210821670 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc006030 con 0x7fcbd4068580 2020-11-20T12:14:54.519 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbd27fc700 1 -- 172.21.15.93:0/3210821670 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbbc006190 con 0x7fcbd4068580 2020-11-20T12:14:54.519 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.510+0000 7fcbd27fc700 1 -- 172.21.15.93:0/3210821670 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbbc006510 con 0x7fcbd4068580 2020-11-20T12:14:54.519 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 -- 172.21.15.93:0/3210821670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd4068580 msgr2=0x7fcbd40c2130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.520 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/3210821670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd4068580 0x7fcbd40c2130 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fcbd4060bc0 tx=0x7fcbbc006e90).stop 2020-11-20T12:14:54.520 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 -- 172.21.15.93:0/3210821670 shutdown_connections 2020-11-20T12:14:54.520 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/3210821670 >> v2:172.21.15.132:3300/0 conn(0x7fcbd40c2620 0x7fcbd4064130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.520 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/3210821670 >> v2:172.21.15.66:3300/0 conn(0x7fcbd40602f0 0x7fcbd40606d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/3210821670 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd4068580 0x7fcbd40c2130 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 -- 172.21.15.93:0/3210821670 >> 172.21.15.93:0/3210821670 conn(0x7fcbd40c7790 msgr2=0x7fcbd40c7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:54.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 -- 172.21.15.93:0/3210821670 shutdown_connections 2020-11-20T12:14:54.521 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.511+0000 7fcbd3fff700 1 -- 172.21.15.93:0/3210821670 wait complete. 2020-11-20T12:14:54.522 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.512+0000 7fcbd3fff700 1 Processor -- start 2020-11-20T12:14:54.522 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.512+0000 7fcbd3fff700 1 -- start start 2020-11-20T12:14:54.524 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd40602f0 0x7fcbd40c6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd4068580 0x7fcbd40bf6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd40c2620 0x7fcbd40bfbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd41618b0 con 0x7fcbd4068580 2020-11-20T12:14:54.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4164d80 con 0x7fcbd40c2620 2020-11-20T12:14:54.525 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4160990 con 0x7fcbd40602f0 2020-11-20T12:14:54.526 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd40c2620 0x7fcbd40bfbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.526 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd40c2620 0x7fcbd40bfbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39690/0 (socket says 172.21.15.93:39690) 2020-11-20T12:14:54.526 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 -- 172.21.15.93:0/390643165 learned_addr learned my addr 172.21.15.93:0/390643165 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:54.527 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbcbfff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd4068580 0x7fcbd40bf6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.527 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd2ffd700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd40602f0 0x7fcbd40c6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.527 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 -- 172.21.15.93:0/390643165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd40602f0 msgr2=0x7fcbd40c6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.527 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd40602f0 0x7fcbd40c6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.527 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 -- 172.21.15.93:0/390643165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd4068580 msgr2=0x7fcbd40bf6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.528 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd4068580 0x7fcbd40bf6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.528 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 -- 172.21.15.93:0/390643165 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4160c30 con 0x7fcbd40c2620 2020-11-20T12:14:54.528 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd2ffd700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd40602f0 0x7fcbd40c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2020-11-20T12:14:54.528 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbcbfff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd4068580 0x7fcbd40bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:54.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd37fe700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd40c2620 0x7fcbd40bfbd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcbcc00db90 tx=0x7fcbcc008040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbcaffd700 1 -- 172.21.15.93:0/390643165 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc017070 con 0x7fcbd40c2620 2020-11-20T12:14:54.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbcaffd700 1 -- 172.21.15.93:0/390643165 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc00b910 con 0x7fcbd40c2620 2020-11-20T12:14:54.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd4160ed0 con 0x7fcbd40c2620 2020-11-20T12:14:54.529 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbcaffd700 1 -- 172.21.15.93:0/390643165 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc00bcb0 con 0x7fcbd40c2620 2020-11-20T12:14:54.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.513+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd4161410 con 0x7fcbd40c2620 2020-11-20T12:14:54.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.514+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd41546b0 con 0x7fcbd40c2620 2020-11-20T12:14:54.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.515+0000 7fcbcaffd700 1 -- 172.21.15.93:0/390643165 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7fcbcc013690 con 0x7fcbd40c2620 2020-11-20T12:14:54.530 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.515+0000 7fcbcaffd700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fcbb0080670 0x7fcbb0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.515+0000 7fcbcaffd700 1 -- 172.21.15.93:0/390643165 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7fcbcc0a2d00 con 0x7fcbd40c2620 2020-11-20T12:14:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.515+0000 7fcbd2ffd700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fcbb0080670 0x7fcbb0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.516+0000 7fcbd2ffd700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fcbb0080670 0x7fcbb0082b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcbc4006c10 tx=0x7fcbc4008040).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.531 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.519+0000 7fcbcaffd700 1 -- 172.21.15.93:0/390643165 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7fcbcc077690 con 0x7fcbd40c2620 2020-11-20T12:14:54.666 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.663+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcbd4061760 con 0x7fcbd40c2620 2020-11-20T12:14:54.667 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.663+0000 7fcbcaffd700 1 -- 172.21.15.93:0/390643165 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v28) v1 ==== 104+0+10 (secure 0 0 0) 0x7fcbcc07acb0 con 0x7fcbd40c2620 2020-11-20T12:14:54.667 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:54.668 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fcbb0080670 msgr2=0x7fcbb0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fcbb0080670 0x7fcbb0082b30 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fcbc4006c10 tx=0x7fcbc4008040).stop 2020-11-20T12:14:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd40c2620 msgr2=0x7fcbd40bfbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.669 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd40c2620 0x7fcbd40bfbd0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fcbcc00db90 tx=0x7fcbcc008040).stop 2020-11-20T12:14:54.670 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 shutdown_connections 2020-11-20T12:14:54.670 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7fcbd40c2620 0x7fcbd40bfbd0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.670 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbd40602f0 0x7fcbd40c6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7fcbb0080670 0x7fcbb0082b30 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 --2- 172.21.15.93:0/390643165 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7fcbd4068580 0x7fcbd40bf6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 >> 172.21.15.93:0/390643165 conn(0x7fcbd40c7790 msgr2=0x7fcbd414ec40 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:54.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 shutdown_connections 2020-11-20T12:14:54.671 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.665+0000 7fcbd3fff700 1 -- 172.21.15.93:0/390643165 wait complete. 2020-11-20T12:14:54.680 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2020-11-20T12:14:54.791 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.788+0000 7f71512da700 1 Processor -- start 2020-11-20T12:14:54.792 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.788+0000 7f71512da700 1 -- start start 2020-11-20T12:14:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.789+0000 7f71512da700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f714c0c7de0 0x7f714c151800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.789+0000 7f71512da700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c0c4130 con 0x7f714c0c7a00 2020-11-20T12:14:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.789+0000 7f71512da700 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f714c151e60 con 0x7f714c065060 2020-11-20T12:14:54.795 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.789+0000 7f71512da700 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f714c0c4390 con 0x7f714c0c7de0 2020-11-20T12:14:54.796 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.789+0000 7f714b7fe700 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f714c0c7de0 0x7f714c151800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.796 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f7143fff700 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f714c065060 0x7f714c1510f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.93:37474/0 (socket says 172.21.15.93:37474) 2020-11-20T12:14:54.796 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f7143fff700 1 -- 172.21.15.93:0/2594041591 learned_addr learned my addr 172.21.15.93:0/2594041591 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:54.796 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714affd700 1 --1- 172.21.15.93:0/2594041591 >> v1:172.21.15.66:6789/0 conn(0x7f714c0c7a00 0x7f714c0677c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.66:6789/0 says I am v1:172.21.15.93:39926/0 (socket says 172.21.15.93:39926) 2020-11-20T12:14:54.797 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714a7fc700 1 -- 172.21.15.93:0/2594041591 <== mon.0 v1:172.21.15.66:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749474534 0 0) 0x7f714c0c4130 con 0x7f714c0c7a00 2020-11-20T12:14:54.797 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714a7fc700 1 -- 172.21.15.93:0/2594041591 --> v1:172.21.15.66:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f712c003280 con 0x7f714c0c7a00 2020-11-20T12:14:54.797 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714b7fe700 1 -- 172.21.15.93:0/2594041591 >> v1:172.21.15.132:6789/0 conn(0x7f714c065060 legacy=0x7f714c1510f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.797 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714a7fc700 1 -- 172.21.15.93:0/2594041591 <== mon.2 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3456483153 0 0) 0x7f714c151e60 con 0x7f714c065060 2020-11-20T12:14:54.797 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714b7fe700 1 -- 172.21.15.93:0/2594041591 >> v1:172.21.15.66:6789/0 conn(0x7f714c0c7a00 legacy=0x7f714c0677c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714b7fe700 1 -- 172.21.15.93:0/2594041591 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c0c4630 con 0x7f714c0c7de0 2020-11-20T12:14:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714b7fe700 1 --2- 172.21.15.93:0/2594041591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 0x7f714c151800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7144009ce0 tx=0x7f7144009220).ready entity=mon.2 client_cookie=f361c579e2544f0d server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714a7fc700 1 -- 172.21.15.93:0/2594041591 <== mon.2 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f714400ba40 con 0x7f714c0c7de0 2020-11-20T12:14:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714a7fc700 1 -- 172.21.15.93:0/2594041591 <== mon.2 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f714400bba0 con 0x7f714c0c7de0 2020-11-20T12:14:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.790+0000 7f714a7fc700 1 -- 172.21.15.93:0/2594041591 <== mon.2 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7144011400 con 0x7f714c0c7de0 2020-11-20T12:14:54.798 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.791+0000 7f71512da700 1 -- 172.21.15.93:0/2594041591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 msgr2=0x7f714c151800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.791+0000 7f71512da700 1 --2- 172.21.15.93:0/2594041591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 0x7f714c151800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f7144009ce0 tx=0x7f7144009220).stop 2020-11-20T12:14:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.791+0000 7f71512da700 1 -- 172.21.15.93:0/2594041591 shutdown_connections 2020-11-20T12:14:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.791+0000 7f71512da700 1 --2- 172.21.15.93:0/2594041591 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 0x7f714c151800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.799 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.791+0000 7f71512da700 1 -- 172.21.15.93:0/2594041591 >> 172.21.15.93:0/2594041591 conn(0x7f714c062480 msgr2=0x7f714c062890 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:54.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.791+0000 7f71512da700 1 -- 172.21.15.93:0/2594041591 shutdown_connections 2020-11-20T12:14:54.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.791+0000 7f71512da700 1 -- 172.21.15.93:0/2594041591 wait complete. 2020-11-20T12:14:54.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.792+0000 7f71512da700 1 Processor -- start 2020-11-20T12:14:54.800 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.792+0000 7f71512da700 1 -- start start 2020-11-20T12:14:54.803 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.792+0000 7f71512da700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714c065060 0x7f714c164110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.803 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f71512da700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f714c0c7a00 0x7f714c0c2740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.803 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f71512da700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 0x7f714c146840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.803 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f71512da700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c14a9b0 con 0x7f714c065060 2020-11-20T12:14:54.804 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f71512da700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c164600 con 0x7f714c0c7a00 2020-11-20T12:14:54.804 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f71512da700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f714c14bde0 con 0x7f714c0c7de0 2020-11-20T12:14:54.804 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f714c0c7a00 0x7f714c0c2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.804 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f714c0c7a00 0x7f714c0c2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39700/0 (socket says 172.21.15.93:39700) 2020-11-20T12:14:54.804 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 -- 172.21.15.93:0/1237803349 learned_addr learned my addr 172.21.15.93:0/1237803349 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:54.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f714affd700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714c065060 0x7f714c164110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f714b7fe700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 0x7f714c146840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 -- 172.21.15.93:0/1237803349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 msgr2=0x7f714c146840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.805 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 0x7f714c146840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 -- 172.21.15.93:0/1237803349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714c065060 msgr2=0x7f714c164110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714c065060 0x7f714c164110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 -- 172.21.15.93:0/1237803349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f714c149400 con 0x7f714c0c7a00 2020-11-20T12:14:54.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7143fff700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f714c0c7a00 0x7f714c0c2740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f713400c720 tx=0x7f7134007ac0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.806 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7142ffd700 1 -- 172.21.15.93:0/1237803349 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71340072e0 con 0x7f714c0c7a00 2020-11-20T12:14:54.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7142ffd700 1 -- 172.21.15.93:0/1237803349 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7134007440 con 0x7f714c0c7a00 2020-11-20T12:14:54.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f714c14aba0 con 0x7f714c0c7a00 2020-11-20T12:14:54.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f7142ffd700 1 -- 172.21.15.93:0/1237803349 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134005840 con 0x7f714c0c7a00 2020-11-20T12:14:54.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.793+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f714c14b0e0 con 0x7f714c0c7a00 2020-11-20T12:14:54.807 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.794+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f714c05ca60 con 0x7f714c0c7a00 2020-11-20T12:14:54.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.795+0000 7f7142ffd700 1 -- 172.21.15.93:0/1237803349 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f7134010070 con 0x7f714c0c7a00 2020-11-20T12:14:54.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.795+0000 7f7142ffd700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f71280806a0 0x7f7128082b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:54.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.795+0000 7f7142ffd700 1 -- 172.21.15.93:0/1237803349 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f71340a21e0 con 0x7f714c0c7a00 2020-11-20T12:14:54.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.795+0000 7f714affd700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f71280806a0 0x7f7128082b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:54.808 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.796+0000 7f714affd700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f71280806a0 0x7f7128082b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f713c007550 tx=0x7f713c000bc0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:54.809 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.799+0000 7f7142ffd700 1 -- 172.21.15.93:0/1237803349 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f7134076b70 con 0x7f714c0c7a00 2020-11-20T12:14:54.945 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.942+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f714c0c86e0 con 0x7f714c0c7a00 2020-11-20T12:14:54.945 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.942+0000 7f7142ffd700 1 -- 172.21.15.93:0/1237803349 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v28) v1 ==== 100+0+10 (secure 0 0 0) 0x7f713407a190 con 0x7f714c0c7a00 2020-11-20T12:14:54.946 INFO:teuthology.orchestra.run.smithi093.stdout:pg_num: 8 2020-11-20T12:14:54.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.943+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f71280806a0 msgr2=0x7f7128082b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.943+0000 7f71512da700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f71280806a0 0x7f7128082b60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f713c007550 tx=0x7f713c000bc0).stop 2020-11-20T12:14:54.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.943+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f714c0c7a00 msgr2=0x7f714c0c2740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:54.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.943+0000 7f71512da700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f714c0c7a00 0x7f714c0c2740 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f713400c720 tx=0x7f7134007ac0).stop 2020-11-20T12:14:54.947 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 shutdown_connections 2020-11-20T12:14:54.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f714c0c7de0 0x7f714c146840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f71280806a0 0x7f7128082b60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f714c065060 0x7f714c164110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 --2- 172.21.15.93:0/1237803349 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f714c0c7a00 0x7f714c0c2740 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:54.948 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 >> 172.21.15.93:0/1237803349 conn(0x7f714c062480 msgr2=0x7f714c060130 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:54.949 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 shutdown_connections 2020-11-20T12:14:54.949 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:54.944+0000 7f71512da700 1 -- 172.21.15.93:0/1237803349 wait complete. 2020-11-20T12:14:54.958 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-11-20T12:14:54.958 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2020-11-20T12:14:55.068 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.065+0000 7f5b1ee84700 1 Processor -- start 2020-11-20T12:14:55.068 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.065+0000 7f5b1ee84700 1 -- start start 2020-11-20T12:14:55.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1ee84700 1 --2- >> v2:172.21.15.66:3300/0 conn(0x7f5b1814ec90 0x7f5b180640c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:55.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1ee84700 1 -- --> v1:172.21.15.66:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b180c8140 con 0x7f5b180c8310 2020-11-20T12:14:55.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1ee84700 1 -- --> v1:172.21.15.93:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b18064780 con 0x7f5b18154a50 2020-11-20T12:14:55.071 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1ee84700 1 -- --> v2:172.21.15.66:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b18064a20 con 0x7f5b1814ec90 2020-11-20T12:14:55.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1de82700 1 --1- >> v1:172.21.15.93:6789/0 conn(0x7f5b18154a50 0x7f5b18154e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.93:6789/0 says I am v1:172.21.15.93:40404/0 (socket says 172.21.15.93:40404) 2020-11-20T12:14:55.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1de82700 1 -- 172.21.15.93:0/3976816666 learned_addr learned my addr 172.21.15.93:0/3976816666 (peer_addr_for_me v1:172.21.15.93:0/0) 2020-11-20T12:14:55.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1e683700 1 --2- 172.21.15.93:0/3976816666 >> v2:172.21.15.66:3300/0 conn(0x7f5b1814ec90 0x7f5b180640c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:55.072 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1ce80700 1 -- 172.21.15.93:0/3976816666 <== mon.1 v1:172.21.15.93:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1117127392 0 0) 0x7f5b18064780 con 0x7f5b18154a50 2020-11-20T12:14:55.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1ce80700 1 -- 172.21.15.93:0/3976816666 --> v1:172.21.15.93:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5b00003280 con 0x7f5b18154a50 2020-11-20T12:14:55.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1e683700 1 -- 172.21.15.93:0/3976816666 >> v1:172.21.15.93:6789/0 conn(0x7f5b18154a50 legacy=0x7f5b18154e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:55.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1ce80700 1 -- 172.21.15.93:0/3976816666 <== mon.1 v1:172.21.15.93:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1039281616 0 0) 0x7f5b00003280 con 0x7f5b18154a50 2020-11-20T12:14:55.073 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1e683700 1 -- 172.21.15.93:0/3976816666 >> v1:172.21.15.66:6789/0 conn(0x7f5b180c8310 legacy=0x7f5b1814e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:55.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.066+0000 7f5b1e683700 1 -- 172.21.15.93:0/3976816666 --> v2:172.21.15.66:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b18064cc0 con 0x7f5b1814ec90 2020-11-20T12:14:55.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1e683700 1 --2- 172.21.15.93:0/3976816666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b180640c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5b10009cc0 tx=0x7f5b10009220).ready entity=mon.0 client_cookie=4212fccad0dbc80 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:55.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ce80700 1 -- 172.21.15.93:0/3976816666 <== mon.0 v2:172.21.15.66:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b14001560 con 0x7f5b1814ec90 2020-11-20T12:14:55.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ce80700 1 -- 172.21.15.93:0/3976816666 <== mon.0 v2:172.21.15.66:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1000b6a0 con 0x7f5b1814ec90 2020-11-20T12:14:55.074 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ce80700 1 -- 172.21.15.93:0/3976816666 <== mon.0 v2:172.21.15.66:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1000ba20 con 0x7f5b1814ec90 2020-11-20T12:14:55.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ee84700 1 -- 172.21.15.93:0/3976816666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 msgr2=0x7f5b180640c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:55.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/3976816666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b180640c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f5b10009cc0 tx=0x7f5b10009220).stop 2020-11-20T12:14:55.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ee84700 1 -- 172.21.15.93:0/3976816666 shutdown_connections 2020-11-20T12:14:55.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/3976816666 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b180640c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:55.075 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ee84700 1 -- 172.21.15.93:0/3976816666 >> 172.21.15.93:0/3976816666 conn(0x7f5b18060c00 msgr2=0x7f5b180c7730 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:55.076 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ee84700 1 -- 172.21.15.93:0/3976816666 shutdown_connections 2020-11-20T12:14:55.076 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.067+0000 7f5b1ee84700 1 -- 172.21.15.93:0/3976816666 wait complete. 2020-11-20T12:14:55.078 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.068+0000 7f5b1ee84700 1 Processor -- start 2020-11-20T12:14:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.068+0000 7f5b1ee84700 1 -- start start 2020-11-20T12:14:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1ee84700 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b180c8310 0x7f5b18152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1ee84700 1 --2- >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b181644b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1ee84700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b18154a50 0x7f5b180c0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:55.079 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1ee84700 1 -- --> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b181649a0 con 0x7f5b1814ec90 2020-11-20T12:14:55.080 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1ee84700 1 -- --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1814e010 con 0x7f5b18154a50 2020-11-20T12:14:55.080 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1ee84700 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b1814dad0 con 0x7f5b180c8310 2020-11-20T12:14:55.080 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1e683700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b18154a50 0x7f5b180c0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:55.080 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1e683700 1 --2- >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b18154a50 0x7f5b180c0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.93:3300/0 says I am v2:172.21.15.93:39716/0 (socket says 172.21.15.93:39716) 2020-11-20T12:14:55.080 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1e683700 1 -- 172.21.15.93:0/1958181455 learned_addr learned my addr 172.21.15.93:0/1958181455 (peer_addr_for_me v2:172.21.15.93:0/0) 2020-11-20T12:14:55.081 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.069+0000 7f5b1d681700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b181644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:55.081 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1de82700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b180c8310 0x7f5b18152a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:55.081 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1e683700 1 -- 172.21.15.93:0/1958181455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b180c8310 msgr2=0x7f5b18152a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:55.081 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1e683700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b180c8310 0x7f5b18152a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:55.082 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1e683700 1 -- 172.21.15.93:0/1958181455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 msgr2=0x7f5b181644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:55.082 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1e683700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b181644b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:55.082 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1e683700 1 -- 172.21.15.93:0/1958181455 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1814dd70 con 0x7f5b18154a50 2020-11-20T12:14:55.082 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1d681700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b181644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-11-20T12:14:55.082 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1e683700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b18154a50 0x7f5b180c0d60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f5b10010000 tx=0x7f5b18064910).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:55.083 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b05ffb700 1 -- 172.21.15.93:0/1958181455 <== mon.1 v2:172.21.15.93:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1001c650 con 0x7f5b18154a50 2020-11-20T12:14:55.083 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b05ffb700 1 -- 172.21.15.93:0/1958181455 <== mon.1 v2:172.21.15.93:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1001c7d0 con 0x7f5b18154a50 2020-11-20T12:14:55.083 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b18160680 con 0x7f5b18154a50 2020-11-20T12:14:55.083 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b05ffb700 1 -- 172.21.15.93:0/1958181455 <== mon.1 v2:172.21.15.93:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b1001cb90 con 0x7f5b18154a50 2020-11-20T12:14:55.083 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.070+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b180c1250 con 0x7f5b18154a50 2020-11-20T12:14:55.084 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.071+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b18061680 con 0x7f5b18154a50 2020-11-20T12:14:55.084 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.072+0000 7f5b05ffb700 1 -- 172.21.15.93:0/1958181455 <== mon.1 v2:172.21.15.93:3300/0 4 ==== mgrmap(e 4) v1 ==== 101150+0+0 (secure 0 0 0) 0x7f5b10002020 con 0x7f5b18154a50 2020-11-20T12:14:55.084 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.072+0000 7f5b05ffb700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f5af0080670 0x7f5af0082b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2020-11-20T12:14:55.084 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.072+0000 7f5b05ffb700 1 -- 172.21.15.93:0/1958181455 <== mon.1 v2:172.21.15.93:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 8271+0+0 (secure 0 0 0) 0x7f5b100a4860 con 0x7f5b18154a50 2020-11-20T12:14:55.085 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.072+0000 7f5b1de82700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f5af0080670 0x7f5af0082b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2020-11-20T12:14:55.085 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.072+0000 7f5b1de82700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f5af0080670 0x7f5af0082b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5b140058b0 tx=0x7f5b14001d60).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-11-20T12:14:55.085 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.075+0000 7f5b05ffb700 1 -- 172.21.15.93:0/1958181455 <== mon.1 v2:172.21.15.93:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+143281 (secure 0 0 0) 0x7f5b10079270 con 0x7f5b18154a50 2020-11-20T12:14:55.267 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.263+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 --> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5b1805ca60 con 0x7f5b18154a50 2020-11-20T12:14:55.267 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.264+0000 7f5b05ffb700 1 -- 172.21.15.93:0/1958181455 <== mon.1 v2:172.21.15.93:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2480 (secure 0 0 0) 0x7f5b1007c890 con 0x7f5b18154a50 2020-11-20T12:14:55.267 INFO:teuthology.orchestra.run.smithi093.stdout: 2020-11-20T12:14:55.268 INFO:teuthology.orchestra.run.smithi093.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4296,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.93:6835/3224210757","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.93:6834","nonce":3224210757},{"type":"v1","addr":"172.21.15.93:6835","nonce":3224210757}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":2},{"gid":4305,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.66:6833/354762617","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.66:6832","nonce":354762617},{"type":"v1","addr":"172.21.15.66:6833","nonce":354762617}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0,"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-11-20T12:14:39.043063+0000","modified":"2020-11-20T12:14:41.045929+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4307},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4307":{"gid":4307,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6833/208815911","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":208815911},{"type":"v1","addr":"172.21.15.132:6833","nonce":208815911}]},"join_fscid":-1,"export_targets":[],"features":4540138297136906239,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-11-20T12:14:55.269 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f5af0080670 msgr2=0x7f5af0082b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:55.269 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f5af0080670 0x7f5af0082b30 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f5b140058b0 tx=0x7f5b14001d60).stop 2020-11-20T12:14:55.269 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b18154a50 msgr2=0x7f5b180c0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-11-20T12:14:55.269 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b18154a50 0x7f5b180c0d60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f5b10010000 tx=0x7f5b18064910).stop 2020-11-20T12:14:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 shutdown_connections 2020-11-20T12:14:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:3300/0,v1:172.21.15.93:6789/0] conn(0x7f5b18154a50 0x7f5b180c0d60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b180c8310 0x7f5b18152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.93:6800/22895,v1:172.21.15.93:6801/22895] conn(0x7f5af0080670 0x7f5af0082b30 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:55.270 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.265+0000 7f5b1ee84700 1 --2- 172.21.15.93:0/1958181455 >> [v2:172.21.15.66:3300/0,v1:172.21.15.66:6789/0] conn(0x7f5b1814ec90 0x7f5b181644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2020-11-20T12:14:55.271 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.266+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 >> 172.21.15.93:0/1958181455 conn(0x7f5b18060c00 msgr2=0x7f5b18061930 unknown :-1 s=STATE_NONE l=0).mark_down 2020-11-20T12:14:55.271 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.266+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 shutdown_connections 2020-11-20T12:14:55.271 INFO:teuthology.orchestra.run.smithi093.stderr:2020-11-20T12:14:55.266+0000 7f5b1ee84700 1 -- 172.21.15.93:0/1958181455 wait complete. 2020-11-20T12:14:55.271 INFO:teuthology.orchestra.run.smithi093.stderr:dumped fsmap epoch 6 2020-11-20T12:14:55.582 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2020-11-20T12:14:39.043063+0000', 'modified': '2020-11-20T12:14:41.045929+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4307}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4307': {'gid': 4307, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6833/208815911', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6832', 'nonce': 208815911}, {'type': 'v1', 'addr': '172.21.15.132:6833', 'nonce': 208815911}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138297136906239, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2020-11-20T12:14:55.583 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-11-20T12:14:55.583 INFO:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2020-11-20T12:14:55.722 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"c8cfafc9-773d-4a52-b4ca-518048ab7244","whoami":0,"id":4307,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":16.665064884,"mdsmap_epoch":6,"osdmap_epoch":28,"osdmap_epoch_barrier":28,"uptime":23.059065689000001} 2020-11-20T12:14:55.723 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "c8cfafc9-773d-4a52-b4ca-518048ab7244", "fs_name": "cephfs", "id": 4307, "mdsmap_epoch": 6, "osdmap_epoch": 28, "osdmap_epoch_barrier": 28, "rank_uptime": 16.665064884, "state": "up:active", "uptime": 23.059065689, "want_state": "up:active", "whoami": 0 } 2020-11-20T12:14:55.723 INFO:tasks.cephfs.mount:Ready to start KernelMount... 2020-11-20T12:14:55.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:55.724 INFO:teuthology.orchestra.run.smithi093:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:55.740 INFO:teuthology.orchestra.run:Running command with timeout 1800 2020-11-20T12:14:55.740 INFO:teuthology.orchestra.run.smithi093:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T12:14:55.828 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T12:14:55.828 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T12:14:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:parsing options: rw,norequire_active_mds,name=0,conf=/etc/ceph/ceph.conf,norbytes 2020-11-20T12:14:55.940 INFO:teuthology.orchestra.run.smithi093.stdout:mount.ceph: options "norequire_active_mds,name=0,norbytes" will pass to kernel. 2020-11-20T12:14:55.943 INFO:tasks.cephfs.kernel_mount:mount command passed 2020-11-20T12:14:55.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2020-11-20T12:14:55.944 INFO:teuthology.orchestra.run.smithi093:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:55.971 INFO:teuthology.run_tasks:Running task check-counter... 2020-11-20T12:14:55.981 INFO:teuthology.run_tasks:Running task workunit... 2020-11-20T12:14:56.000 INFO:tasks.workunit:Pulling workunits from ref b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:14:56.001 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-11-20T12:14:56.001 INFO:tasks.workunit:timeout=3h 2020-11-20T12:14:56.002 INFO:tasks.workunit:cleanup=True 2020-11-20T12:14:56.002 INFO:teuthology.orchestra.run.smithi093:> stat -- /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:56.026 INFO:teuthology.orchestra.run.smithi093.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:56.026 INFO:teuthology.orchestra.run.smithi093.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2020-11-20T12:14:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:Device: 2eh/46d Inode: 1 Links: 2 2020-11-20T12:14:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-11-20T12:14:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:Context: system_u:object_r:cephfs_t:s0 2020-11-20T12:14:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-11-20T12:14:56.027 INFO:teuthology.orchestra.run.smithi093.stdout:Modify: 2020-11-20 12:14:39.046195454 +0000 2020-11-20T12:14:56.028 INFO:teuthology.orchestra.run.smithi093.stdout:Change: 2020-11-20 12:14:55.966302879 +0000 2020-11-20T12:14:56.028 INFO:teuthology.orchestra.run.smithi093.stdout: Birth: - 2020-11-20T12:14:56.028 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-11-20T12:14:56.028 INFO:teuthology.orchestra.run.smithi093:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-11-20T12:14:56.097 INFO:teuthology.orchestra.run.smithi093:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout b86e691bf191566922a8f08e2a5abf64fde8cfcb 2020-11-20T12:14:56.221 INFO:tasks.workunit.client.0.smithi093.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-11-20T12:15:20.212 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:20.226 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:20.240 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:44.881 INFO:tasks.workunit.client.0.smithi093.stderr:Note: switching to 'b86e691bf191566922a8f08e2a5abf64fde8cfcb'. 2020-11-20T12:15:45.118 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:45.119 INFO:tasks.workunit.client.0.smithi093.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-11-20T12:15:45.119 INFO:tasks.workunit.client.0.smithi093.stderr:changes and commit them, and you can discard any commits you make in this 2020-11-20T12:15:45.119 INFO:tasks.workunit.client.0.smithi093.stderr:state without impacting any branches by switching back to a branch. 2020-11-20T12:15:45.119 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:45.119 INFO:tasks.workunit.client.0.smithi093.stderr:If you want to create a new branch to retain commits you create, you may 2020-11-20T12:15:45.120 INFO:tasks.workunit.client.0.smithi093.stderr:do so (now or later) by using -c with the switch command. Example: 2020-11-20T12:15:45.120 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:45.120 INFO:tasks.workunit.client.0.smithi093.stderr: git switch -c 2020-11-20T12:15:45.120 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:45.121 INFO:tasks.workunit.client.0.smithi093.stderr:Or undo this operation with: 2020-11-20T12:15:45.121 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:45.121 INFO:tasks.workunit.client.0.smithi093.stderr: git switch - 2020-11-20T12:15:45.121 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:45.122 INFO:tasks.workunit.client.0.smithi093.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2020-11-20T12:15:45.122 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:45.122 INFO:tasks.workunit.client.0.smithi093.stderr:HEAD is now at b86e691bf1 Merge PR #37174 into wip-pdonnell-testing-20201120.053228 2020-11-20T12:15:45.123 INFO:teuthology.orchestra.run.smithi093:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-11-20T12:15:45.149 INFO:tasks.workunit.client.0.smithi093.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-11-20T12:15:45.151 INFO:tasks.workunit.client.0.smithi093.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T12:15:45.151 INFO:tasks.workunit.client.0.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-11-20T12:15:45.824 INFO:tasks.workunit.client.0.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-11-20T12:15:45.891 INFO:tasks.workunit.client.0.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-11-20T12:15:45.927 INFO:tasks.workunit.client.0.smithi093.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-11-20T12:15:45.929 INFO:tasks.workunit.client.0.smithi093.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T12:15:45.929 INFO:tasks.workunit.client.0.smithi093.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-11-20T12:15:45.964 INFO:tasks.workunit.client.0.smithi093.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-11-20T12:15:45.967 INFO:teuthology.orchestra.run.smithi093:> set -ex 2020-11-20T12:15:45.967 INFO:teuthology.orchestra.run.smithi093:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T12:15:46.020 INFO:teuthology.orchestra.run.smithi093.stderr:+ dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2020-11-20T12:15:46.021 INFO:teuthology.orchestra.run.smithi093.stdout:mon/rbd_snaps_ops.shmon/osd.shmon/config.shmon/pg_autoscaler.shmon/test_mon_osdmap_prune.shmon/pool_ops.shmon/ping.pymon/crush_ops.shmon/test_mon_config_key.pymon/auth_caps.shmon/caps.shmon/test_config_key_caps.shpost-file.shtrue.shceph-helpers-root.shceph-tests/ceph-admin-commands.sherasure-code/bench.sherasure-code/encode-decode-non-regression.shrgw/test_rgw_reshard.pyrgw/test_rgw_throttle.shrgw/s3_bucket_quota.plrgw/test_rgw_gc_log.shrgw/test_rgw_obj.shrgw/s3_multipart_upload.plrgw/test_rgw_orphan_list.shrgw/s3_user_quota.plrgw/run-reshard.shrgw/run-s3tests.shcephtool/test_daemon.shcephtool/test_kvstore_tool.shcephtool/test.shsuites/cephfs_journal_tool_smoke.shsuites/iogen.shsuites/pjd.shsuites/dbench.shsuites/iozone-sync.shsuites/fsx.shsuites/fsstress.shsuites/fio.shsuites/iozone.shsuites/blogbench.shsuites/dbench-short.shsuites/bonnie.shsuites/fsync-tester.shsuites/ffsb.shlibcephfs/test.shcls/test_cls_cmpomap.shcls/test_cls_numops.shcls/test_cls_hello.shcls/test_cls_sdk.shcls/test_cls_rbd.shcls/test_cls_refcount.shcls/test_cls_2pc_queue.shcls/test_cls_lock.shcls/test_cls_journal.shcls/test_cls_log.shcls/test_cls_rgw.shosdc/stress_objectcacher.shrbd/merge_diff.shrbd/krbd_stable_pages_required.shrbd/rbd_mirror_ha.shrbd/diff_continuous.shrbd/test_librbd.shrbd/test_lock_fence.shrbd/qemu_rebuild_object_map.shrbd/qemu-iotests.shrbd/test_rbd_mirror.shrbd/krbd_udev_enumerate.shrbd/test_admin_socket.shrbd/krbd_wac.shrbd/notify_slave.shrbd/test_librbd_python.shrbd/rbd_mirror_bootstrap.shrbd/test_rbd_tasks.shrbd/rbd-ggate.shrbd/rbd_mirror_helpers.shrbd/test_rbdmap_RBDMAPFILE.shrbd/verify_pool.shrbd/cli_generic.shrbd/image_read.shrbd/rbd_mirror_fsx_compare.shrbd/read-flags.shrbd/map-unmap.shrbd/journal.shrbd/krbd_udev_netns.shrbd/huge-tickets.shrbd/qemu_dynamic_features.shrbd/simple_big.shrbd/krbd_latest_osdmap_on_map.shrbd/krbd_namespaces.shrbd/rbd_groups.shrbd/krbd_udev_symlinks.shrbd/rbd_mirror_stress.shrbd/permissions.shrbd/notify_master.shrbd/rbd_mirror_fsx_prepare.shrbd/import_export.shrbd/issue-20295.shrbd/map-snapshot-io.shrbd/concurrent.shrbd/qos.shrbd/krbd_huge_osdmap.shrbd/krbd_exclusive_option.shrbd/diff.shrbd/krbd_udev_netlink_enobufs.shrbd/rbd-nbd.shrbd/krbd_data_pool.shrbd/krbd_fallocate.shrbd/kernel.shrbd/rbd_mirror_journal.shrbd/rbd_mirror_snapshot.shkernel_untar_build.shmgr/test_localpool.shhadoop/terasort.shhadoop/repl.shhadoop/wordcount.shrestart/test-backtraces.pyfs/misc/mkpool_layout_vxattrs.shfs/misc/rstats.shfs/misc/subvolume.shfs/misc/filelock_interrupt.pyfs/misc/layout_vxattrs.shfs/misc/direct_io.pyfs/misc/filelock_deadlock.pyfs/misc/chmod.shfs/misc/multiple_rsync.shfs/misc/acl.shfs/misc/xattrs.shfs/misc/i_complete_vs_rename.shfs/misc/dirfrag.shfs/misc/trivial_sync.shfs/test_o_trunc.shfs/upgrade/volume_clientfs/test_python.shfs/multiclient_sync_read_eof.pyfs/quota/quota.shfs/snap-hierarchy.shfs/test_o_truncfs/norstats/kernel_untar_tar.shfs/snaps/snaptest-2.shfs/snaps/snaptest-xattrwb.shfs/snaps/snaptest-double-null.shfs/snaps/snaptest-0.shfs/snaps/snaptest-capwb.shfs/snaps/snaptest-git-ceph.shfs/snaps/untar_snap_rm.shfs/snaps/snaptest-intodir.shfs/snaps/snaptest-1.shfs/snaps/snaptest-dir-rename.shfs/snaps/snaptest-estale.shfs/snaps/snaptest-multiple-capsnaps.shfs/snaps/snaptest-upchildrealms.shfs/snaps/snaptest-parents.shfs/snaps/snaptest-snap-rename.shfs/snaps/snaptest-authwb.shfs/snaps/snaptest-realm-split.shfs/snaps/snap-rm-diff.shfs/snaps/snaptest-snap-rm-cmp.shfs/snaps/snaptest-hardlink.shobjectstore/test_fuse.shcephadm/test_adoption.shcephadm/test_dashboard_e2e.shcephadm/test_repos.shcephadm/create_iscsi_disks.shcephadm/test_cephadm.shcaps/mon_commands.shrest/test-restful.shrest/test_mgr_rest_api.pydirect_io/test_sync_iodirect_io/big.shdirect_io/test_short_dio_readdirect_io/misc.shdirect_io/direct_io_testrename/pri_nul.shrename/prepare.shrename/rem_nul.shrename/rem_pri.shrename/pri_rem.shrename/rem_rem.shrename/pri_pri.shrename/dir_pri_nul.shrename/dir_pri_pri.shrename/all.shrados/test_dedup_tool.shrados/test_large_omap_detection.pyrados/test_pool_access.shrados/test_rados_timeouts.shrados/stress_watch.shrados/clone.shrados/test_envlibrados_for_rocksdb.shrados/load-gen-mix.shrados/test.shrados/test_python.shrados/test_librados_build.shrados/test_hang.shrados/test_health_warnings.shrados/test_crash.shrados/load-gen-mix-small-long.shrados/test_cache_pool.shrados/test_alloc_hint.shrados/load-gen-big.shrados/load-gen-mostlyread.shrados/test_rados_tool.shrados/load-gen-mix-small.shrados/test_pool_quota.shrados/version_number_sanity.sh 2020-11-20T12:15:46.021 INFO:teuthology.orchestra.run.smithi093.stderr:9+1 records in 2020-11-20T12:15:46.022 INFO:teuthology.orchestra.run.smithi093.stderr:9+1 records out 2020-11-20T12:15:46.022 INFO:teuthology.orchestra.run.smithi093.stderr:4744 bytes (4.7 kB, 4.6 KiB) copied, 3.9721e-05 s, 119 MB/s 2020-11-20T12:15:46.022 INFO:tasks.workunit:Running workunits matching kernel_untar_build.sh on client.0... 2020-11-20T12:15:46.024 INFO:tasks.workunit:Running workunit kernel_untar_build.sh... 2020-11-20T12:15:46.024 INFO:teuthology.orchestra.run.smithi093:workunit test kernel_untar_build.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=b86e691bf191566922a8f08e2a5abf64fde8cfcb TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/kernel_untar_build.sh 2020-11-20T12:15:46.107 INFO:tasks.workunit.client.0.smithi093.stderr:--2020-11-20 12:15:46-- http://download.ceph.com/qa/linux-5.4.tar.gz 2020-11-20T12:15:46.108 INFO:tasks.workunit.client.0.smithi093.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2020-11-20T12:15:46.186 INFO:tasks.workunit.client.0.smithi093.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2020-11-20T12:15:46.264 INFO:tasks.workunit.client.0.smithi093.stderr:HTTP request sent, awaiting response... 200 OK 2020-11-20T12:15:46.264 INFO:tasks.workunit.client.0.smithi093.stderr:Length: 172616875 (165M) [application/octet-stream] 2020-11-20T12:15:46.265 INFO:tasks.workunit.client.0.smithi093.stderr:Saving to: ‘linux.tar.gz’ 2020-11-20T12:15:46.267 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:15:46.422 INFO:tasks.workunit.client.0.smithi093.stderr: 0K .......... .......... .......... .......... .......... 0% 317K 8m51s 2020-11-20T12:15:46.502 INFO:tasks.workunit.client.0.smithi093.stderr: 50K .......... .......... .......... .......... .......... 0% 622K 6m41s 2020-11-20T12:15:46.581 INFO:tasks.workunit.client.0.smithi093.stderr: 100K .......... .......... .......... .......... .......... 0% 630K 5m56s 2020-11-20T12:15:46.655 INFO:tasks.workunit.client.0.smithi093.stderr: 150K .......... .......... .......... .......... .......... 0% 680K 5m29s 2020-11-20T12:15:46.716 INFO:tasks.workunit.client.0.smithi093.stderr: 200K .......... .......... .......... .......... .......... 0% 809K 5m5s 2020-11-20T12:15:46.780 INFO:tasks.workunit.client.0.smithi093.stderr: 250K .......... .......... .......... .......... .......... 0% 777K 4m50s 2020-11-20T12:15:46.788 INFO:tasks.workunit.client.0.smithi093.stderr: 300K .......... .......... .......... .......... .......... 0% 5.86M 4m12s 2020-11-20T12:15:46.850 INFO:tasks.workunit.client.0.smithi093.stderr: 350K .......... .......... .......... .......... .......... 0% 816K 4m7s 2020-11-20T12:15:46.913 INFO:tasks.workunit.client.0.smithi093.stderr: 400K .......... .......... .......... .......... .......... 0% 793K 4m3s 2020-11-20T12:15:46.971 INFO:tasks.workunit.client.0.smithi093.stderr: 450K .......... .......... .......... .......... .......... 0% 871K 3m58s 2020-11-20T12:15:47.030 INFO:tasks.workunit.client.0.smithi093.stderr: 500K .......... .......... .......... .......... .......... 0% 845K 3m54s 2020-11-20T12:15:47.043 INFO:tasks.workunit.client.0.smithi093.stderr: 550K .......... .......... .......... .......... .......... 0% 3.69M 3m38s 2020-11-20T12:15:47.106 INFO:tasks.workunit.client.0.smithi093.stderr: 600K .......... .......... .......... .......... .......... 0% 793K 3m38s 2020-11-20T12:15:47.167 INFO:tasks.workunit.client.0.smithi093.stderr: 650K .......... .......... .......... .......... .......... 0% 820K 3m37s 2020-11-20T12:15:47.182 INFO:tasks.workunit.client.0.smithi093.stderr: 700K .......... .......... .......... .......... .......... 0% 3.15M 3m26s 2020-11-20T12:15:47.245 INFO:tasks.workunit.client.0.smithi093.stderr: 750K .......... .......... .......... .......... .......... 0% 801K 3m26s 2020-11-20T12:15:47.294 INFO:tasks.workunit.client.0.smithi093.stderr: 800K .......... .......... .......... .......... .......... 0% 1.01M 3m23s 2020-11-20T12:15:47.326 INFO:tasks.workunit.client.0.smithi093.stderr: 850K .......... .......... .......... .......... .......... 0% 1.58M 3m18s 2020-11-20T12:15:47.384 INFO:tasks.workunit.client.0.smithi093.stderr: 900K .......... .......... .......... .......... .......... 0% 829K 3m18s 2020-11-20T12:15:47.400 INFO:tasks.workunit.client.0.smithi093.stderr: 950K .......... .......... .......... .......... .......... 0% 3.09M 3m10s 2020-11-20T12:15:47.454 INFO:tasks.workunit.client.0.smithi093.stderr: 1000K .......... .......... .......... .......... .......... 0% 913K 3m10s 2020-11-20T12:15:47.469 INFO:tasks.workunit.client.0.smithi093.stderr: 1050K .......... .......... .......... .......... .......... 0% 3.42M 3m4s 2020-11-20T12:15:47.534 INFO:tasks.workunit.client.0.smithi093.stderr: 1100K .......... .......... .......... .......... .......... 0% 778K 3m5s 2020-11-20T12:15:47.546 INFO:tasks.workunit.client.0.smithi093.stderr: 1150K .......... .......... .......... .......... .......... 0% 3.88M 2m59s 2020-11-20T12:15:47.614 INFO:tasks.workunit.client.0.smithi093.stderr: 1200K .......... .......... .......... .......... .......... 0% 739K 3m1s 2020-11-20T12:15:47.627 INFO:tasks.workunit.client.0.smithi093.stderr: 1250K .......... .......... .......... .......... .......... 0% 3.68M 2m55s 2020-11-20T12:15:47.691 INFO:tasks.workunit.client.0.smithi093.stderr: 1300K .......... .......... .......... .......... .......... 0% 781K 2m57s 2020-11-20T12:15:47.702 INFO:tasks.workunit.client.0.smithi093.stderr: 1350K .......... .......... .......... .......... .......... 0% 4.21M 2m52s 2020-11-20T12:15:47.764 INFO:tasks.workunit.client.0.smithi093.stderr: 1400K .......... .......... .......... .......... .......... 0% 803K 2m53s 2020-11-20T12:15:47.779 INFO:tasks.workunit.client.0.smithi093.stderr: 1450K .......... .......... .......... .......... .......... 0% 3.45M 2m49s 2020-11-20T12:15:47.843 INFO:tasks.workunit.client.0.smithi093.stderr: 1500K .......... .......... .......... .......... .......... 0% 783K 2m50s 2020-11-20T12:15:47.854 INFO:tasks.workunit.client.0.smithi093.stderr: 1550K .......... .......... .......... .......... .......... 0% 4.41M 2m46s 2020-11-20T12:15:47.869 INFO:tasks.workunit.client.0.smithi093.stderr: 1600K .......... .......... .......... .......... .......... 0% 3.50M 2m42s 2020-11-20T12:15:47.928 INFO:tasks.workunit.client.0.smithi093.stderr: 1650K .......... .......... .......... .......... .......... 1% 843K 2m43s 2020-11-20T12:15:47.938 INFO:tasks.workunit.client.0.smithi093.stderr: 1700K .......... .......... .......... .......... .......... 1% 4.33M 2m40s 2020-11-20T12:15:47.999 INFO:tasks.workunit.client.0.smithi093.stderr: 1750K .......... .......... .......... .......... .......... 1% 824K 2m41s 2020-11-20T12:15:48.020 INFO:tasks.workunit.client.0.smithi093.stderr: 1800K .......... .......... .......... .......... .......... 1% 3.28M 2m38s 2020-11-20T12:15:48.025 INFO:tasks.workunit.client.0.smithi093.stderr: 1850K .......... .......... .......... .......... .......... 1% 4.83M 2m34s 2020-11-20T12:15:48.221 INFO:tasks.workunit.client.0.smithi093.stderr: 1900K .......... .......... .......... .......... .......... 1% 260K 2m47s 2020-11-20T12:15:48.221 INFO:tasks.workunit.client.0.smithi093.stderr: 1950K .......... .......... .......... .......... .......... 1% 300M 2m43s 2020-11-20T12:15:48.221 INFO:tasks.workunit.client.0.smithi093.stderr: 2000K .......... .......... .......... .......... .......... 1% 604M 2m39s 2020-11-20T12:15:48.221 INFO:tasks.workunit.client.0.smithi093.stderr: 2050K .......... .......... .......... .......... .......... 1% 342M 2m35s 2020-11-20T12:15:48.222 INFO:tasks.workunit.client.0.smithi093.stderr: 2100K .......... .......... .......... .......... .......... 1% 463M 2m31s 2020-11-20T12:15:48.222 INFO:tasks.workunit.client.0.smithi093.stderr: 2150K .......... .......... .......... .......... .......... 1% 444M 2m28s 2020-11-20T12:15:48.222 INFO:tasks.workunit.client.0.smithi093.stderr: 2200K .......... .......... .......... .......... .......... 1% 691M 2m24s 2020-11-20T12:15:48.280 INFO:tasks.workunit.client.0.smithi093.stderr: 2250K .......... .......... .......... .......... .......... 1% 830K 2m26s 2020-11-20T12:15:49.873 INFO:tasks.workunit.client.0.smithi093.stderr: 2300K .......... .......... .......... .......... .......... 1% 32.1M 2m23s 2020-11-20T12:15:49.931 INFO:tasks.workunit.client.0.smithi093.stderr: 2350K .......... .......... .......... .......... .......... 1% 931K 2m23s 2020-11-20T12:15:49.932 INFO:tasks.workunit.client.0.smithi093.stderr: 2400K .......... .......... .......... .......... .......... 1% 17.2M 2m20s 2020-11-20T12:15:49.932 INFO:tasks.workunit.client.0.smithi093.stderr: 2450K .......... .......... .......... .......... .......... 1% 941K 2m21s 2020-11-20T12:15:49.932 INFO:tasks.workunit.client.0.smithi093.stderr: 2500K .......... .......... .......... .......... .......... 1% 11.9M 2m19s 2020-11-20T12:15:49.933 INFO:tasks.workunit.client.0.smithi093.stderr: 2550K .......... .......... .......... .......... .......... 1% 948K 2m19s 2020-11-20T12:15:49.933 INFO:tasks.workunit.client.0.smithi093.stderr: 2600K .......... .......... .......... .......... .......... 1% 980K 2m20s 2020-11-20T12:15:49.933 INFO:tasks.workunit.client.0.smithi093.stderr: 2650K .......... .......... .......... .......... .......... 1% 7.58M 2m18s 2020-11-20T12:15:49.933 INFO:tasks.workunit.client.0.smithi093.stderr: 2700K .......... .......... .......... .......... .......... 1% 1004K 2m18s 2020-11-20T12:15:49.933 INFO:tasks.workunit.client.0.smithi093.stderr: 2750K .......... .......... .......... .......... .......... 1% 7.04M 2m16s 2020-11-20T12:15:49.934 INFO:tasks.workunit.client.0.smithi093.stderr: 2800K .......... .......... .......... .......... .......... 1% 855K 2m17s 2020-11-20T12:15:49.934 INFO:tasks.workunit.client.0.smithi093.stderr: 2850K .......... .......... .......... .......... .......... 1% 5.79M 2m15s 2020-11-20T12:15:49.934 INFO:tasks.workunit.client.0.smithi093.stderr: 2900K .......... .......... .......... .......... .......... 1% 955K 2m16s 2020-11-20T12:15:49.934 INFO:tasks.workunit.client.0.smithi093.stderr: 2950K .......... .......... .......... .......... .......... 1% 4.34M 2m14s 2020-11-20T12:15:49.934 INFO:tasks.workunit.client.0.smithi093.stderr: 3000K .......... .......... .......... .......... .......... 1% 954K 2m15s 2020-11-20T12:15:49.935 INFO:tasks.workunit.client.0.smithi093.stderr: 3050K .......... .......... .......... .......... .......... 1% 4.82M 2m13s 2020-11-20T12:15:49.935 INFO:tasks.workunit.client.0.smithi093.stderr: 3100K .......... .......... .......... .......... .......... 1% 994K 2m13s 2020-11-20T12:15:49.935 INFO:tasks.workunit.client.0.smithi093.stderr: 3150K .......... .......... .......... .......... .......... 1% 3.75M 2m12s 2020-11-20T12:15:49.935 INFO:tasks.workunit.client.0.smithi093.stderr: 3200K .......... .......... .......... .......... .......... 1% 5.14M 2m10s 2020-11-20T12:15:49.935 INFO:tasks.workunit.client.0.smithi093.stderr: 3250K .......... .......... .......... .......... .......... 1% 952K 2m11s 2020-11-20T12:15:49.936 INFO:tasks.workunit.client.0.smithi093.stderr: 3300K .......... .......... .......... .......... .......... 1% 5.99M 2m9s 2020-11-20T12:15:49.936 INFO:tasks.workunit.client.0.smithi093.stderr: 3350K .......... .......... .......... .......... .......... 2% 872K 2m10s 2020-11-20T12:15:49.936 INFO:tasks.workunit.client.0.smithi093.stderr: 3400K .......... .......... .......... .......... .......... 2% 4.46M 2m9s 2020-11-20T12:15:49.936 INFO:tasks.workunit.client.0.smithi093.stderr: 3450K .......... .......... .......... .......... .......... 2% 944K 2m9s 2020-11-20T12:15:49.936 INFO:tasks.workunit.client.0.smithi093.stderr: 3500K .......... .......... .......... .......... .......... 2% 3.77M 2m8s 2020-11-20T12:15:49.936 INFO:tasks.workunit.client.0.smithi093.stderr: 3550K .......... .......... .......... .......... .......... 2% 1.00M 2m9s 2020-11-20T12:15:49.937 INFO:tasks.workunit.client.0.smithi093.stderr: 3600K .......... .......... .......... .......... .......... 2% 2.28M 2m8s 2020-11-20T12:15:49.937 INFO:tasks.workunit.client.0.smithi093.stderr: 3650K .......... .......... .......... .......... .......... 2% 1.12M 2m8s 2020-11-20T12:15:49.937 INFO:tasks.workunit.client.0.smithi093.stderr: 3700K .......... .......... .......... .......... .......... 2% 2.64M 2m7s 2020-11-20T12:15:49.937 INFO:tasks.workunit.client.0.smithi093.stderr: 3750K .......... .......... .......... .......... .......... 2% 979K 2m7s 2020-11-20T12:15:49.937 INFO:tasks.workunit.client.0.smithi093.stderr: 3800K .......... .......... .......... .......... .......... 2% 2.37M 2m7s 2020-11-20T12:15:49.938 INFO:tasks.workunit.client.0.smithi093.stderr: 3850K .......... .......... .......... .......... .......... 2% 5.42M 2m5s 2020-11-20T12:15:49.938 INFO:tasks.workunit.client.0.smithi093.stderr: 3900K .......... .......... .......... .......... .......... 2% 982K 2m6s 2020-11-20T12:15:49.938 INFO:tasks.workunit.client.0.smithi093.stderr: 3950K .......... .......... .......... .......... .......... 2% 3.92M 2m5s 2020-11-20T12:15:49.938 INFO:tasks.workunit.client.0.smithi093.stderr: 4000K .......... .......... .......... .......... .......... 2% 862K 2m6s 2020-11-20T12:15:49.938 INFO:tasks.workunit.client.0.smithi093.stderr: 4050K .......... .......... .......... .......... .......... 2% 3.33M 2m5s 2020-11-20T12:15:49.939 INFO:tasks.workunit.client.0.smithi093.stderr: 4100K .......... .......... .......... .......... .......... 2% 972K 2m5s 2020-11-20T12:15:49.939 INFO:tasks.workunit.client.0.smithi093.stderr: 4150K .......... .......... .......... .......... .......... 2% 2.48M 2m4s 2020-11-20T12:15:49.939 INFO:tasks.workunit.client.0.smithi093.stderr: 4200K .......... .......... .......... .......... .......... 2% 4.42M 2m3s 2020-11-20T12:15:49.939 INFO:tasks.workunit.client.0.smithi093.stderr: 4250K .......... .......... .......... .......... .......... 2% 848K 2m4s 2020-11-20T12:15:49.939 INFO:tasks.workunit.client.0.smithi093.stderr: 4300K .......... .......... .......... .......... .......... 2% 3.62M 2m3s 2020-11-20T12:15:49.940 INFO:tasks.workunit.client.0.smithi093.stderr: 4350K .......... .......... .......... .......... .......... 2% 913K 2m4s 2020-11-20T12:15:49.940 INFO:tasks.workunit.client.0.smithi093.stderr: 4400K .......... .......... .......... .......... .......... 2% 3.55M 2m3s 2020-11-20T12:15:49.940 INFO:tasks.workunit.client.0.smithi093.stderr: 4450K .......... .......... .......... .......... .......... 2% 986K 2m3s 2020-11-20T12:15:49.940 INFO:tasks.workunit.client.0.smithi093.stderr: 4500K .......... .......... .......... .......... .......... 2% 2.30M 2m3s 2020-11-20T12:15:49.940 INFO:tasks.workunit.client.0.smithi093.stderr: 4550K .......... .......... .......... .......... .......... 2% 4.42M 2m2s 2020-11-20T12:15:49.941 INFO:tasks.workunit.client.0.smithi093.stderr: 4600K .......... .......... .......... .......... .......... 2% 887K 2m2s 2020-11-20T12:15:49.941 INFO:tasks.workunit.client.0.smithi093.stderr: 4650K .......... .......... .......... .......... .......... 2% 3.09M 2m1s 2020-11-20T12:15:49.941 INFO:tasks.workunit.client.0.smithi093.stderr: 4700K .......... .......... .......... .......... .......... 2% 973K 2m2s 2020-11-20T12:15:49.941 INFO:tasks.workunit.client.0.smithi093.stderr: 4750K .......... .......... .......... .......... .......... 2% 2.54M 2m1s 2020-11-20T12:15:49.941 INFO:tasks.workunit.client.0.smithi093.stderr: 4800K .......... .......... .......... .......... .......... 2% 2.67M 2m1s 2020-11-20T12:15:50.191 INFO:tasks.workunit.client.0.smithi093.stderr: 4850K .......... .......... .......... .......... .......... 2% 143K 2m11s 2020-11-20T12:15:50.191 INFO:tasks.workunit.client.0.smithi093.stderr: 4900K .......... .......... .......... .......... .......... 2% 500M 2m10s 2020-11-20T12:15:50.192 INFO:tasks.workunit.client.0.smithi093.stderr: 4950K .......... .......... .......... .......... .......... 2% 497M 2m8s 2020-11-20T12:15:50.192 INFO:tasks.workunit.client.0.smithi093.stderr: 5000K .......... .......... .......... .......... .......... 2% 655M 2m7s 2020-11-20T12:15:50.192 INFO:tasks.workunit.client.0.smithi093.stderr: 5050K .......... .......... .......... .......... .......... 3% 674M 2m6s 2020-11-20T12:15:50.192 INFO:tasks.workunit.client.0.smithi093.stderr: 5100K .......... .......... .......... .......... .......... 3% 308M 2m4s 2020-11-20T12:15:50.193 INFO:tasks.workunit.client.0.smithi093.stderr: 5150K .......... .......... .......... .......... .......... 3% 613M 2m3s 2020-11-20T12:15:50.193 INFO:tasks.workunit.client.0.smithi093.stderr: 5200K .......... .......... .......... .......... .......... 3% 638M 2m2s 2020-11-20T12:15:50.193 INFO:tasks.workunit.client.0.smithi093.stderr: 5250K .......... .......... .......... .......... .......... 3% 669M 2m1s 2020-11-20T12:15:50.193 INFO:tasks.workunit.client.0.smithi093.stderr: 5300K .......... .......... .......... .......... .......... 3% 490M 2m0s 2020-11-20T12:15:50.203 INFO:tasks.workunit.client.0.smithi093.stderr: 5350K .......... .......... .......... .......... .......... 3% 2.93M 1m59s 2020-11-20T12:15:50.261 INFO:tasks.workunit.client.0.smithi093.stderr: 5400K .......... .......... .......... .......... .......... 3% 863K 2m0s 2020-11-20T12:15:50.277 INFO:tasks.workunit.client.0.smithi093.stderr: 5450K .......... .......... .......... .......... .......... 3% 3.11M 1m59s 2020-11-20T12:15:50.324 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:50.327 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:50.330 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:15:50.332 INFO:tasks.workunit.client.0.smithi093.stderr: 5500K .......... .......... .......... .......... .......... 3% 905K 2m0s 2020-11-20T12:15:50.348 INFO:tasks.workunit.client.0.smithi093.stderr: 5550K .......... .......... .......... .......... .......... 3% 3.19M 1m59s 2020-11-20T12:15:50.399 INFO:tasks.workunit.client.0.smithi093.stderr: 5600K .......... .......... .......... .......... .......... 3% 973K 1m59s 2020-11-20T12:15:50.411 INFO:tasks.workunit.client.0.smithi093.stderr: 5650K .......... .......... .......... .......... .......... 3% 4.33M 1m58s 2020-11-20T12:15:50.428 INFO:tasks.workunit.client.0.smithi093.stderr: 5700K .......... .......... .......... .......... .......... 3% 2.61M 1m58s 2020-11-20T12:15:50.475 INFO:tasks.workunit.client.0.smithi093.stderr: 5750K .......... .......... .......... .......... .......... 3% 1.05M 1m58s 2020-11-20T12:15:50.498 INFO:tasks.workunit.client.0.smithi093.stderr: 5800K .......... .......... .......... .......... .......... 3% 2.08M 1m58s 2020-11-20T12:15:50.547 INFO:tasks.workunit.client.0.smithi093.stderr: 5850K .......... .......... .......... .......... .......... 3% 1.01M 1m58s 2020-11-20T12:15:50.570 INFO:tasks.workunit.client.0.smithi093.stderr: 5900K .......... .......... .......... .......... .......... 3% 2.08M 1m58s 2020-11-20T12:15:50.620 INFO:tasks.workunit.client.0.smithi093.stderr: 5950K .......... .......... .......... .......... .......... 3% 999K 1m58s 2020-11-20T12:15:50.646 INFO:tasks.workunit.client.0.smithi093.stderr: 6000K .......... .......... .......... .......... .......... 3% 2.02M 1m58s 2020-11-20T12:15:50.691 INFO:tasks.workunit.client.0.smithi093.stderr: 6050K .......... .......... .......... .......... .......... 3% 1.05M 1m58s 2020-11-20T12:15:50.717 INFO:tasks.workunit.client.0.smithi093.stderr: 6100K .......... .......... .......... .......... .......... 3% 1.83M 1m58s 2020-11-20T12:15:50.761 INFO:tasks.workunit.client.0.smithi093.stderr: 6150K .......... .......... .......... .......... .......... 3% 1.11M 1m58s 2020-11-20T12:15:50.787 INFO:tasks.workunit.client.0.smithi093.stderr: 6200K .......... .......... .......... .......... .......... 3% 1.93M 1m57s 2020-11-20T12:15:50.831 INFO:tasks.workunit.client.0.smithi093.stderr: 6250K .......... .......... .......... .......... .......... 3% 1.10M 1m58s 2020-11-20T12:15:50.855 INFO:tasks.workunit.client.0.smithi093.stderr: 6300K .......... .......... .......... .......... .......... 3% 2.01M 1m57s 2020-11-20T12:15:50.895 INFO:tasks.workunit.client.0.smithi093.stderr: 6350K .......... .......... .......... .......... .......... 3% 1.28M 1m57s 2020-11-20T12:15:50.925 INFO:tasks.workunit.client.0.smithi093.stderr: 6400K .......... .......... .......... .......... .......... 3% 1.54M 1m57s 2020-11-20T12:15:50.967 INFO:tasks.workunit.client.0.smithi093.stderr: 6450K .......... .......... .......... .......... .......... 3% 1.20M 1m57s 2020-11-20T12:15:50.994 INFO:tasks.workunit.client.0.smithi093.stderr: 6500K .......... .......... .......... .......... .......... 3% 1.72M 1m57s 2020-11-20T12:15:51.041 INFO:tasks.workunit.client.0.smithi093.stderr: 6550K .......... .......... .......... .......... .......... 3% 1.03M 1m57s 2020-11-20T12:15:51.060 INFO:tasks.workunit.client.0.smithi093.stderr: 6600K .......... .......... .......... .......... .......... 3% 2.70M 1m57s 2020-11-20T12:15:51.110 INFO:tasks.workunit.client.0.smithi093.stderr: 6650K .......... .......... .......... .......... .......... 3% 983K 1m57s 2020-11-20T12:15:51.127 INFO:tasks.workunit.client.0.smithi093.stderr: 6700K .......... .......... .......... .......... .......... 4% 2.99M 1m57s 2020-11-20T12:15:51.181 INFO:tasks.workunit.client.0.smithi093.stderr: 6750K .......... .......... .......... .......... .......... 4% 942K 1m57s 2020-11-20T12:15:51.191 INFO:tasks.workunit.client.0.smithi093.stderr: 6800K .......... .......... .......... .......... .......... 4% 4.64M 1m56s 2020-11-20T12:15:51.229 INFO:tasks.workunit.client.0.smithi093.stderr: 6850K .......... .......... .......... .......... .......... 4% 1.27M 1m56s 2020-11-20T12:15:51.264 INFO:tasks.workunit.client.0.smithi093.stderr: 6900K .......... .......... .......... .......... .......... 4% 1.49M 1m56s 2020-11-20T12:15:51.303 INFO:tasks.workunit.client.0.smithi093.stderr: 6950K .......... .......... .......... .......... .......... 4% 1.21M 1m56s 2020-11-20T12:15:51.337 INFO:tasks.workunit.client.0.smithi093.stderr: 7000K .......... .......... .......... .......... .......... 4% 1.45M 1m56s 2020-11-20T12:15:51.359 INFO:tasks.workunit.client.0.smithi093.stderr: 7050K .......... .......... .......... .......... .......... 4% 2.15M 1m56s 2020-11-20T12:15:51.412 INFO:tasks.workunit.client.0.smithi093.stderr: 7100K .......... .......... .......... .......... .......... 4% 938K 1m56s 2020-11-20T12:15:51.433 INFO:tasks.workunit.client.0.smithi093.stderr: 7150K .......... .......... .......... .......... .......... 4% 2.29M 1m56s 2020-11-20T12:15:51.487 INFO:tasks.workunit.client.0.smithi093.stderr: 7200K .......... .......... .......... .......... .......... 4% 929K 1m56s 2020-11-20T12:15:51.504 INFO:tasks.workunit.client.0.smithi093.stderr: 7250K .......... .......... .......... .......... .......... 4% 3.85M 1m56s 2020-11-20T12:15:51.538 INFO:tasks.workunit.client.0.smithi093.stderr: 7300K .......... .......... .......... .......... .......... 4% 1.26M 1m56s 2020-11-20T12:15:51.570 INFO:tasks.workunit.client.0.smithi093.stderr: 7350K .......... .......... .......... .......... .......... 4% 1.53M 1m56s 2020-11-20T12:15:51.612 INFO:tasks.workunit.client.0.smithi093.stderr: 7400K .......... .......... .......... .......... .......... 4% 1.16M 1m56s 2020-11-20T12:15:51.648 INFO:tasks.workunit.client.0.smithi093.stderr: 7450K .......... .......... .......... .......... .......... 4% 1.52M 1m56s 2020-11-20T12:15:51.669 INFO:tasks.workunit.client.0.smithi093.stderr: 7500K .......... .......... .......... .......... .......... 4% 1.93M 1m55s 2020-11-20T12:15:51.723 INFO:tasks.workunit.client.0.smithi093.stderr: 7550K .......... .......... .......... .......... .......... 4% 939K 1m56s 2020-11-20T12:15:51.811 INFO:tasks.workunit.client.0.smithi093.stderr: 7600K .......... .......... .......... .......... .......... 4% 574K 1m57s 2020-11-20T12:15:51.811 INFO:tasks.workunit.client.0.smithi093.stderr: 7650K .......... .......... .......... .......... .......... 4% 471M 1m56s 2020-11-20T12:15:51.822 INFO:tasks.workunit.client.0.smithi093.stderr: 7700K .......... .......... .......... .......... .......... 4% 4.03M 1m55s 2020-11-20T12:15:51.874 INFO:tasks.workunit.client.0.smithi093.stderr: 7750K .......... .......... .......... .......... .......... 4% 977K 1m56s 2020-11-20T12:15:51.901 INFO:tasks.workunit.client.0.smithi093.stderr: 7800K .......... .......... .......... .......... .......... 4% 1.93M 1m55s 2020-11-20T12:15:51.945 INFO:tasks.workunit.client.0.smithi093.stderr: 7850K .......... .......... .......... .......... .......... 4% 1.04M 1m56s 2020-11-20T12:15:51.980 INFO:tasks.workunit.client.0.smithi093.stderr: 7900K .......... .......... .......... .......... .......... 4% 1.49M 1m55s 2020-11-20T12:15:52.021 INFO:tasks.workunit.client.0.smithi093.stderr: 7950K .......... .......... .......... .......... .......... 4% 1.15M 1m56s 2020-11-20T12:15:52.077 INFO:tasks.workunit.client.0.smithi093.stderr: 8000K .......... .......... .......... .......... .......... 4% 889K 1m56s 2020-11-20T12:15:52.099 INFO:tasks.workunit.client.0.smithi093.stderr: 8050K .......... .......... .......... .......... .......... 4% 2.24M 1m56s 2020-11-20T12:15:52.148 INFO:tasks.workunit.client.0.smithi093.stderr: 8100K .......... .......... .......... .......... .......... 4% 1008K 1m56s 2020-11-20T12:15:52.179 INFO:tasks.workunit.client.0.smithi093.stderr: 8150K .......... .......... .......... .......... .......... 4% 1.62M 1m56s 2020-11-20T12:15:52.218 INFO:tasks.workunit.client.0.smithi093.stderr: 8200K .......... .......... .......... .......... .......... 4% 1.24M 1m56s 2020-11-20T12:15:52.248 INFO:tasks.workunit.client.0.smithi093.stderr: 8250K .......... .......... .......... .......... .......... 4% 1.72M 1m56s 2020-11-20T12:15:52.292 INFO:tasks.workunit.client.0.smithi093.stderr: 8300K .......... .......... .......... .......... .......... 4% 1.06M 1m56s 2020-11-20T12:15:52.349 INFO:tasks.workunit.client.0.smithi093.stderr: 8350K .......... .......... .......... .......... .......... 4% 1.96M 1m55s 2020-11-20T12:15:52.370 INFO:tasks.workunit.client.0.smithi093.stderr: 8400K .......... .......... .......... .......... .......... 5% 949K 1m56s 2020-11-20T12:15:52.422 INFO:tasks.workunit.client.0.smithi093.stderr: 8450K .......... .......... .......... .......... .......... 5% 960K 1m56s 2020-11-20T12:15:52.444 INFO:tasks.workunit.client.0.smithi093.stderr: 8500K .......... .......... .......... .......... .......... 5% 2.45M 1m56s 2020-11-20T12:15:52.498 INFO:tasks.workunit.client.0.smithi093.stderr: 8550K .......... .......... .......... .......... .......... 5% 889K 1m56s 2020-11-20T12:15:52.533 INFO:tasks.workunit.client.0.smithi093.stderr: 8600K .......... .......... .......... .......... .......... 5% 2.28M 1m56s 2020-11-20T12:15:52.578 INFO:tasks.workunit.client.0.smithi093.stderr: 8650K .......... .......... .......... .......... .......... 5% 862K 1m56s 2020-11-20T12:15:52.607 INFO:tasks.workunit.client.0.smithi093.stderr: 8700K .......... .......... .......... .......... .......... 5% 1.67M 1m56s 2020-11-20T12:15:52.650 INFO:tasks.workunit.client.0.smithi093.stderr: 8750K .......... .......... .......... .......... .......... 5% 1.12M 1m56s 2020-11-20T12:15:52.678 INFO:tasks.workunit.client.0.smithi093.stderr: 8800K .......... .......... .......... .......... .......... 5% 1.78M 1m56s 2020-11-20T12:15:52.729 INFO:tasks.workunit.client.0.smithi093.stderr: 8850K .......... .......... .......... .......... .......... 5% 989K 1m56s 2020-11-20T12:15:52.751 INFO:tasks.workunit.client.0.smithi093.stderr: 8900K .......... .......... .......... .......... .......... 5% 2.26M 1m56s 2020-11-20T12:15:52.808 INFO:tasks.workunit.client.0.smithi093.stderr: 8950K .......... .......... .......... .......... .......... 5% 923K 1m56s 2020-11-20T12:15:52.867 INFO:tasks.workunit.client.0.smithi093.stderr: 9000K .......... .......... .......... .......... .......... 5% 809K 1m56s 2020-11-20T12:15:52.884 INFO:tasks.workunit.client.0.smithi093.stderr: 9050K .......... .......... .......... .......... .......... 5% 2.75M 1m56s 2020-11-20T12:15:52.946 INFO:tasks.workunit.client.0.smithi093.stderr: 9100K .......... .......... .......... .......... .......... 5% 813K 1m56s 2020-11-20T12:15:52.968 INFO:tasks.workunit.client.0.smithi093.stderr: 9150K .......... .......... .......... .......... .......... 5% 2.23M 1m56s 2020-11-20T12:15:53.028 INFO:tasks.workunit.client.0.smithi093.stderr: 9200K .......... .......... .......... .......... .......... 5% 816K 1m57s 2020-11-20T12:15:53.056 INFO:tasks.workunit.client.0.smithi093.stderr: 9250K .......... .......... .......... .......... .......... 5% 2.16M 1m56s 2020-11-20T12:15:53.108 INFO:tasks.workunit.client.0.smithi093.stderr: 9300K .......... .......... .......... .......... .......... 5% 891K 1m57s 2020-11-20T12:15:53.134 INFO:tasks.workunit.client.0.smithi093.stderr: 9350K .......... .......... .......... .......... .......... 5% 1.81M 1m56s 2020-11-20T12:15:53.273 INFO:tasks.workunit.client.0.smithi093.stderr: 9400K .......... .......... .......... .......... .......... 5% 907K 1m57s 2020-11-20T12:15:53.278 INFO:tasks.workunit.client.0.smithi093.stderr: 9450K .......... .......... .......... .......... .......... 5% 567K 1m57s 2020-11-20T12:15:53.305 INFO:tasks.workunit.client.0.smithi093.stderr: 9500K .......... .......... .......... .......... .......... 5% 1.81M 1m57s 2020-11-20T12:15:53.343 INFO:tasks.workunit.client.0.smithi093.stderr: 9550K .......... .......... .......... .......... .......... 5% 1.26M 1m57s 2020-11-20T12:15:53.386 INFO:tasks.workunit.client.0.smithi093.stderr: 9600K .......... .......... .......... .......... .......... 5% 1.21M 1m57s 2020-11-20T12:15:53.442 INFO:tasks.workunit.client.0.smithi093.stderr: 9650K .......... .......... .......... .......... .......... 5% 863K 1m58s 2020-11-20T12:15:53.498 INFO:tasks.workunit.client.0.smithi093.stderr: 9700K .......... .......... .......... .......... .......... 5% 987K 1m58s 2020-11-20T12:15:53.555 INFO:tasks.workunit.client.0.smithi093.stderr: 9750K .......... .......... .......... .......... .......... 5% 806K 1m58s 2020-11-20T12:15:53.585 INFO:tasks.workunit.client.0.smithi093.stderr: 9800K .......... .......... .......... .......... .......... 5% 1.59M 1m58s 2020-11-20T12:15:53.636 INFO:tasks.workunit.client.0.smithi093.stderr: 9850K .......... .......... .......... .......... .......... 5% 1003K 1m58s 2020-11-20T12:15:53.699 INFO:tasks.workunit.client.0.smithi093.stderr: 9900K .......... .......... .......... .......... .......... 5% 791K 1m59s 2020-11-20T12:15:53.730 INFO:tasks.workunit.client.0.smithi093.stderr: 9950K .......... .......... .......... .......... .......... 5% 1.61M 1m58s 2020-11-20T12:15:53.787 INFO:tasks.workunit.client.0.smithi093.stderr: 10000K .......... .......... .......... .......... .......... 5% 855K 1m59s 2020-11-20T12:15:53.855 INFO:tasks.workunit.client.0.smithi093.stderr: 10050K .......... .......... .......... .......... .......... 5% 827K 1m59s 2020-11-20T12:15:53.879 INFO:tasks.workunit.client.0.smithi093.stderr: 10100K .......... .......... .......... .......... .......... 6% 1.58M 1m59s 2020-11-20T12:15:53.943 INFO:tasks.workunit.client.0.smithi093.stderr: 10150K .......... .......... .......... .......... .......... 6% 831K 1m59s 2020-11-20T12:15:54.001 INFO:tasks.workunit.client.0.smithi093.stderr: 10200K .......... .......... .......... .......... .......... 6% 802K 2m0s 2020-11-20T12:15:54.030 INFO:tasks.workunit.client.0.smithi093.stderr: 10250K .......... .......... .......... .......... .......... 6% 1.69M 1m59s 2020-11-20T12:15:54.181 INFO:tasks.workunit.client.0.smithi093.stderr: 10300K .......... .......... .......... .......... .......... 6% 335K 2m1s 2020-11-20T12:15:54.181 INFO:tasks.workunit.client.0.smithi093.stderr: 10350K .......... .......... .......... .......... .......... 6% 355M 2m0s 2020-11-20T12:15:54.199 INFO:tasks.workunit.client.0.smithi093.stderr: 10400K .......... .......... .......... .......... .......... 6% 2.52M 2m0s 2020-11-20T12:15:54.277 INFO:tasks.workunit.client.0.smithi093.stderr: 10450K .......... .......... .......... .......... .......... 6% 635K 2m1s 2020-11-20T12:15:54.352 INFO:tasks.workunit.client.0.smithi093.stderr: 10500K .......... .......... .......... .......... .......... 6% 741K 2m1s 2020-11-20T12:15:54.421 INFO:tasks.workunit.client.0.smithi093.stderr: 10550K .......... .......... .......... .......... .......... 6% 657K 2m2s 2020-11-20T12:15:54.492 INFO:tasks.workunit.client.0.smithi093.stderr: 10600K .......... .......... .......... .......... .......... 6% 732K 2m2s 2020-11-20T12:15:54.563 INFO:tasks.workunit.client.0.smithi093.stderr: 10650K .......... .......... .......... .......... .......... 6% 676K 2m2s 2020-11-20T12:15:54.633 INFO:tasks.workunit.client.0.smithi093.stderr: 10700K .......... .......... .......... .......... .......... 6% 710K 2m3s 2020-11-20T12:15:54.704 INFO:tasks.workunit.client.0.smithi093.stderr: 10750K .......... .......... .......... .......... .......... 6% 712K 2m3s 2020-11-20T12:15:54.780 INFO:tasks.workunit.client.0.smithi093.stderr: 10800K .......... .......... .......... .......... .......... 6% 662K 2m4s 2020-11-20T12:15:54.816 INFO:tasks.workunit.client.0.smithi093.stderr: 10850K .......... .......... .......... .......... .......... 6% 1.37M 2m4s 2020-11-20T12:15:54.958 INFO:tasks.workunit.client.0.smithi093.stderr: 10900K .......... .......... .......... .......... .......... 6% 350K 2m5s 2020-11-20T12:15:54.966 INFO:tasks.workunit.client.0.smithi093.stderr: 10950K .......... .......... .......... .......... .......... 6% 7.06M 2m5s 2020-11-20T12:15:55.055 INFO:tasks.workunit.client.0.smithi093.stderr: 11000K .......... .......... .......... .......... .......... 6% 605K 2m5s 2020-11-20T12:15:55.126 INFO:tasks.workunit.client.0.smithi093.stderr: 11050K .......... .......... .......... .......... .......... 6% 633K 2m6s 2020-11-20T12:15:55.238 INFO:tasks.workunit.client.0.smithi093.stderr: 11100K .......... .......... .......... .......... .......... 6% 448K 2m7s 2020-11-20T12:15:55.308 INFO:tasks.workunit.client.0.smithi093.stderr: 11150K .......... .......... .......... .......... .......... 6% 714K 2m7s 2020-11-20T12:15:55.377 INFO:tasks.workunit.client.0.smithi093.stderr: 11200K .......... .......... .......... .......... .......... 6% 776K 2m7s 2020-11-20T12:15:55.447 INFO:tasks.workunit.client.0.smithi093.stderr: 11250K .......... .......... .......... .......... .......... 6% 673K 2m8s 2020-11-20T12:15:55.517 INFO:tasks.workunit.client.0.smithi093.stderr: 11300K .......... .......... .......... .......... .......... 6% 711K 2m8s 2020-11-20T12:15:55.600 INFO:tasks.workunit.client.0.smithi093.stderr: 11350K .......... .......... .......... .......... .......... 6% 662K 2m9s 2020-11-20T12:15:55.682 INFO:tasks.workunit.client.0.smithi093.stderr: 11400K .......... .......... .......... .......... .......... 6% 574K 2m9s 2020-11-20T12:15:55.821 INFO:tasks.workunit.client.0.smithi093.stderr: 11450K .......... .......... .......... .......... .......... 6% 358K 2m11s 2020-11-20T12:15:55.893 INFO:tasks.workunit.client.0.smithi093.stderr: 11500K .......... .......... .......... .......... .......... 6% 676K 2m11s 2020-11-20T12:15:55.983 INFO:tasks.workunit.client.0.smithi093.stderr: 11550K .......... .......... .......... .......... .......... 6% 554K 2m12s 2020-11-20T12:15:56.069 INFO:tasks.workunit.client.0.smithi093.stderr: 11600K .......... .......... .......... .......... .......... 6% 586K 2m12s 2020-11-20T12:15:56.205 INFO:tasks.workunit.client.0.smithi093.stderr: 11650K .......... .......... .......... .......... .......... 6% 366K 2m13s 2020-11-20T12:15:56.286 INFO:tasks.workunit.client.0.smithi093.stderr: 11700K .......... .......... .......... .......... .......... 6% 617K 2m14s 2020-11-20T12:15:56.380 INFO:tasks.workunit.client.0.smithi093.stderr: 11750K .......... .......... .......... .......... .......... 7% 530K 2m14s 2020-11-20T12:15:56.519 INFO:tasks.workunit.client.0.smithi093.stderr: 11800K .......... .......... .......... .......... .......... 7% 360K 2m16s 2020-11-20T12:15:56.600 INFO:tasks.workunit.client.0.smithi093.stderr: 11850K .......... .......... .......... .......... .......... 7% 618K 2m16s 2020-11-20T12:15:56.672 INFO:tasks.workunit.client.0.smithi093.stderr: 11900K .......... .......... .......... .......... .......... 7% 692K 2m16s 2020-11-20T12:15:56.752 INFO:tasks.workunit.client.0.smithi093.stderr: 11950K .......... .......... .......... .......... .......... 7% 626K 2m17s 2020-11-20T12:15:56.861 INFO:tasks.workunit.client.0.smithi093.stderr: 12000K .......... .......... .......... .......... .......... 7% 461K 2m18s 2020-11-20T12:15:56.930 INFO:tasks.workunit.client.0.smithi093.stderr: 12050K .......... .......... .......... .......... .......... 7% 718K 2m18s 2020-11-20T12:15:57.002 INFO:tasks.workunit.client.0.smithi093.stderr: 12100K .......... .......... .......... .......... .......... 7% 712K 2m18s 2020-11-20T12:15:57.067 INFO:tasks.workunit.client.0.smithi093.stderr: 12150K .......... .......... .......... .......... .......... 7% 743K 2m18s 2020-11-20T12:15:57.144 INFO:tasks.workunit.client.0.smithi093.stderr: 12200K .......... .......... .......... .......... .......... 7% 650K 2m19s 2020-11-20T12:15:57.212 INFO:tasks.workunit.client.0.smithi093.stderr: 12250K .......... .......... .......... .......... .......... 7% 742K 2m19s 2020-11-20T12:15:57.283 INFO:tasks.workunit.client.0.smithi093.stderr: 12300K .......... .......... .......... .......... .......... 7% 706K 2m19s 2020-11-20T12:15:57.344 INFO:tasks.workunit.client.0.smithi093.stderr: 12350K .......... .......... .......... .......... .......... 7% 814K 2m20s 2020-11-20T12:15:57.408 INFO:tasks.workunit.client.0.smithi093.stderr: 12400K .......... .......... .......... .......... .......... 7% 781K 2m20s 2020-11-20T12:15:57.477 INFO:tasks.workunit.client.0.smithi093.stderr: 12450K .......... .......... .......... .......... .......... 7% 768K 2m20s 2020-11-20T12:15:57.539 INFO:tasks.workunit.client.0.smithi093.stderr: 12500K .......... .......... .......... .......... .......... 7% 761K 2m20s 2020-11-20T12:15:57.607 INFO:tasks.workunit.client.0.smithi093.stderr: 12550K .......... .......... .......... .......... .......... 7% 739K 2m20s 2020-11-20T12:15:57.680 INFO:tasks.workunit.client.0.smithi093.stderr: 12600K .......... .......... .......... .......... .......... 7% 709K 2m21s 2020-11-20T12:15:57.740 INFO:tasks.workunit.client.0.smithi093.stderr: 12650K .......... .......... .......... .......... .......... 7% 802K 2m21s 2020-11-20T12:15:57.808 INFO:tasks.workunit.client.0.smithi093.stderr: 12700K .......... .......... .......... .......... .......... 7% 732K 2m21s 2020-11-20T12:15:57.878 INFO:tasks.workunit.client.0.smithi093.stderr: 12750K .......... .......... .......... .......... .......... 7% 807K 2m21s 2020-11-20T12:15:57.943 INFO:tasks.workunit.client.0.smithi093.stderr: 12800K .......... .......... .......... .......... .......... 7% 685K 2m22s 2020-11-20T12:15:58.013 INFO:tasks.workunit.client.0.smithi093.stderr: 12850K .......... .......... .......... .......... .......... 7% 707K 2m22s 2020-11-20T12:15:58.088 INFO:tasks.workunit.client.0.smithi093.stderr: 12900K .......... .......... .......... .......... .......... 7% 674K 2m22s 2020-11-20T12:15:58.154 INFO:tasks.workunit.client.0.smithi093.stderr: 12950K .......... .......... .......... .......... .......... 7% 754K 2m22s 2020-11-20T12:15:58.220 INFO:tasks.workunit.client.0.smithi093.stderr: 13000K .......... .......... .......... .......... .......... 7% 765K 2m22s 2020-11-20T12:15:58.261 INFO:tasks.workunit.client.0.smithi093.stderr: 13050K .......... .......... .......... .......... .......... 7% 1.18M 2m22s 2020-11-20T12:15:58.343 INFO:tasks.workunit.client.0.smithi093.stderr: 13100K .......... .......... .......... .......... .......... 7% 612K 2m23s 2020-11-20T12:15:58.416 INFO:tasks.workunit.client.0.smithi093.stderr: 13150K .......... .......... .......... .......... .......... 7% 677K 2m23s 2020-11-20T12:15:58.470 INFO:tasks.workunit.client.0.smithi093.stderr: 13200K .......... .......... .......... .......... .......... 7% 938K 2m23s 2020-11-20T12:15:58.541 INFO:tasks.workunit.client.0.smithi093.stderr: 13250K .......... .......... .......... .......... .......... 7% 699K 2m23s 2020-11-20T12:15:58.612 INFO:tasks.workunit.client.0.smithi093.stderr: 13300K .......... .......... .......... .......... .......... 7% 717K 2m24s 2020-11-20T12:15:58.649 INFO:tasks.workunit.client.0.smithi093.stderr: 13350K .......... .......... .......... .......... .......... 7% 1.26M 2m23s 2020-11-20T12:15:58.719 INFO:tasks.workunit.client.0.smithi093.stderr: 13400K .......... .......... .......... .......... .......... 7% 717K 2m24s 2020-11-20T12:15:58.781 INFO:tasks.workunit.client.0.smithi093.stderr: 13450K .......... .......... .......... .......... .......... 8% 812K 2m24s 2020-11-20T12:15:58.847 INFO:tasks.workunit.client.0.smithi093.stderr: 13500K .......... .......... .......... .......... .......... 8% 802K 2m24s 2020-11-20T12:15:58.918 INFO:tasks.workunit.client.0.smithi093.stderr: 13550K .......... .......... .......... .......... .......... 8% 702K 2m24s 2020-11-20T12:15:58.949 INFO:tasks.workunit.client.0.smithi093.stderr: 13600K .......... .......... .......... .......... .......... 8% 1.44M 2m24s 2020-11-20T12:15:59.021 INFO:tasks.workunit.client.0.smithi093.stderr: 13650K .......... .......... .......... .......... .......... 8% 691K 2m24s 2020-11-20T12:15:59.092 INFO:tasks.workunit.client.0.smithi093.stderr: 13700K .......... .......... .......... .......... .......... 8% 714K 2m24s 2020-11-20T12:15:59.154 INFO:tasks.workunit.client.0.smithi093.stderr: 13750K .......... .......... .......... .......... .......... 8% 800K 2m25s 2020-11-20T12:15:59.227 INFO:tasks.workunit.client.0.smithi093.stderr: 13800K .......... .......... .......... .......... .......... 8% 683K 2m25s 2020-11-20T12:15:59.261 INFO:tasks.workunit.client.0.smithi093.stderr: 13850K .......... .......... .......... .......... .......... 8% 1.41M 2m25s 2020-11-20T12:15:59.330 INFO:tasks.workunit.client.0.smithi093.stderr: 13900K .......... .......... .......... .......... .......... 8% 739K 2m25s 2020-11-20T12:15:59.387 INFO:tasks.workunit.client.0.smithi093.stderr: 13950K .......... .......... .......... .......... .......... 8% 856K 2m25s 2020-11-20T12:15:59.419 INFO:tasks.workunit.client.0.smithi093.stderr: 14000K .......... .......... .......... .......... .......... 8% 1.56M 2m25s 2020-11-20T12:15:59.484 INFO:tasks.workunit.client.0.smithi093.stderr: 14050K .......... .......... .......... .......... .......... 8% 783K 2m25s 2020-11-20T12:15:59.541 INFO:tasks.workunit.client.0.smithi093.stderr: 14100K .......... .......... .......... .......... .......... 8% 1.03M 2m25s 2020-11-20T12:15:59.587 INFO:tasks.workunit.client.0.smithi093.stderr: 14150K .......... .......... .......... .......... .......... 8% 873K 2m25s 2020-11-20T12:15:59.626 INFO:tasks.workunit.client.0.smithi093.stderr: 14200K .......... .......... .......... .......... .......... 8% 1.25M 2m25s 2020-11-20T12:15:59.690 INFO:tasks.workunit.client.0.smithi093.stderr: 14250K .......... .......... .......... .......... .......... 8% 784K 2m25s 2020-11-20T12:15:59.734 INFO:tasks.workunit.client.0.smithi093.stderr: 14300K .......... .......... .......... .......... .......... 8% 1.09M 2m25s 2020-11-20T12:15:59.797 INFO:tasks.workunit.client.0.smithi093.stderr: 14350K .......... .......... .......... .......... .......... 8% 817K 2m25s 2020-11-20T12:15:59.832 INFO:tasks.workunit.client.0.smithi093.stderr: 14400K .......... .......... .......... .......... .......... 8% 1.34M 2m25s 2020-11-20T12:15:59.881 INFO:tasks.workunit.client.0.smithi093.stderr: 14450K .......... .......... .......... .......... .......... 8% 1.14M 2m25s 2020-11-20T12:15:59.944 INFO:tasks.workunit.client.0.smithi093.stderr: 14500K .......... .......... .......... .......... .......... 8% 732K 2m25s 2020-11-20T12:15:59.980 INFO:tasks.workunit.client.0.smithi093.stderr: 14550K .......... .......... .......... .......... .......... 8% 1.34M 2m25s 2020-11-20T12:16:00.030 INFO:tasks.workunit.client.0.smithi093.stderr: 14600K .......... .......... .......... .......... .......... 8% 989K 2m25s 2020-11-20T12:16:00.093 INFO:tasks.workunit.client.0.smithi093.stderr: 14650K .......... .......... .......... .......... .......... 8% 805K 2m25s 2020-11-20T12:16:00.133 INFO:tasks.workunit.client.0.smithi093.stderr: 14700K .......... .......... .......... .......... .......... 8% 1.20M 2m25s 2020-11-20T12:16:00.180 INFO:tasks.workunit.client.0.smithi093.stderr: 14750K .......... .......... .......... .......... .......... 8% 1.05M 2m25s 2020-11-20T12:16:00.246 INFO:tasks.workunit.client.0.smithi093.stderr: 14800K .......... .......... .......... .......... .......... 8% 754K 2m25s 2020-11-20T12:16:00.289 INFO:tasks.workunit.client.0.smithi093.stderr: 14850K .......... .......... .......... .......... .......... 8% 1.14M 2m25s 2020-11-20T12:16:00.339 INFO:tasks.workunit.client.0.smithi093.stderr: 14900K .......... .......... .......... .......... .......... 8% 1.04M 2m25s 2020-11-20T12:16:00.453 INFO:tasks.workunit.client.0.smithi093.stderr: 14950K .......... .......... .......... .......... .......... 8% 428K 2m25s 2020-11-20T12:16:00.482 INFO:tasks.workunit.client.0.smithi093.stderr: 15000K .......... .......... .......... .......... .......... 8% 1.68M 2m25s 2020-11-20T12:16:00.527 INFO:tasks.workunit.client.0.smithi093.stderr: 15050K .......... .......... .......... .......... .......... 8% 1.10M 2m25s 2020-11-20T12:16:00.596 INFO:tasks.workunit.client.0.smithi093.stderr: 15100K .......... .......... .......... .......... .......... 8% 721K 2m25s 2020-11-20T12:16:00.658 INFO:tasks.workunit.client.0.smithi093.stderr: 15150K .......... .......... .......... .......... .......... 9% 795K 2m25s 2020-11-20T12:16:00.718 INFO:tasks.workunit.client.0.smithi093.stderr: 15200K .......... .......... .......... .......... .......... 9% 843K 2m25s 2020-11-20T12:16:00.760 INFO:tasks.workunit.client.0.smithi093.stderr: 15250K .......... .......... .......... .......... .......... 9% 1.20M 2m25s 2020-11-20T12:16:00.830 INFO:tasks.workunit.client.0.smithi093.stderr: 15300K .......... .......... .......... .......... .......... 9% 722K 2m25s 2020-11-20T12:16:00.892 INFO:tasks.workunit.client.0.smithi093.stderr: 15350K .......... .......... .......... .......... .......... 9% 779K 2m25s 2020-11-20T12:16:00.922 INFO:tasks.workunit.client.0.smithi093.stderr: 15400K .......... .......... .......... .......... .......... 9% 1.65M 2m25s 2020-11-20T12:16:00.991 INFO:tasks.workunit.client.0.smithi093.stderr: 15450K .......... .......... .......... .......... .......... 9% 722K 2m25s 2020-11-20T12:16:01.040 INFO:tasks.workunit.client.0.smithi093.stderr: 15500K .......... .......... .......... .......... .......... 9% 1007K 2m25s 2020-11-20T12:16:01.106 INFO:tasks.workunit.client.0.smithi093.stderr: 15550K .......... .......... .......... .......... .......... 9% 792K 2m26s 2020-11-20T12:16:01.136 INFO:tasks.workunit.client.0.smithi093.stderr: 15600K .......... .......... .......... .......... .......... 9% 1.53M 2m25s 2020-11-20T12:16:01.208 INFO:tasks.workunit.client.0.smithi093.stderr: 15650K .......... .......... .......... .......... .......... 9% 693K 2m26s 2020-11-20T12:16:01.259 INFO:tasks.workunit.client.0.smithi093.stderr: 15700K .......... .......... .......... .......... .......... 9% 1005K 2m25s 2020-11-20T12:16:01.327 INFO:tasks.workunit.client.0.smithi093.stderr: 15750K .......... .......... .......... .......... .......... 9% 718K 2m26s 2020-11-20T12:16:01.360 INFO:tasks.workunit.client.0.smithi093.stderr: 15800K .......... .......... .......... .......... .......... 9% 1.53M 2m25s 2020-11-20T12:16:01.433 INFO:tasks.workunit.client.0.smithi093.stderr: 15850K .......... .......... .......... .......... .......... 9% 682K 2m26s 2020-11-20T12:16:01.481 INFO:tasks.workunit.client.0.smithi093.stderr: 15900K .......... .......... .......... .......... .......... 9% 1.00M 2m26s 2020-11-20T12:16:01.553 INFO:tasks.workunit.client.0.smithi093.stderr: 15950K .......... .......... .......... .......... .......... 9% 694K 2m26s 2020-11-20T12:16:01.591 INFO:tasks.workunit.client.0.smithi093.stderr: 16000K .......... .......... .......... .......... .......... 9% 1.28M 2m26s 2020-11-20T12:16:01.642 INFO:tasks.workunit.client.0.smithi093.stderr: 16050K .......... .......... .......... .......... .......... 9% 998K 2m26s 2020-11-20T12:16:01.707 INFO:tasks.workunit.client.0.smithi093.stderr: 16100K .......... .......... .......... .......... .......... 9% 763K 2m26s 2020-11-20T12:16:01.755 INFO:tasks.workunit.client.0.smithi093.stderr: 16150K .......... .......... .......... .......... .......... 9% 1.02M 2m26s 2020-11-20T12:16:01.820 INFO:tasks.workunit.client.0.smithi093.stderr: 16200K .......... .......... .......... .......... .......... 9% 765K 2m26s 2020-11-20T12:16:01.866 INFO:tasks.workunit.client.0.smithi093.stderr: 16250K .......... .......... .......... .......... .......... 9% 1.17M 2m26s 2020-11-20T12:16:01.912 INFO:tasks.workunit.client.0.smithi093.stderr: 16300K .......... .......... .......... .......... .......... 9% 987K 2m26s 2020-11-20T12:16:01.971 INFO:tasks.workunit.client.0.smithi093.stderr: 16350K .......... .......... .......... .......... .......... 9% 860K 2m26s 2020-11-20T12:16:02.010 INFO:tasks.workunit.client.0.smithi093.stderr: 16400K .......... .......... .......... .......... .......... 9% 1.25M 2m26s 2020-11-20T12:16:02.081 INFO:tasks.workunit.client.0.smithi093.stderr: 16450K .......... .......... .......... .......... .......... 9% 726K 2m26s 2020-11-20T12:16:02.122 INFO:tasks.workunit.client.0.smithi093.stderr: 16500K .......... .......... .......... .......... .......... 9% 1.14M 2m26s 2020-11-20T12:16:02.165 INFO:tasks.workunit.client.0.smithi093.stderr: 16550K .......... .......... .......... .......... .......... 9% 1.15M 2m26s 2020-11-20T12:16:02.235 INFO:tasks.workunit.client.0.smithi093.stderr: 16600K .......... .......... .......... .......... .......... 9% 1.21M 2m25s 2020-11-20T12:16:02.274 INFO:tasks.workunit.client.0.smithi093.stderr: 16650K .......... .......... .......... .......... .......... 9% 724K 2m26s 2020-11-20T12:16:02.396 INFO:tasks.workunit.client.0.smithi093.stderr: 16700K .......... .......... .......... .......... .......... 9% 411K 2m26s 2020-11-20T12:16:02.397 INFO:tasks.workunit.client.0.smithi093.stderr: 16750K .......... .......... .......... .......... .......... 9% 234M 2m26s 2020-11-20T12:16:02.443 INFO:tasks.workunit.client.0.smithi093.stderr: 16800K .......... .......... .......... .......... .......... 9% 1.03M 2m26s 2020-11-20T12:16:02.518 INFO:tasks.workunit.client.0.smithi093.stderr: 16850K .......... .......... .......... .......... .......... 10% 660K 2m26s 2020-11-20T12:16:02.591 INFO:tasks.workunit.client.0.smithi093.stderr: 16900K .......... .......... .......... .......... .......... 10% 688K 2m26s 2020-11-20T12:16:02.663 INFO:tasks.workunit.client.0.smithi093.stderr: 16950K .......... .......... .......... .......... .......... 10% 696K 2m26s 2020-11-20T12:16:02.700 INFO:tasks.workunit.client.0.smithi093.stderr: 17000K .......... .......... .......... .......... .......... 10% 1.32M 2m26s 2020-11-20T12:16:02.774 INFO:tasks.workunit.client.0.smithi093.stderr: 17050K .......... .......... .......... .......... .......... 10% 675K 2m26s 2020-11-20T12:16:02.849 INFO:tasks.workunit.client.0.smithi093.stderr: 17100K .......... .......... .......... .......... .......... 10% 666K 2m26s 2020-11-20T12:16:02.921 INFO:tasks.workunit.client.0.smithi093.stderr: 17150K .......... .......... .......... .......... .......... 10% 706K 2m27s 2020-11-20T12:16:03.005 INFO:tasks.workunit.client.0.smithi093.stderr: 17200K .......... .......... .......... .......... .......... 10% 613K 2m27s 2020-11-20T12:16:03.080 INFO:tasks.workunit.client.0.smithi093.stderr: 17250K .......... .......... .......... .......... .......... 10% 649K 2m27s 2020-11-20T12:16:03.156 INFO:tasks.workunit.client.0.smithi093.stderr: 17300K .......... .......... .......... .......... .......... 10% 651K 2m27s 2020-11-20T12:16:03.230 INFO:tasks.workunit.client.0.smithi093.stderr: 17350K .......... .......... .......... .......... .......... 10% 674K 2m27s 2020-11-20T12:16:03.304 INFO:tasks.workunit.client.0.smithi093.stderr: 17400K .......... .......... .......... .......... .......... 10% 684K 2m28s 2020-11-20T12:16:03.380 INFO:tasks.workunit.client.0.smithi093.stderr: 17450K .......... .......... .......... .......... .......... 10% 648K 2m28s 2020-11-20T12:16:03.502 INFO:tasks.workunit.client.0.smithi093.stderr: 17500K .......... .......... .......... .......... .......... 10% 408K 2m28s 2020-11-20T12:16:03.583 INFO:tasks.workunit.client.0.smithi093.stderr: 17550K .......... .......... .......... .......... .......... 10% 617K 2m29s 2020-11-20T12:16:03.673 INFO:tasks.workunit.client.0.smithi093.stderr: 17600K .......... .......... .......... .......... .......... 10% 650K 2m29s 2020-11-20T12:16:03.754 INFO:tasks.workunit.client.0.smithi093.stderr: 17650K .......... .......... .......... .......... .......... 10% 535K 2m29s 2020-11-20T12:16:03.835 INFO:tasks.workunit.client.0.smithi093.stderr: 17700K .......... .......... .......... .......... .......... 10% 630K 2m29s 2020-11-20T12:16:03.920 INFO:tasks.workunit.client.0.smithi093.stderr: 17750K .......... .......... .......... .......... .......... 10% 579K 2m30s 2020-11-20T12:16:03.995 INFO:tasks.workunit.client.0.smithi093.stderr: 17800K .......... .......... .......... .......... .......... 10% 662K 2m30s 2020-11-20T12:16:04.066 INFO:tasks.workunit.client.0.smithi093.stderr: 17850K .......... .......... .......... .......... .......... 10% 707K 2m30s 2020-11-20T12:16:04.139 INFO:tasks.workunit.client.0.smithi093.stderr: 17900K .......... .......... .......... .......... .......... 10% 679K 2m30s 2020-11-20T12:16:04.211 INFO:tasks.workunit.client.0.smithi093.stderr: 17950K .......... .......... .......... .......... .......... 10% 699K 2m30s 2020-11-20T12:16:04.281 INFO:tasks.workunit.client.0.smithi093.stderr: 18000K .......... .......... .......... .......... .......... 10% 715K 2m30s 2020-11-20T12:16:04.352 INFO:tasks.workunit.client.0.smithi093.stderr: 18050K .......... .......... .......... .......... .......... 10% 731K 2m30s 2020-11-20T12:16:04.423 INFO:tasks.workunit.client.0.smithi093.stderr: 18100K .......... .......... .......... .......... .......... 10% 678K 2m31s 2020-11-20T12:16:04.495 INFO:tasks.workunit.client.0.smithi093.stderr: 18150K .......... .......... .......... .......... .......... 10% 692K 2m31s 2020-11-20T12:16:04.570 INFO:tasks.workunit.client.0.smithi093.stderr: 18200K .......... .......... .......... .......... .......... 10% 667K 2m31s 2020-11-20T12:16:04.647 INFO:tasks.workunit.client.0.smithi093.stderr: 18250K .......... .......... .......... .......... .......... 10% 654K 2m31s 2020-11-20T12:16:04.727 INFO:tasks.workunit.client.0.smithi093.stderr: 18300K .......... .......... .......... .......... .......... 10% 716K 2m31s 2020-11-20T12:16:04.792 INFO:tasks.workunit.client.0.smithi093.stderr: 18350K .......... .......... .......... .......... .......... 10% 1.91M 2m31s 2020-11-20T12:16:04.820 INFO:tasks.workunit.client.0.smithi093.stderr: 18400K .......... .......... .......... .......... .......... 10% 643K 2m31s 2020-11-20T12:16:04.897 INFO:tasks.workunit.client.0.smithi093.stderr: 18450K .......... .......... .......... .......... .......... 10% 645K 2m31s 2020-11-20T12:16:04.974 INFO:tasks.workunit.client.0.smithi093.stderr: 18500K .......... .......... .......... .......... .......... 11% 671K 2m31s 2020-11-20T12:16:05.048 INFO:tasks.workunit.client.0.smithi093.stderr: 18550K .......... .......... .......... .......... .......... 11% 771K 2m31s 2020-11-20T12:16:05.104 INFO:tasks.workunit.client.0.smithi093.stderr: 18600K .......... .......... .......... .......... .......... 11% 790K 2m31s 2020-11-20T12:16:05.166 INFO:tasks.workunit.client.0.smithi093.stderr: 18650K .......... .......... .......... .......... .......... 11% 753K 2m31s 2020-11-20T12:16:05.226 INFO:tasks.workunit.client.0.smithi093.stderr: 18700K .......... .......... .......... .......... .......... 11% 840K 2m32s 2020-11-20T12:16:05.271 INFO:tasks.workunit.client.0.smithi093.stderr: 18750K .......... .......... .......... .......... .......... 11% 1.09M 2m31s 2020-11-20T12:16:05.344 INFO:tasks.workunit.client.0.smithi093.stderr: 18800K .......... .......... .......... .......... .......... 11% 698K 2m32s 2020-11-20T12:16:05.418 INFO:tasks.workunit.client.0.smithi093.stderr: 18850K .......... .......... .......... .......... .......... 11% 801K 2m32s 2020-11-20T12:16:05.472 INFO:tasks.workunit.client.0.smithi093.stderr: 18900K .......... .......... .......... .......... .......... 11% 747K 2m32s 2020-11-20T12:16:05.536 INFO:tasks.workunit.client.0.smithi093.stderr: 18950K .......... .......... .......... .......... .......... 11% 776K 2m32s 2020-11-20T12:16:05.578 INFO:tasks.workunit.client.0.smithi093.stderr: 19000K .......... .......... .......... .......... .......... 11% 1.17M 2m32s 2020-11-20T12:16:05.651 INFO:tasks.workunit.client.0.smithi093.stderr: 19050K .......... .......... .......... .......... .......... 11% 693K 2m32s 2020-11-20T12:16:05.718 INFO:tasks.workunit.client.0.smithi093.stderr: 19100K .......... .......... .......... .......... .......... 11% 737K 2m32s 2020-11-20T12:16:05.779 INFO:tasks.workunit.client.0.smithi093.stderr: 19150K .......... .......... .......... .......... .......... 11% 825K 2m32s 2020-11-20T12:16:05.815 INFO:tasks.workunit.client.0.smithi093.stderr: 19200K .......... .......... .......... .......... .......... 11% 1.34M 2m32s 2020-11-20T12:16:05.890 INFO:tasks.workunit.client.0.smithi093.stderr: 19250K .......... .......... .......... .......... .......... 11% 671K 2m32s 2020-11-20T12:16:05.963 INFO:tasks.workunit.client.0.smithi093.stderr: 19300K .......... .......... .......... .......... .......... 11% 791K 2m32s 2020-11-20T12:16:06.016 INFO:tasks.workunit.client.0.smithi093.stderr: 19350K .......... .......... .......... .......... .......... 11% 797K 2m32s 2020-11-20T12:16:06.051 INFO:tasks.workunit.client.0.smithi093.stderr: 19400K .......... .......... .......... .......... .......... 11% 1.42M 2m32s 2020-11-20T12:16:06.117 INFO:tasks.workunit.client.0.smithi093.stderr: 19450K .......... .......... .......... .......... .......... 11% 750K 2m32s 2020-11-20T12:16:06.175 INFO:tasks.workunit.client.0.smithi093.stderr: 19500K .......... .......... .......... .......... .......... 11% 859K 2m32s 2020-11-20T12:16:06.237 INFO:tasks.workunit.client.0.smithi093.stderr: 19550K .......... .......... .......... .......... .......... 11% 806K 2m32s 2020-11-20T12:16:06.268 INFO:tasks.workunit.client.0.smithi093.stderr: 19600K .......... .......... .......... .......... .......... 11% 1.63M 2m32s 2020-11-20T12:16:06.327 INFO:tasks.workunit.client.0.smithi093.stderr: 19650K .......... .......... .......... .......... .......... 11% 879K 2m32s 2020-11-20T12:16:06.380 INFO:tasks.workunit.client.0.smithi093.stderr: 19700K .......... .......... .......... .......... .......... 11% 894K 2m32s 2020-11-20T12:16:06.432 INFO:tasks.workunit.client.0.smithi093.stderr: 19750K .......... .......... .......... .......... .......... 11% 1.51M 2m31s 2020-11-20T12:16:06.473 INFO:tasks.workunit.client.0.smithi093.stderr: 19800K .......... .......... .......... .......... .......... 11% 819K 2m31s 2020-11-20T12:16:06.535 INFO:tasks.workunit.client.0.smithi093.stderr: 19850K .......... .......... .......... .......... .......... 11% 851K 2m31s 2020-11-20T12:16:06.586 INFO:tasks.workunit.client.0.smithi093.stderr: 19900K .......... .......... .......... .......... .......... 11% 930K 2m31s 2020-11-20T12:16:06.625 INFO:tasks.workunit.client.0.smithi093.stderr: 19950K .......... .......... .......... .......... .......... 11% 1.26M 2m31s 2020-11-20T12:16:06.684 INFO:tasks.workunit.client.0.smithi093.stderr: 20000K .......... .......... .......... .......... .......... 11% 840K 2m31s 2020-11-20T12:16:06.738 INFO:tasks.workunit.client.0.smithi093.stderr: 20050K .......... .......... .......... .......... .......... 11% 932K 2m31s 2020-11-20T12:16:06.785 INFO:tasks.workunit.client.0.smithi093.stderr: 20100K .......... .......... .......... .......... .......... 11% 1.23M 2m31s 2020-11-20T12:16:06.842 INFO:tasks.workunit.client.0.smithi093.stderr: 20150K .......... .......... .......... .......... .......... 11% 769K 2m31s 2020-11-20T12:16:06.894 INFO:tasks.workunit.client.0.smithi093.stderr: 20200K .......... .......... .......... .......... .......... 12% 1.04M 2m31s 2020-11-20T12:16:06.934 INFO:tasks.workunit.client.0.smithi093.stderr: 20250K .......... .......... .......... .......... .......... 12% 1.09M 2m31s 2020-11-20T12:16:07.000 INFO:tasks.workunit.client.0.smithi093.stderr: 20300K .......... .......... .......... .......... .......... 12% 759K 2m31s 2020-11-20T12:16:07.051 INFO:tasks.workunit.client.0.smithi093.stderr: 20350K .......... .......... .......... .......... .......... 12% 977K 2m31s 2020-11-20T12:16:07.093 INFO:tasks.workunit.client.0.smithi093.stderr: 20400K .......... .......... .......... .......... .......... 12% 1.21M 2m31s 2020-11-20T12:16:07.158 INFO:tasks.workunit.client.0.smithi093.stderr: 20450K .......... .......... .......... .......... .......... 12% 755K 2m31s 2020-11-20T12:16:07.173 INFO:tasks.workunit.client.0.smithi093.stderr: 20500K .......... .......... .......... .......... .......... 12% 3.17M 2m31s 2020-11-20T12:16:07.243 INFO:tasks.workunit.client.0.smithi093.stderr: 20550K .......... .......... .......... .......... .......... 12% 746K 2m31s 2020-11-20T12:16:07.302 INFO:tasks.workunit.client.0.smithi093.stderr: 20600K .......... .......... .......... .......... .......... 12% 808K 2m31s 2020-11-20T12:16:07.317 INFO:tasks.workunit.client.0.smithi093.stderr: 20650K .......... .......... .......... .......... .......... 12% 3.24M 2m30s 2020-11-20T12:16:07.387 INFO:tasks.workunit.client.0.smithi093.stderr: 20700K .......... .......... .......... .......... .......... 12% 723K 2m30s 2020-11-20T12:16:07.447 INFO:tasks.workunit.client.0.smithi093.stderr: 20750K .......... .......... .......... .......... .......... 12% 1.29M 2m30s 2020-11-20T12:16:07.464 INFO:tasks.workunit.client.0.smithi093.stderr: 20800K .......... .......... .......... .......... .......... 12% 1.22M 2m30s 2020-11-20T12:16:07.526 INFO:tasks.workunit.client.0.smithi093.stderr: 20850K .......... .......... .......... .......... .......... 12% 814K 2m30s 2020-11-20T12:16:07.546 INFO:tasks.workunit.client.0.smithi093.stderr: 20900K .......... .......... .......... .......... .......... 12% 2.39M 2m30s 2020-11-20T12:16:07.610 INFO:tasks.workunit.client.0.smithi093.stderr: 20950K .......... .......... .......... .......... .......... 12% 796K 2m30s 2020-11-20T12:16:07.674 INFO:tasks.workunit.client.0.smithi093.stderr: 21000K .......... .......... .......... .......... .......... 12% 773K 2m30s 2020-11-20T12:16:07.695 INFO:tasks.workunit.client.0.smithi093.stderr: 21050K .......... .......... .......... .......... .......... 12% 2.29M 2m30s 2020-11-20T12:16:07.758 INFO:tasks.workunit.client.0.smithi093.stderr: 21100K .......... .......... .......... .......... .......... 12% 804K 2m30s 2020-11-20T12:16:07.782 INFO:tasks.workunit.client.0.smithi093.stderr: 21150K .......... .......... .......... .......... .......... 12% 2.02M 2m30s 2020-11-20T12:16:07.846 INFO:tasks.workunit.client.0.smithi093.stderr: 21200K .......... .......... .......... .......... .......... 12% 780K 2m30s 2020-11-20T12:16:07.908 INFO:tasks.workunit.client.0.smithi093.stderr: 21250K .......... .......... .......... .......... .......... 12% 799K 2m30s 2020-11-20T12:16:08.013 INFO:tasks.workunit.client.0.smithi093.stderr: 21300K .......... .......... .......... .......... .......... 12% 488K 2m30s 2020-11-20T12:16:08.024 INFO:tasks.workunit.client.0.smithi093.stderr: 21350K .......... .......... .......... .......... .......... 12% 4.54M 2m30s 2020-11-20T12:16:08.073 INFO:tasks.workunit.client.0.smithi093.stderr: 21400K .......... .......... .......... .......... .......... 12% 969K 2m30s 2020-11-20T12:16:08.135 INFO:tasks.workunit.client.0.smithi093.stderr: 21450K .......... .......... .......... .......... .......... 12% 2.08M 2m29s 2020-11-20T12:16:08.166 INFO:tasks.workunit.client.0.smithi093.stderr: 21500K .......... .......... .......... .......... .......... 12% 734K 2m29s 2020-11-20T12:16:08.232 INFO:tasks.workunit.client.0.smithi093.stderr: 21550K .......... .......... .......... .......... .......... 12% 759K 2m29s 2020-11-20T12:16:08.293 INFO:tasks.workunit.client.0.smithi093.stderr: 21600K .......... .......... .......... .......... .......... 12% 800K 2m29s 2020-11-20T12:16:08.357 INFO:tasks.workunit.client.0.smithi093.stderr: 21650K .......... .......... .......... .......... .......... 12% 776K 2m30s 2020-11-20T12:16:08.382 INFO:tasks.workunit.client.0.smithi093.stderr: 21700K .......... .......... .......... .......... .......... 12% 1.97M 2m29s 2020-11-20T12:16:08.445 INFO:tasks.workunit.client.0.smithi093.stderr: 21750K .......... .......... .......... .......... .......... 12% 798K 2m29s 2020-11-20T12:16:08.498 INFO:tasks.workunit.client.0.smithi093.stderr: 21800K .......... .......... .......... .......... .......... 12% 935K 2m29s 2020-11-20T12:16:08.562 INFO:tasks.workunit.client.0.smithi093.stderr: 21850K .......... .......... .......... .......... .......... 12% 814K 2m29s 2020-11-20T12:16:08.594 INFO:tasks.workunit.client.0.smithi093.stderr: 21900K .......... .......... .......... .......... .......... 13% 1.54M 2m29s 2020-11-20T12:16:08.656 INFO:tasks.workunit.client.0.smithi093.stderr: 21950K .......... .......... .......... .......... .......... 13% 778K 2m29s 2020-11-20T12:16:08.713 INFO:tasks.workunit.client.0.smithi093.stderr: 22000K .......... .......... .......... .......... .......... 13% 883K 2m29s 2020-11-20T12:16:08.743 INFO:tasks.workunit.client.0.smithi093.stderr: 22050K .......... .......... .......... .......... .......... 13% 1.57M 2m29s 2020-11-20T12:16:08.808 INFO:tasks.workunit.client.0.smithi093.stderr: 22100K .......... .......... .......... .......... .......... 13% 823K 2m29s 2020-11-20T12:16:08.860 INFO:tasks.workunit.client.0.smithi093.stderr: 22150K .......... .......... .......... .......... .......... 13% 893K 2m29s 2020-11-20T12:16:08.890 INFO:tasks.workunit.client.0.smithi093.stderr: 22200K .......... .......... .......... .......... .......... 13% 1.63M 2m29s 2020-11-20T12:16:08.958 INFO:tasks.workunit.client.0.smithi093.stderr: 22250K .......... .......... .......... .......... .......... 13% 741K 2m29s 2020-11-20T12:16:09.010 INFO:tasks.workunit.client.0.smithi093.stderr: 22300K .......... .......... .......... .......... .......... 13% 953K 2m29s 2020-11-20T12:16:09.046 INFO:tasks.workunit.client.0.smithi093.stderr: 22350K .......... .......... .......... .......... .......... 13% 1.47M 2m29s 2020-11-20T12:16:09.106 INFO:tasks.workunit.client.0.smithi093.stderr: 22400K .......... .......... .......... .......... .......... 13% 788K 2m29s 2020-11-20T12:16:09.165 INFO:tasks.workunit.client.0.smithi093.stderr: 22450K .......... .......... .......... .......... .......... 13% 890K 2m29s 2020-11-20T12:16:09.199 INFO:tasks.workunit.client.0.smithi093.stderr: 22500K .......... .......... .......... .......... .......... 13% 1.37M 2m29s 2020-11-20T12:16:09.259 INFO:tasks.workunit.client.0.smithi093.stderr: 22550K .......... .......... .......... .......... .......... 13% 871K 2m29s 2020-11-20T12:16:09.312 INFO:tasks.workunit.client.0.smithi093.stderr: 22600K .......... .......... .......... .......... .......... 13% 888K 2m28s 2020-11-20T12:16:09.350 INFO:tasks.workunit.client.0.smithi093.stderr: 22650K .......... .......... .......... .......... .......... 13% 1.29M 2m28s 2020-11-20T12:16:09.443 INFO:tasks.workunit.client.0.smithi093.stderr: 22700K .......... .......... .......... .......... .......... 13% 542K 2m29s 2020-11-20T12:16:09.478 INFO:tasks.workunit.client.0.smithi093.stderr: 22750K .......... .......... .......... .......... .......... 13% 1.36M 2m28s 2020-11-20T12:16:09.546 INFO:tasks.workunit.client.0.smithi093.stderr: 22800K .......... .......... .......... .......... .......... 13% 741K 2m28s 2020-11-20T12:16:09.593 INFO:tasks.workunit.client.0.smithi093.stderr: 22850K .......... .......... .......... .......... .......... 13% 1.03M 2m28s 2020-11-20T12:16:09.654 INFO:tasks.workunit.client.0.smithi093.stderr: 22900K .......... .......... .......... .......... .......... 13% 826K 2m28s 2020-11-20T12:16:09.721 INFO:tasks.workunit.client.0.smithi093.stderr: 22950K .......... .......... .......... .......... .......... 13% 746K 2m28s 2020-11-20T12:16:09.785 INFO:tasks.workunit.client.0.smithi093.stderr: 23000K .......... .......... .......... .......... .......... 13% 803K 2m28s 2020-11-20T12:16:09.839 INFO:tasks.workunit.client.0.smithi093.stderr: 23050K .......... .......... .......... .......... .......... 13% 887K 2m28s 2020-11-20T12:16:09.902 INFO:tasks.workunit.client.0.smithi093.stderr: 23100K .......... .......... .......... .......... .......... 13% 796K 2m28s 2020-11-20T12:16:09.934 INFO:tasks.workunit.client.0.smithi093.stderr: 23150K .......... .......... .......... .......... .......... 13% 1.51M 2m28s 2020-11-20T12:16:09.993 INFO:tasks.workunit.client.0.smithi093.stderr: 23200K .......... .......... .......... .......... .......... 13% 845K 2m28s 2020-11-20T12:16:10.062 INFO:tasks.workunit.client.0.smithi093.stderr: 23250K .......... .......... .......... .......... .......... 13% 737K 2m28s 2020-11-20T12:16:10.119 INFO:tasks.workunit.client.0.smithi093.stderr: 23300K .......... .......... .......... .......... .......... 13% 859K 2m28s 2020-11-20T12:16:10.189 INFO:tasks.workunit.client.0.smithi093.stderr: 23350K .......... .......... .......... .......... .......... 13% 719K 2m28s 2020-11-20T12:16:10.222 INFO:tasks.workunit.client.0.smithi093.stderr: 23400K .......... .......... .......... .......... .......... 13% 1.47M 2m28s 2020-11-20T12:16:10.292 INFO:tasks.workunit.client.0.smithi093.stderr: 23450K .......... .......... .......... .......... .......... 13% 720K 2m28s 2020-11-20T12:16:10.349 INFO:tasks.workunit.client.0.smithi093.stderr: 23500K .......... .......... .......... .......... .......... 13% 874K 2m28s 2020-11-20T12:16:10.419 INFO:tasks.workunit.client.0.smithi093.stderr: 23550K .......... .......... .......... .......... .......... 14% 711K 2m28s 2020-11-20T12:16:10.461 INFO:tasks.workunit.client.0.smithi093.stderr: 23600K .......... .......... .......... .......... .......... 14% 1.16M 2m28s 2020-11-20T12:16:10.523 INFO:tasks.workunit.client.0.smithi093.stderr: 23650K .......... .......... .......... .......... .......... 14% 806K 2m28s 2020-11-20T12:16:10.582 INFO:tasks.workunit.client.0.smithi093.stderr: 23700K .......... .......... .......... .......... .......... 14% 846K 2m28s 2020-11-20T12:16:10.657 INFO:tasks.workunit.client.0.smithi093.stderr: 23750K .......... .......... .......... .......... .......... 14% 665K 2m28s 2020-11-20T12:16:10.702 INFO:tasks.workunit.client.0.smithi093.stderr: 23800K .......... .......... .......... .......... .......... 14% 1.20M 2m28s 2020-11-20T12:16:10.760 INFO:tasks.workunit.client.0.smithi093.stderr: 23850K .......... .......... .......... .......... .......... 14% 804K 2m28s 2020-11-20T12:16:10.812 INFO:tasks.workunit.client.0.smithi093.stderr: 23900K .......... .......... .......... .......... .......... 14% 1008K 2m28s 2020-11-20T12:16:10.875 INFO:tasks.workunit.client.0.smithi093.stderr: 23950K .......... .......... .......... .......... .......... 14% 786K 2m28s 2020-11-20T12:16:10.909 INFO:tasks.workunit.client.0.smithi093.stderr: 24000K .......... .......... .......... .......... .......... 14% 1.48M 2m28s 2020-11-20T12:16:10.962 INFO:tasks.workunit.client.0.smithi093.stderr: 24050K .......... .......... .......... .......... .......... 14% 908K 2m28s 2020-11-20T12:16:11.007 INFO:tasks.workunit.client.0.smithi093.stderr: 24100K .......... .......... .......... .......... .......... 14% 1.07M 2m28s 2020-11-20T12:16:11.046 INFO:tasks.workunit.client.0.smithi093.stderr: 24150K .......... .......... .......... .......... .......... 14% 1.31M 2m28s 2020-11-20T12:16:11.097 INFO:tasks.workunit.client.0.smithi093.stderr: 24200K .......... .......... .......... .......... .......... 14% 952K 2m28s 2020-11-20T12:16:11.144 INFO:tasks.workunit.client.0.smithi093.stderr: 24250K .......... .......... .......... .......... .......... 14% 1.04M 2m28s 2020-11-20T12:16:11.205 INFO:tasks.workunit.client.0.smithi093.stderr: 24300K .......... .......... .......... .......... .......... 14% 821K 2m28s 2020-11-20T12:16:11.242 INFO:tasks.workunit.client.0.smithi093.stderr: 24350K .......... .......... .......... .......... .......... 14% 1.32M 2m28s 2020-11-20T12:16:11.286 INFO:tasks.workunit.client.0.smithi093.stderr: 24400K .......... .......... .......... .......... .......... 14% 1.10M 2m27s 2020-11-20T12:16:11.347 INFO:tasks.workunit.client.0.smithi093.stderr: 24450K .......... .......... .......... .......... .......... 14% 829K 2m27s 2020-11-20T12:16:11.377 INFO:tasks.workunit.client.0.smithi093.stderr: 24500K .......... .......... .......... .......... .......... 14% 1.60M 2m27s 2020-11-20T12:16:11.432 INFO:tasks.workunit.client.0.smithi093.stderr: 24550K .......... .......... .......... .......... .......... 14% 906K 2m27s 2020-11-20T12:16:11.491 INFO:tasks.workunit.client.0.smithi093.stderr: 24600K .......... .......... .......... .......... .......... 14% 851K 2m27s 2020-11-20T12:16:11.524 INFO:tasks.workunit.client.0.smithi093.stderr: 24650K .......... .......... .......... .......... .......... 14% 1.47M 2m27s 2020-11-20T12:16:11.577 INFO:tasks.workunit.client.0.smithi093.stderr: 24700K .......... .......... .......... .......... .......... 14% 944K 2m27s 2020-11-20T12:16:11.637 INFO:tasks.workunit.client.0.smithi093.stderr: 24750K .......... .......... .......... .......... .......... 14% 842K 2m27s 2020-11-20T12:16:11.673 INFO:tasks.workunit.client.0.smithi093.stderr: 24800K .......... .......... .......... .......... .......... 14% 1.43M 2m27s 2020-11-20T12:16:11.729 INFO:tasks.workunit.client.0.smithi093.stderr: 24850K .......... .......... .......... .......... .......... 14% 853K 2m27s 2020-11-20T12:16:11.772 INFO:tasks.workunit.client.0.smithi093.stderr: 24900K .......... .......... .......... .......... .......... 14% 1.25M 2m27s 2020-11-20T12:16:11.826 INFO:tasks.workunit.client.0.smithi093.stderr: 24950K .......... .......... .......... .......... .......... 14% 896K 2m27s 2020-11-20T12:16:11.930 INFO:tasks.workunit.client.0.smithi093.stderr: 25000K .......... .......... .......... .......... .......... 14% 477K 2m27s 2020-11-20T12:16:11.930 INFO:tasks.workunit.client.0.smithi093.stderr: 25050K .......... .......... .......... .......... .......... 14% 467M 2m27s 2020-11-20T12:16:12.004 INFO:tasks.workunit.client.0.smithi093.stderr: 25100K .......... .......... .......... .......... .......... 14% 702K 2m27s 2020-11-20T12:16:12.076 INFO:tasks.workunit.client.0.smithi093.stderr: 25150K .......... .......... .......... .......... .......... 14% 653K 2m27s 2020-11-20T12:16:12.151 INFO:tasks.workunit.client.0.smithi093.stderr: 25200K .......... .......... .......... .......... .......... 14% 678K 2m27s 2020-11-20T12:16:12.248 INFO:tasks.workunit.client.0.smithi093.stderr: 25250K .......... .......... .......... .......... .......... 15% 516K 2m27s 2020-11-20T12:16:12.307 INFO:tasks.workunit.client.0.smithi093.stderr: 25300K .......... .......... .......... .......... .......... 15% 837K 2m27s 2020-11-20T12:16:12.385 INFO:tasks.workunit.client.0.smithi093.stderr: 25350K .......... .......... .......... .......... .......... 15% 642K 2m27s 2020-11-20T12:16:12.456 INFO:tasks.workunit.client.0.smithi093.stderr: 25400K .......... .......... .......... .......... .......... 15% 711K 2m27s 2020-11-20T12:16:12.532 INFO:tasks.workunit.client.0.smithi093.stderr: 25450K .......... .......... .......... .......... .......... 15% 654K 2m27s 2020-11-20T12:16:12.615 INFO:tasks.workunit.client.0.smithi093.stderr: 25500K .......... .......... .......... .......... .......... 15% 727K 2m27s 2020-11-20T12:16:12.689 INFO:tasks.workunit.client.0.smithi093.stderr: 25550K .......... .......... .......... .......... .......... 15% 564K 2m28s 2020-11-20T12:16:12.767 INFO:tasks.workunit.client.0.smithi093.stderr: 25600K .......... .......... .......... .......... .......... 15% 644K 2m28s 2020-11-20T12:16:12.834 INFO:tasks.workunit.client.0.smithi093.stderr: 25650K .......... .......... .......... .......... .......... 15% 740K 2m28s 2020-11-20T12:16:12.909 INFO:tasks.workunit.client.0.smithi093.stderr: 25700K .......... .......... .......... .......... .......... 15% 672K 2m28s 2020-11-20T12:16:12.985 INFO:tasks.workunit.client.0.smithi093.stderr: 25750K .......... .......... .......... .......... .......... 15% 661K 2m28s 2020-11-20T12:16:13.064 INFO:tasks.workunit.client.0.smithi093.stderr: 25800K .......... .......... .......... .......... .......... 15% 633K 2m28s 2020-11-20T12:16:13.140 INFO:tasks.workunit.client.0.smithi093.stderr: 25850K .......... .......... .......... .......... .......... 15% 658K 2m28s 2020-11-20T12:16:13.218 INFO:tasks.workunit.client.0.smithi093.stderr: 25900K .......... .......... .......... .......... .......... 15% 647K 2m28s 2020-11-20T12:16:13.296 INFO:tasks.workunit.client.0.smithi093.stderr: 25950K .......... .......... .......... .......... .......... 15% 631K 2m28s 2020-11-20T12:16:13.377 INFO:tasks.workunit.client.0.smithi093.stderr: 26000K .......... .......... .......... .......... .......... 15% 613K 2m28s 2020-11-20T12:16:13.462 INFO:tasks.workunit.client.0.smithi093.stderr: 26050K .......... .......... .......... .......... .......... 15% 612K 2m28s 2020-11-20T12:16:13.542 INFO:tasks.workunit.client.0.smithi093.stderr: 26100K .......... .......... .......... .......... .......... 15% 642K 2m29s 2020-11-20T12:16:13.604 INFO:tasks.workunit.client.0.smithi093.stderr: 26150K .......... .......... .......... .......... .......... 15% 748K 2m29s 2020-11-20T12:16:13.677 INFO:tasks.workunit.client.0.smithi093.stderr: 26200K .......... .......... .......... .......... .......... 15% 687K 2m29s 2020-11-20T12:16:13.751 INFO:tasks.workunit.client.0.smithi093.stderr: 26250K .......... .......... .......... .......... .......... 15% 673K 2m29s 2020-11-20T12:16:13.793 INFO:tasks.workunit.client.0.smithi093.stderr: 26300K .......... .......... .......... .......... .......... 15% 1.16M 2m29s 2020-11-20T12:16:13.861 INFO:tasks.workunit.client.0.smithi093.stderr: 26350K .......... .......... .......... .......... .......... 15% 739K 2m29s 2020-11-20T12:16:13.931 INFO:tasks.workunit.client.0.smithi093.stderr: 26400K .......... .......... .......... .......... .......... 15% 729K 2m29s 2020-11-20T12:16:14.004 INFO:tasks.workunit.client.0.smithi093.stderr: 26450K .......... .......... .......... .......... .......... 15% 668K 2m29s 2020-11-20T12:16:14.060 INFO:tasks.workunit.client.0.smithi093.stderr: 26500K .......... .......... .......... .......... .......... 15% 893K 2m29s 2020-11-20T12:16:14.125 INFO:tasks.workunit.client.0.smithi093.stderr: 26550K .......... .......... .......... .......... .......... 15% 767K 2m29s 2020-11-20T12:16:14.194 INFO:tasks.workunit.client.0.smithi093.stderr: 26600K .......... .......... .......... .......... .......... 15% 729K 2m29s 2020-11-20T12:16:14.253 INFO:tasks.workunit.client.0.smithi093.stderr: 26650K .......... .......... .......... .......... .......... 15% 848K 2m29s 2020-11-20T12:16:14.328 INFO:tasks.workunit.client.0.smithi093.stderr: 26700K .......... .......... .......... .......... .......... 15% 665K 2m29s 2020-11-20T12:16:14.482 INFO:tasks.workunit.client.0.smithi093.stderr: 26750K .......... .......... .......... .......... .......... 15% 717K 2m29s 2020-11-20T12:16:14.482 INFO:tasks.workunit.client.0.smithi093.stderr: 26800K .......... .......... .......... .......... .......... 15% 596K 2m29s 2020-11-20T12:16:14.560 INFO:tasks.workunit.client.0.smithi093.stderr: 26850K .......... .......... .......... .......... .......... 15% 640K 2m29s 2020-11-20T12:16:14.690 INFO:tasks.workunit.client.0.smithi093.stderr: 26900K .......... .......... .......... .......... .......... 15% 385K 2m29s 2020-11-20T12:16:14.752 INFO:tasks.workunit.client.0.smithi093.stderr: 26950K .......... .......... .......... .......... .......... 16% 803K 2m29s 2020-11-20T12:16:14.841 INFO:tasks.workunit.client.0.smithi093.stderr: 27000K .......... .......... .......... .......... .......... 16% 562K 2m30s 2020-11-20T12:16:14.943 INFO:tasks.workunit.client.0.smithi093.stderr: 27050K .......... .......... .......... .......... .......... 16% 491K 2m30s 2020-11-20T12:16:15.023 INFO:tasks.workunit.client.0.smithi093.stderr: 27100K .......... .......... .......... .......... .......... 16% 620K 2m30s 2020-11-20T12:16:15.125 INFO:tasks.workunit.client.0.smithi093.stderr: 27150K .......... .......... .......... .......... .......... 16% 496K 2m30s 2020-11-20T12:16:15.216 INFO:tasks.workunit.client.0.smithi093.stderr: 27200K .......... .......... .......... .......... .......... 16% 568K 2m30s 2020-11-20T12:16:15.318 INFO:tasks.workunit.client.0.smithi093.stderr: 27250K .......... .......... .......... .......... .......... 16% 477K 2m30s 2020-11-20T12:16:15.392 INFO:tasks.workunit.client.0.smithi093.stderr: 27300K .......... .......... .......... .......... .......... 16% 672K 2m30s 2020-11-20T12:16:15.476 INFO:tasks.workunit.client.0.smithi093.stderr: 27350K .......... .......... .......... .......... .......... 16% 593K 2m31s 2020-11-20T12:16:15.557 INFO:tasks.workunit.client.0.smithi093.stderr: 27400K .......... .......... .......... .......... .......... 16% 651K 2m31s 2020-11-20T12:16:15.666 INFO:tasks.workunit.client.0.smithi093.stderr: 27450K .......... .......... .......... .......... .......... 16% 442K 2m31s 2020-11-20T12:16:15.754 INFO:tasks.workunit.client.0.smithi093.stderr: 27500K .......... .......... .......... .......... .......... 16% 618K 2m31s 2020-11-20T12:16:15.839 INFO:tasks.workunit.client.0.smithi093.stderr: 27550K .......... .......... .......... .......... .......... 16% 543K 2m31s 2020-11-20T12:16:15.915 INFO:tasks.workunit.client.0.smithi093.stderr: 27600K .......... .......... .......... .......... .......... 16% 657K 2m31s 2020-11-20T12:16:15.997 INFO:tasks.workunit.client.0.smithi093.stderr: 27650K .......... .......... .......... .......... .......... 16% 619K 2m31s 2020-11-20T12:16:16.115 INFO:tasks.workunit.client.0.smithi093.stderr: 27700K .......... .......... .......... .......... .......... 16% 420K 2m31s 2020-11-20T12:16:16.195 INFO:tasks.workunit.client.0.smithi093.stderr: 27750K .......... .......... .......... .......... .......... 16% 657K 2m32s 2020-11-20T12:16:16.283 INFO:tasks.workunit.client.0.smithi093.stderr: 27800K .......... .......... .......... .......... .......... 16% 546K 2m32s 2020-11-20T12:16:16.369 INFO:tasks.workunit.client.0.smithi093.stderr: 27850K .......... .......... .......... .......... .......... 16% 612K 2m32s 2020-11-20T12:16:16.583 INFO:tasks.workunit.client.0.smithi093.stderr: 27900K .......... .......... .......... .......... .......... 16% 622K 2m32s 2020-11-20T12:16:16.585 INFO:tasks.workunit.client.0.smithi093.stderr: 27950K .......... .......... .......... .......... .......... 16% 631K 2m32s 2020-11-20T12:16:16.608 INFO:tasks.workunit.client.0.smithi093.stderr: 28000K .......... .......... .......... .......... .......... 16% 621K 2m32s 2020-11-20T12:16:16.673 INFO:tasks.workunit.client.0.smithi093.stderr: 28050K .......... .......... .......... .......... .......... 16% 730K 2m32s 2020-11-20T12:16:16.739 INFO:tasks.workunit.client.0.smithi093.stderr: 28100K .......... .......... .......... .......... .......... 16% 857K 2m32s 2020-11-20T12:16:16.797 INFO:tasks.workunit.client.0.smithi093.stderr: 28150K .......... .......... .......... .......... .......... 16% 764K 2m32s 2020-11-20T12:16:16.863 INFO:tasks.workunit.client.0.smithi093.stderr: 28200K .......... .......... .......... .......... .......... 16% 786K 2m32s 2020-11-20T12:16:16.925 INFO:tasks.workunit.client.0.smithi093.stderr: 28250K .......... .......... .......... .......... .......... 16% 766K 2m32s 2020-11-20T12:16:16.997 INFO:tasks.workunit.client.0.smithi093.stderr: 28300K .......... .......... .......... .......... .......... 16% 760K 2m32s 2020-11-20T12:16:17.060 INFO:tasks.workunit.client.0.smithi093.stderr: 28350K .......... .......... .......... .......... .......... 16% 726K 2m32s 2020-11-20T12:16:17.131 INFO:tasks.workunit.client.0.smithi093.stderr: 28400K .......... .......... .......... .......... .......... 16% 716K 2m32s 2020-11-20T12:16:17.202 INFO:tasks.workunit.client.0.smithi093.stderr: 28450K .......... .......... .......... .......... .......... 16% 701K 2m32s 2020-11-20T12:16:17.237 INFO:tasks.workunit.client.0.smithi093.stderr: 28500K .......... .......... .......... .......... .......... 16% 1.38M 2m32s 2020-11-20T12:16:17.310 INFO:tasks.workunit.client.0.smithi093.stderr: 28550K .......... .......... .......... .......... .......... 16% 741K 2m32s 2020-11-20T12:16:17.382 INFO:tasks.workunit.client.0.smithi093.stderr: 28600K .......... .......... .......... .......... .......... 16% 650K 2m32s 2020-11-20T12:16:17.452 INFO:tasks.workunit.client.0.smithi093.stderr: 28650K .......... .......... .......... .......... .......... 17% 720K 2m32s 2020-11-20T12:16:17.515 INFO:tasks.workunit.client.0.smithi093.stderr: 28700K .......... .......... .......... .......... .......... 17% 780K 2m32s 2020-11-20T12:16:17.591 INFO:tasks.workunit.client.0.smithi093.stderr: 28750K .......... .......... .......... .......... .......... 17% 739K 2m32s 2020-11-20T12:16:17.663 INFO:tasks.workunit.client.0.smithi093.stderr: 28800K .......... .......... .......... .......... .......... 17% 625K 2m32s 2020-11-20T12:16:17.750 INFO:tasks.workunit.client.0.smithi093.stderr: 28850K .......... .......... .......... .......... .......... 17% 576K 2m32s 2020-11-20T12:16:17.819 INFO:tasks.workunit.client.0.smithi093.stderr: 28900K .......... .......... .......... .......... .......... 17% 718K 2m32s 2020-11-20T12:16:17.906 INFO:tasks.workunit.client.0.smithi093.stderr: 28950K .......... .......... .......... .......... .......... 17% 591K 2m32s 2020-11-20T12:16:17.989 INFO:tasks.workunit.client.0.smithi093.stderr: 29000K .......... .......... .......... .......... .......... 17% 586K 2m32s 2020-11-20T12:16:18.069 INFO:tasks.workunit.client.0.smithi093.stderr: 29050K .......... .......... .......... .......... .......... 17% 622K 2m32s 2020-11-20T12:16:18.148 INFO:tasks.workunit.client.0.smithi093.stderr: 29100K .......... .......... .......... .......... .......... 17% 725K 2m32s 2020-11-20T12:16:18.222 INFO:tasks.workunit.client.0.smithi093.stderr: 29150K .......... .......... .......... .......... .......... 17% 594K 2m33s 2020-11-20T12:16:18.293 INFO:tasks.workunit.client.0.smithi093.stderr: 29200K .......... .......... .......... .......... .......... 17% 710K 2m33s 2020-11-20T12:16:18.366 INFO:tasks.workunit.client.0.smithi093.stderr: 29250K .......... .......... .......... .......... .......... 17% 684K 2m33s 2020-11-20T12:16:18.428 INFO:tasks.workunit.client.0.smithi093.stderr: 29300K .......... .......... .......... .......... .......... 17% 809K 2m33s 2020-11-20T12:16:18.503 INFO:tasks.workunit.client.0.smithi093.stderr: 29350K .......... .......... .......... .......... .......... 17% 666K 2m33s 2020-11-20T12:16:18.574 INFO:tasks.workunit.client.0.smithi093.stderr: 29400K .......... .......... .......... .......... .......... 17% 697K 2m33s 2020-11-20T12:16:18.649 INFO:tasks.workunit.client.0.smithi093.stderr: 29450K .......... .......... .......... .......... .......... 17% 719K 2m33s 2020-11-20T12:16:18.719 INFO:tasks.workunit.client.0.smithi093.stderr: 29500K .......... .......... .......... .......... .......... 17% 661K 2m33s 2020-11-20T12:16:18.793 INFO:tasks.workunit.client.0.smithi093.stderr: 29550K .......... .......... .......... .......... .......... 17% 687K 2m33s 2020-11-20T12:16:18.872 INFO:tasks.workunit.client.0.smithi093.stderr: 29600K .......... .......... .......... .......... .......... 17% 625K 2m33s 2020-11-20T12:16:18.953 INFO:tasks.workunit.client.0.smithi093.stderr: 29650K .......... .......... .......... .......... .......... 17% 641K 2m33s 2020-11-20T12:16:19.115 INFO:tasks.workunit.client.0.smithi093.stderr: 29700K .......... .......... .......... .......... .......... 17% 304K 2m33s 2020-11-20T12:16:19.119 INFO:tasks.workunit.client.0.smithi093.stderr: 29750K .......... .......... .......... .......... .......... 17% 24.3M 2m33s 2020-11-20T12:16:19.190 INFO:tasks.workunit.client.0.smithi093.stderr: 29800K .......... .......... .......... .......... .......... 17% 677K 2m33s 2020-11-20T12:16:19.274 INFO:tasks.workunit.client.0.smithi093.stderr: 29850K .......... .......... .......... .......... .......... 17% 602K 2m33s 2020-11-20T12:16:19.348 INFO:tasks.workunit.client.0.smithi093.stderr: 29900K .......... .......... .......... .......... .......... 17% 710K 2m33s 2020-11-20T12:16:19.404 INFO:tasks.workunit.client.0.smithi093.stderr: 29950K .......... .......... .......... .......... .......... 17% 840K 2m33s 2020-11-20T12:16:19.494 INFO:tasks.workunit.client.0.smithi093.stderr: 30000K .......... .......... .......... .......... .......... 17% 578K 2m33s 2020-11-20T12:16:19.557 INFO:tasks.workunit.client.0.smithi093.stderr: 30050K .......... .......... .......... .......... .......... 17% 750K 2m33s 2020-11-20T12:16:19.629 INFO:tasks.workunit.client.0.smithi093.stderr: 30100K .......... .......... .......... .......... .......... 17% 700K 2m33s 2020-11-20T12:16:19.710 INFO:tasks.workunit.client.0.smithi093.stderr: 30150K .......... .......... .......... .......... .......... 17% 616K 2m33s 2020-11-20T12:16:19.778 INFO:tasks.workunit.client.0.smithi093.stderr: 30200K .......... .......... .......... .......... .......... 17% 735K 2m33s 2020-11-20T12:16:19.845 INFO:tasks.workunit.client.0.smithi093.stderr: 30250K .......... .......... .......... .......... .......... 17% 740K 2m33s 2020-11-20T12:16:19.916 INFO:tasks.workunit.client.0.smithi093.stderr: 30300K .......... .......... .......... .......... .......... 18% 733K 2m33s 2020-11-20T12:16:19.986 INFO:tasks.workunit.client.0.smithi093.stderr: 30350K .......... .......... .......... .......... .......... 18% 689K 2m33s 2020-11-20T12:16:20.059 INFO:tasks.workunit.client.0.smithi093.stderr: 30400K .......... .......... .......... .......... .......... 18% 677K 2m33s 2020-11-20T12:16:20.130 INFO:tasks.workunit.client.0.smithi093.stderr: 30450K .......... .......... .......... .......... .......... 18% 710K 2m33s 2020-11-20T12:16:20.205 INFO:tasks.workunit.client.0.smithi093.stderr: 30500K .......... .......... .......... .......... .......... 18% 667K 2m33s 2020-11-20T12:16:20.279 INFO:tasks.workunit.client.0.smithi093.stderr: 30550K .......... .......... .......... .......... .......... 18% 681K 2m33s 2020-11-20T12:16:20.358 INFO:tasks.workunit.client.0.smithi093.stderr: 30600K .......... .......... .......... .......... .......... 18% 629K 2m33s 2020-11-20T12:16:20.422 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:20.427 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:20.431 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:20.435 INFO:tasks.workunit.client.0.smithi093.stderr: 30650K .......... .......... .......... .......... .......... 18% 644K 2m33s 2020-11-20T12:16:20.514 INFO:tasks.workunit.client.0.smithi093.stderr: 30700K .......... .......... .......... .......... .......... 18% 640K 2m34s 2020-11-20T12:16:20.598 INFO:tasks.workunit.client.0.smithi093.stderr: 30750K .......... .......... .......... .......... .......... 18% 627K 2m34s 2020-11-20T12:16:20.674 INFO:tasks.workunit.client.0.smithi093.stderr: 30800K .......... .......... .......... .......... .......... 18% 660K 2m34s 2020-11-20T12:16:20.746 INFO:tasks.workunit.client.0.smithi093.stderr: 30850K .......... .......... .......... .......... .......... 18% 655K 2m34s 2020-11-20T12:16:20.820 INFO:tasks.workunit.client.0.smithi093.stderr: 30900K .......... .......... .......... .......... .......... 18% 847K 2m34s 2020-11-20T12:16:20.879 INFO:tasks.workunit.client.0.smithi093.stderr: 30950K .......... .......... .......... .......... .......... 18% 677K 2m34s 2020-11-20T12:16:20.938 INFO:tasks.workunit.client.0.smithi093.stderr: 31000K .......... .......... .......... .......... .......... 18% 835K 2m34s 2020-11-20T12:16:21.001 INFO:tasks.workunit.client.0.smithi093.stderr: 31050K .......... .......... .......... .......... .......... 18% 794K 2m34s 2020-11-20T12:16:21.068 INFO:tasks.workunit.client.0.smithi093.stderr: 31100K .......... .......... .......... .......... .......... 18% 753K 2m34s 2020-11-20T12:16:21.106 INFO:tasks.workunit.client.0.smithi093.stderr: 31150K .......... .......... .......... .......... .......... 18% 1.27M 2m33s 2020-11-20T12:16:21.173 INFO:tasks.workunit.client.0.smithi093.stderr: 31200K .......... .......... .......... .......... .......... 18% 744K 2m33s 2020-11-20T12:16:21.239 INFO:tasks.workunit.client.0.smithi093.stderr: 31250K .......... .......... .......... .......... .......... 18% 756K 2m33s 2020-11-20T12:16:21.294 INFO:tasks.workunit.client.0.smithi093.stderr: 31300K .......... .......... .......... .......... .......... 18% 1.10M 2m33s 2020-11-20T12:16:21.352 INFO:tasks.workunit.client.0.smithi093.stderr: 31350K .......... .......... .......... .......... .......... 18% 759K 2m33s 2020-11-20T12:16:21.420 INFO:tasks.workunit.client.0.smithi093.stderr: 31400K .......... .......... .......... .......... .......... 18% 716K 2m33s 2020-11-20T12:16:21.471 INFO:tasks.workunit.client.0.smithi093.stderr: 31450K .......... .......... .......... .......... .......... 18% 973K 2m33s 2020-11-20T12:16:21.543 INFO:tasks.workunit.client.0.smithi093.stderr: 31500K .......... .......... .......... .......... .......... 18% 695K 2m33s 2020-11-20T12:16:21.596 INFO:tasks.workunit.client.0.smithi093.stderr: 31550K .......... .......... .......... .......... .......... 18% 950K 2m33s 2020-11-20T12:16:21.656 INFO:tasks.workunit.client.0.smithi093.stderr: 31600K .......... .......... .......... .......... .......... 18% 825K 2m33s 2020-11-20T12:16:21.708 INFO:tasks.workunit.client.0.smithi093.stderr: 31650K .......... .......... .......... .......... .......... 18% 962K 2m33s 2020-11-20T12:16:21.780 INFO:tasks.workunit.client.0.smithi093.stderr: 31700K .......... .......... .......... .......... .......... 18% 701K 2m33s 2020-11-20T12:16:21.907 INFO:tasks.workunit.client.0.smithi093.stderr: 31750K .......... .......... .......... .......... .......... 18% 652K 2m33s 2020-11-20T12:16:21.907 INFO:tasks.workunit.client.0.smithi093.stderr: 31800K .......... .......... .......... .......... .......... 18% 1.13M 2m33s 2020-11-20T12:16:21.977 INFO:tasks.workunit.client.0.smithi093.stderr: 31850K .......... .......... .......... .......... .......... 18% 653K 2m33s 2020-11-20T12:16:22.020 INFO:tasks.workunit.client.0.smithi093.stderr: 31900K .......... .......... .......... .......... .......... 18% 1.16M 2m33s 2020-11-20T12:16:22.087 INFO:tasks.workunit.client.0.smithi093.stderr: 31950K .......... .......... .......... .......... .......... 18% 734K 2m33s 2020-11-20T12:16:22.126 INFO:tasks.workunit.client.0.smithi093.stderr: 32000K .......... .......... .......... .......... .......... 19% 1.22M 2m33s 2020-11-20T12:16:22.192 INFO:tasks.workunit.client.0.smithi093.stderr: 32050K .......... .......... .......... .......... .......... 19% 767K 2m33s 2020-11-20T12:16:22.230 INFO:tasks.workunit.client.0.smithi093.stderr: 32100K .......... .......... .......... .......... .......... 19% 1.28M 2m33s 2020-11-20T12:16:22.274 INFO:tasks.workunit.client.0.smithi093.stderr: 32150K .......... .......... .......... .......... .......... 19% 1.12M 2m33s 2020-11-20T12:16:22.318 INFO:tasks.workunit.client.0.smithi093.stderr: 32200K .......... .......... .......... .......... .......... 19% 1.09M 2m32s 2020-11-20T12:16:22.358 INFO:tasks.workunit.client.0.smithi093.stderr: 32250K .......... .......... .......... .......... .......... 19% 1.24M 2m32s 2020-11-20T12:16:22.410 INFO:tasks.workunit.client.0.smithi093.stderr: 32300K .......... .......... .......... .......... .......... 19% 955K 2m32s 2020-11-20T12:16:22.450 INFO:tasks.workunit.client.0.smithi093.stderr: 32350K .......... .......... .......... .......... .......... 19% 1.23M 2m32s 2020-11-20T12:16:22.496 INFO:tasks.workunit.client.0.smithi093.stderr: 32400K .......... .......... .......... .......... .......... 19% 1.04M 2m32s 2020-11-20T12:16:22.549 INFO:tasks.workunit.client.0.smithi093.stderr: 32450K .......... .......... .......... .......... .......... 19% 958K 2m32s 2020-11-20T12:16:22.598 INFO:tasks.workunit.client.0.smithi093.stderr: 32500K .......... .......... .......... .......... .......... 19% 1012K 2m32s 2020-11-20T12:16:22.653 INFO:tasks.workunit.client.0.smithi093.stderr: 32550K .......... .......... .......... .......... .......... 19% 920K 2m32s 2020-11-20T12:16:22.695 INFO:tasks.workunit.client.0.smithi093.stderr: 32600K .......... .......... .......... .......... .......... 19% 1.35M 2m32s 2020-11-20T12:16:22.740 INFO:tasks.workunit.client.0.smithi093.stderr: 32650K .......... .......... .......... .......... .......... 19% 972K 2m32s 2020-11-20T12:16:22.795 INFO:tasks.workunit.client.0.smithi093.stderr: 32700K .......... .......... .......... .......... .......... 19% 925K 2m32s 2020-11-20T12:16:22.838 INFO:tasks.workunit.client.0.smithi093.stderr: 32750K .......... .......... .......... .......... .......... 19% 1.11M 2m31s 2020-11-20T12:16:22.885 INFO:tasks.workunit.client.0.smithi093.stderr: 32800K .......... .......... .......... .......... .......... 19% 1.13M 2m31s 2020-11-20T12:16:22.939 INFO:tasks.workunit.client.0.smithi093.stderr: 32850K .......... .......... .......... .......... .......... 19% 878K 2m31s 2020-11-20T12:16:22.982 INFO:tasks.workunit.client.0.smithi093.stderr: 32900K .......... .......... .......... .......... .......... 19% 1.12M 2m31s 2020-11-20T12:16:23.029 INFO:tasks.workunit.client.0.smithi093.stderr: 32950K .......... .......... .......... .......... .......... 19% 1.03M 2m31s 2020-11-20T12:16:23.068 INFO:tasks.workunit.client.0.smithi093.stderr: 33000K .......... .......... .......... .......... .......... 19% 1.25M 2m31s 2020-11-20T12:16:23.128 INFO:tasks.workunit.client.0.smithi093.stderr: 33050K .......... .......... .......... .......... .......... 19% 829K 2m31s 2020-11-20T12:16:23.172 INFO:tasks.workunit.client.0.smithi093.stderr: 33100K .......... .......... .......... .......... .......... 19% 1.17M 2m31s 2020-11-20T12:16:23.220 INFO:tasks.workunit.client.0.smithi093.stderr: 33150K .......... .......... .......... .......... .......... 19% 1005K 2m31s 2020-11-20T12:16:23.286 INFO:tasks.workunit.client.0.smithi093.stderr: 33200K .......... .......... .......... .......... .......... 19% 762K 2m31s 2020-11-20T12:16:23.328 INFO:tasks.workunit.client.0.smithi093.stderr: 33250K .......... .......... .......... .......... .......... 19% 1.23M 2m31s 2020-11-20T12:16:23.377 INFO:tasks.workunit.client.0.smithi093.stderr: 33300K .......... .......... .......... .......... .......... 19% 1023K 2m30s 2020-11-20T12:16:23.421 INFO:tasks.workunit.client.0.smithi093.stderr: 33350K .......... .......... .......... .......... .......... 19% 1.04M 2m30s 2020-11-20T12:16:23.466 INFO:tasks.workunit.client.0.smithi093.stderr: 33400K .......... .......... .......... .......... .......... 19% 1.11M 2m30s 2020-11-20T12:16:23.529 INFO:tasks.workunit.client.0.smithi093.stderr: 33450K .......... .......... .......... .......... .......... 19% 785K 2m30s 2020-11-20T12:16:23.564 INFO:tasks.workunit.client.0.smithi093.stderr: 33500K .......... .......... .......... .......... .......... 19% 1.43M 2m30s 2020-11-20T12:16:23.612 INFO:tasks.workunit.client.0.smithi093.stderr: 33550K .......... .......... .......... .......... .......... 19% 1020K 2m30s 2020-11-20T12:16:23.655 INFO:tasks.workunit.client.0.smithi093.stderr: 33600K .......... .......... .......... .......... .......... 19% 1.15M 2m30s 2020-11-20T12:16:23.709 INFO:tasks.workunit.client.0.smithi093.stderr: 33650K .......... .......... .......... .......... .......... 19% 924K 2m30s 2020-11-20T12:16:23.755 INFO:tasks.workunit.client.0.smithi093.stderr: 33700K .......... .......... .......... .......... .......... 20% 1.07M 2m30s 2020-11-20T12:16:23.786 INFO:tasks.workunit.client.0.smithi093.stderr: 33750K .......... .......... .......... .......... .......... 20% 1.55M 2m30s 2020-11-20T12:16:23.833 INFO:tasks.workunit.client.0.smithi093.stderr: 33800K .......... .......... .......... .......... .......... 20% 1.02M 2m30s 2020-11-20T12:16:23.877 INFO:tasks.workunit.client.0.smithi093.stderr: 33850K .......... .......... .......... .......... .......... 20% 1.21M 2m29s 2020-11-20T12:16:23.914 INFO:tasks.workunit.client.0.smithi093.stderr: 33900K .......... .......... .......... .......... .......... 20% 1.23M 2m29s 2020-11-20T12:16:23.976 INFO:tasks.workunit.client.0.smithi093.stderr: 33950K .......... .......... .......... .......... .......... 20% 834K 2m29s 2020-11-20T12:16:24.012 INFO:tasks.workunit.client.0.smithi093.stderr: 34000K .......... .......... .......... .......... .......... 20% 1.26M 2m29s 2020-11-20T12:16:24.062 INFO:tasks.workunit.client.0.smithi093.stderr: 34050K .......... .......... .......... .......... .......... 20% 1000K 2m29s 2020-11-20T12:16:24.109 INFO:tasks.workunit.client.0.smithi093.stderr: 34100K .......... .......... .......... .......... .......... 20% 1.03M 2m29s 2020-11-20T12:16:24.146 INFO:tasks.workunit.client.0.smithi093.stderr: 34150K .......... .......... .......... .......... .......... 20% 1.34M 2m29s 2020-11-20T12:16:24.194 INFO:tasks.workunit.client.0.smithi093.stderr: 34200K .......... .......... .......... .......... .......... 20% 1.01M 2m29s 2020-11-20T12:16:24.231 INFO:tasks.workunit.client.0.smithi093.stderr: 34250K .......... .......... .......... .......... .......... 20% 1.31M 2m29s 2020-11-20T12:16:24.344 INFO:tasks.workunit.client.0.smithi093.stderr: 34300K .......... .......... .......... .......... .......... 20% 453K 2m29s 2020-11-20T12:16:24.345 INFO:tasks.workunit.client.0.smithi093.stderr: 34350K .......... .......... .......... .......... .......... 20% 247M 2m29s 2020-11-20T12:16:24.394 INFO:tasks.workunit.client.0.smithi093.stderr: 34400K .......... .......... .......... .......... .......... 20% 1.29M 2m28s 2020-11-20T12:16:24.439 INFO:tasks.workunit.client.0.smithi093.stderr: 34450K .......... .......... .......... .......... .......... 20% 841K 2m28s 2020-11-20T12:16:24.503 INFO:tasks.workunit.client.0.smithi093.stderr: 34500K .......... .......... .......... .......... .......... 20% 945K 2m28s 2020-11-20T12:16:24.538 INFO:tasks.workunit.client.0.smithi093.stderr: 34550K .......... .......... .......... .......... .......... 20% 1.07M 2m28s 2020-11-20T12:16:24.594 INFO:tasks.workunit.client.0.smithi093.stderr: 34600K .......... .......... .......... .......... .......... 20% 894K 2m28s 2020-11-20T12:16:24.634 INFO:tasks.workunit.client.0.smithi093.stderr: 34650K .......... .......... .......... .......... .......... 20% 1.22M 2m28s 2020-11-20T12:16:24.684 INFO:tasks.workunit.client.0.smithi093.stderr: 34700K .......... .......... .......... .......... .......... 20% 998K 2m28s 2020-11-20T12:16:24.726 INFO:tasks.workunit.client.0.smithi093.stderr: 34750K .......... .......... .......... .......... .......... 20% 1.16M 2m28s 2020-11-20T12:16:24.782 INFO:tasks.workunit.client.0.smithi093.stderr: 34800K .......... .......... .......... .......... .......... 20% 936K 2m28s 2020-11-20T12:16:24.834 INFO:tasks.workunit.client.0.smithi093.stderr: 34850K .......... .......... .......... .......... .......... 20% 959K 2m28s 2020-11-20T12:16:24.870 INFO:tasks.workunit.client.0.smithi093.stderr: 34900K .......... .......... .......... .......... .......... 20% 1.24M 2m28s 2020-11-20T12:16:24.933 INFO:tasks.workunit.client.0.smithi093.stderr: 34950K .......... .......... .......... .......... .......... 20% 852K 2m28s 2020-11-20T12:16:24.972 INFO:tasks.workunit.client.0.smithi093.stderr: 35000K .......... .......... .......... .......... .......... 20% 1.17M 2m27s 2020-11-20T12:16:25.018 INFO:tasks.workunit.client.0.smithi093.stderr: 35050K .......... .......... .......... .......... .......... 20% 1.05M 2m27s 2020-11-20T12:16:25.074 INFO:tasks.workunit.client.0.smithi093.stderr: 35100K .......... .......... .......... .......... .......... 20% 891K 2m27s 2020-11-20T12:16:25.113 INFO:tasks.workunit.client.0.smithi093.stderr: 35150K .......... .......... .......... .......... .......... 20% 1.23M 2m27s 2020-11-20T12:16:25.164 INFO:tasks.workunit.client.0.smithi093.stderr: 35200K .......... .......... .......... .......... .......... 20% 1.06M 2m27s 2020-11-20T12:16:25.221 INFO:tasks.workunit.client.0.smithi093.stderr: 35250K .......... .......... .......... .......... .......... 20% 812K 2m27s 2020-11-20T12:16:25.263 INFO:tasks.workunit.client.0.smithi093.stderr: 35300K .......... .......... .......... .......... .......... 20% 1.33M 2m27s 2020-11-20T12:16:25.300 INFO:tasks.workunit.client.0.smithi093.stderr: 35350K .......... .......... .......... .......... .......... 21% 1.16M 2m27s 2020-11-20T12:16:25.350 INFO:tasks.workunit.client.0.smithi093.stderr: 35400K .......... .......... .......... .......... .......... 21% 992K 2m27s 2020-11-20T12:16:25.411 INFO:tasks.workunit.client.0.smithi093.stderr: 35450K .......... .......... .......... .......... .......... 21% 819K 2m27s 2020-11-20T12:16:25.450 INFO:tasks.workunit.client.0.smithi093.stderr: 35500K .......... .......... .......... .......... .......... 21% 1.28M 2m27s 2020-11-20T12:16:25.500 INFO:tasks.workunit.client.0.smithi093.stderr: 35550K .......... .......... .......... .......... .......... 21% 988K 2m27s 2020-11-20T12:16:25.545 INFO:tasks.workunit.client.0.smithi093.stderr: 35600K .......... .......... .......... .......... .......... 21% 1.08M 2m26s 2020-11-20T12:16:25.598 INFO:tasks.workunit.client.0.smithi093.stderr: 35650K .......... .......... .......... .......... .......... 21% 948K 2m26s 2020-11-20T12:16:25.648 INFO:tasks.workunit.client.0.smithi093.stderr: 35700K .......... .......... .......... .......... .......... 21% 993K 2m26s 2020-11-20T12:16:25.683 INFO:tasks.workunit.client.0.smithi093.stderr: 35750K .......... .......... .......... .......... .......... 21% 1.42M 2m26s 2020-11-20T12:16:25.739 INFO:tasks.workunit.client.0.smithi093.stderr: 35800K .......... .......... .......... .......... .......... 21% 892K 2m26s 2020-11-20T12:16:25.797 INFO:tasks.workunit.client.0.smithi093.stderr: 35850K .......... .......... .......... .......... .......... 21% 1.27M 2m26s 2020-11-20T12:16:25.825 INFO:tasks.workunit.client.0.smithi093.stderr: 35900K .......... .......... .......... .......... .......... 21% 1.04M 2m26s 2020-11-20T12:16:25.876 INFO:tasks.workunit.client.0.smithi093.stderr: 35950K .......... .......... .......... .......... .......... 21% 969K 2m26s 2020-11-20T12:16:25.903 INFO:tasks.workunit.client.0.smithi093.stderr: 36000K .......... .......... .......... .......... .......... 21% 1.74M 2m26s 2020-11-20T12:16:25.955 INFO:tasks.workunit.client.0.smithi093.stderr: 36050K .......... .......... .......... .......... .......... 21% 964K 2m26s 2020-11-20T12:16:26.004 INFO:tasks.workunit.client.0.smithi093.stderr: 36100K .......... .......... .......... .......... .......... 21% 1.05M 2m26s 2020-11-20T12:16:26.047 INFO:tasks.workunit.client.0.smithi093.stderr: 36150K .......... .......... .......... .......... .......... 21% 1.08M 2m25s 2020-11-20T12:16:26.097 INFO:tasks.workunit.client.0.smithi093.stderr: 36200K .......... .......... .......... .......... .......... 21% 1015K 2m25s 2020-11-20T12:16:26.126 INFO:tasks.workunit.client.0.smithi093.stderr: 36250K .......... .......... .......... .......... .......... 21% 1.65M 2m25s 2020-11-20T12:16:26.177 INFO:tasks.workunit.client.0.smithi093.stderr: 36300K .......... .......... .......... .......... .......... 21% 1002K 2m25s 2020-11-20T12:16:26.220 INFO:tasks.workunit.client.0.smithi093.stderr: 36350K .......... .......... .......... .......... .......... 21% 1.11M 2m25s 2020-11-20T12:16:26.263 INFO:tasks.workunit.client.0.smithi093.stderr: 36400K .......... .......... .......... .......... .......... 21% 1.13M 2m25s 2020-11-20T12:16:26.327 INFO:tasks.workunit.client.0.smithi093.stderr: 36450K .......... .......... .......... .......... .......... 21% 786K 2m25s 2020-11-20T12:16:26.354 INFO:tasks.workunit.client.0.smithi093.stderr: 36500K .......... .......... .......... .......... .......... 21% 1.79M 2m25s 2020-11-20T12:16:26.409 INFO:tasks.workunit.client.0.smithi093.stderr: 36550K .......... .......... .......... .......... .......... 21% 908K 2m25s 2020-11-20T12:16:26.438 INFO:tasks.workunit.client.0.smithi093.stderr: 36600K .......... .......... .......... .......... .......... 21% 1.69M 2m25s 2020-11-20T12:16:26.492 INFO:tasks.workunit.client.0.smithi093.stderr: 36650K .......... .......... .......... .......... .......... 21% 920K 2m25s 2020-11-20T12:16:26.537 INFO:tasks.workunit.client.0.smithi093.stderr: 36700K .......... .......... .......... .......... .......... 21% 1.09M 2m24s 2020-11-20T12:16:26.591 INFO:tasks.workunit.client.0.smithi093.stderr: 36750K .......... .......... .......... .......... .......... 21% 1.15M 2m24s 2020-11-20T12:16:26.649 INFO:tasks.workunit.client.0.smithi093.stderr: 36800K .......... .......... .......... .......... .......... 21% 762K 2m24s 2020-11-20T12:16:26.675 INFO:tasks.workunit.client.0.smithi093.stderr: 36850K .......... .......... .......... .......... .......... 21% 1.62M 2m24s 2020-11-20T12:16:26.731 INFO:tasks.workunit.client.0.smithi093.stderr: 36900K .......... .......... .......... .......... .......... 21% 914K 2m24s 2020-11-20T12:16:26.761 INFO:tasks.workunit.client.0.smithi093.stderr: 36950K .......... .......... .......... .......... .......... 21% 1.57M 2m24s 2020-11-20T12:16:26.855 INFO:tasks.workunit.client.0.smithi093.stderr: 37000K .......... .......... .......... .......... .......... 21% 536K 2m24s 2020-11-20T12:16:26.879 INFO:tasks.workunit.client.0.smithi093.stderr: 37050K .......... .......... .......... .......... .......... 22% 1.93M 2m24s 2020-11-20T12:16:26.923 INFO:tasks.workunit.client.0.smithi093.stderr: 37100K .......... .......... .......... .......... .......... 22% 1.28M 2m24s 2020-11-20T12:16:26.975 INFO:tasks.workunit.client.0.smithi093.stderr: 37150K .......... .......... .......... .......... .......... 22% 866K 2m24s 2020-11-20T12:16:27.036 INFO:tasks.workunit.client.0.smithi093.stderr: 37200K .......... .......... .......... .......... .......... 22% 941K 2m24s 2020-11-20T12:16:27.085 INFO:tasks.workunit.client.0.smithi093.stderr: 37250K .......... .......... .......... .......... .......... 22% 889K 2m24s 2020-11-20T12:16:27.115 INFO:tasks.workunit.client.0.smithi093.stderr: 37300K .......... .......... .......... .......... .......... 22% 1.61M 2m24s 2020-11-20T12:16:27.161 INFO:tasks.workunit.client.0.smithi093.stderr: 37350K .......... .......... .......... .......... .......... 22% 1.05M 2m23s 2020-11-20T12:16:27.213 INFO:tasks.workunit.client.0.smithi093.stderr: 37400K .......... .......... .......... .......... .......... 22% 960K 2m23s 2020-11-20T12:16:27.262 INFO:tasks.workunit.client.0.smithi093.stderr: 37450K .......... .......... .......... .......... .......... 22% 1016K 2m23s 2020-11-20T12:16:27.291 INFO:tasks.workunit.client.0.smithi093.stderr: 37500K .......... .......... .......... .......... .......... 22% 1.69M 2m23s 2020-11-20T12:16:27.349 INFO:tasks.workunit.client.0.smithi093.stderr: 37550K .......... .......... .......... .......... .......... 22% 874K 2m23s 2020-11-20T12:16:27.406 INFO:tasks.workunit.client.0.smithi093.stderr: 37600K .......... .......... .......... .......... .......... 22% 866K 2m23s 2020-11-20T12:16:27.433 INFO:tasks.workunit.client.0.smithi093.stderr: 37650K .......... .......... .......... .......... .......... 22% 1.81M 2m23s 2020-11-20T12:16:27.485 INFO:tasks.workunit.client.0.smithi093.stderr: 37700K .......... .......... .......... .......... .......... 22% 973K 2m23s 2020-11-20T12:16:27.543 INFO:tasks.workunit.client.0.smithi093.stderr: 37750K .......... .......... .......... .......... .......... 22% 858K 2m23s 2020-11-20T12:16:27.568 INFO:tasks.workunit.client.0.smithi093.stderr: 37800K .......... .......... .......... .......... .......... 22% 1.91M 2m23s 2020-11-20T12:16:27.621 INFO:tasks.workunit.client.0.smithi093.stderr: 37850K .......... .......... .......... .......... .......... 22% 955K 2m23s 2020-11-20T12:16:27.681 INFO:tasks.workunit.client.0.smithi093.stderr: 37900K .......... .......... .......... .......... .......... 22% 846K 2m23s 2020-11-20T12:16:27.706 INFO:tasks.workunit.client.0.smithi093.stderr: 37950K .......... .......... .......... .......... .......... 22% 1.90M 2m22s 2020-11-20T12:16:27.767 INFO:tasks.workunit.client.0.smithi093.stderr: 38000K .......... .......... .......... .......... .......... 22% 835K 2m22s 2020-11-20T12:16:27.830 INFO:tasks.workunit.client.0.smithi093.stderr: 38050K .......... .......... .......... .......... .......... 22% 781K 2m22s 2020-11-20T12:16:27.852 INFO:tasks.workunit.client.0.smithi093.stderr: 38100K .......... .......... .......... .......... .......... 22% 2.56M 2m22s 2020-11-20T12:16:27.916 INFO:tasks.workunit.client.0.smithi093.stderr: 38150K .......... .......... .......... .......... .......... 22% 746K 2m22s 2020-11-20T12:16:27.962 INFO:tasks.workunit.client.0.smithi093.stderr: 38200K .......... .......... .......... .......... .......... 22% 1.06M 2m22s 2020-11-20T12:16:27.991 INFO:tasks.workunit.client.0.smithi093.stderr: 38250K .......... .......... .......... .......... .......... 22% 1.67M 2m22s 2020-11-20T12:16:28.054 INFO:tasks.workunit.client.0.smithi093.stderr: 38300K .......... .......... .......... .......... .......... 22% 788K 2m22s 2020-11-20T12:16:28.080 INFO:tasks.workunit.client.0.smithi093.stderr: 38350K .......... .......... .......... .......... .......... 22% 1.93M 2m22s 2020-11-20T12:16:28.143 INFO:tasks.workunit.client.0.smithi093.stderr: 38400K .......... .......... .......... .......... .......... 22% 788K 2m22s 2020-11-20T12:16:28.206 INFO:tasks.workunit.client.0.smithi093.stderr: 38450K .......... .......... .......... .......... .......... 22% 950K 2m22s 2020-11-20T12:16:28.229 INFO:tasks.workunit.client.0.smithi093.stderr: 38500K .......... .......... .......... .......... .......... 22% 1.52M 2m22s 2020-11-20T12:16:28.293 INFO:tasks.workunit.client.0.smithi093.stderr: 38550K .......... .......... .......... .......... .......... 22% 801K 2m22s 2020-11-20T12:16:28.333 INFO:tasks.workunit.client.0.smithi093.stderr: 38600K .......... .......... .......... .......... .......... 22% 1.15M 2m21s 2020-11-20T12:16:28.374 INFO:tasks.workunit.client.0.smithi093.stderr: 38650K .......... .......... .......... .......... .......... 22% 1.19M 2m21s 2020-11-20T12:16:28.428 INFO:tasks.workunit.client.0.smithi093.stderr: 38700K .......... .......... .......... .......... .......... 22% 924K 2m21s 2020-11-20T12:16:28.457 INFO:tasks.workunit.client.0.smithi093.stderr: 38750K .......... .......... .......... .......... .......... 23% 1.65M 2m21s 2020-11-20T12:16:28.524 INFO:tasks.workunit.client.0.smithi093.stderr: 38800K .......... .......... .......... .......... .......... 23% 751K 2m21s 2020-11-20T12:16:28.545 INFO:tasks.workunit.client.0.smithi093.stderr: 38850K .......... .......... .......... .......... .......... 23% 2.30M 2m21s 2020-11-20T12:16:28.609 INFO:tasks.workunit.client.0.smithi093.stderr: 38900K .......... .......... .......... .......... .......... 23% 782K 2m21s 2020-11-20T12:16:28.668 INFO:tasks.workunit.client.0.smithi093.stderr: 38950K .......... .......... .......... .......... .......... 23% 848K 2m21s 2020-11-20T12:16:28.699 INFO:tasks.workunit.client.0.smithi093.stderr: 39000K .......... .......... .......... .......... .......... 23% 1.58M 2m21s 2020-11-20T12:16:28.754 INFO:tasks.workunit.client.0.smithi093.stderr: 39050K .......... .......... .......... .......... .......... 23% 907K 2m21s 2020-11-20T12:16:28.780 INFO:tasks.workunit.client.0.smithi093.stderr: 39100K .......... .......... .......... .......... .......... 23% 1.87M 2m21s 2020-11-20T12:16:28.840 INFO:tasks.workunit.client.0.smithi093.stderr: 39150K .......... .......... .......... .......... .......... 23% 840K 2m21s 2020-11-20T12:16:28.874 INFO:tasks.workunit.client.0.smithi093.stderr: 39200K .......... .......... .......... .......... .......... 23% 1.44M 2m20s 2020-11-20T12:16:28.921 INFO:tasks.workunit.client.0.smithi093.stderr: 39250K .......... .......... .......... .......... .......... 23% 1.05M 2m20s 2020-11-20T12:16:28.970 INFO:tasks.workunit.client.0.smithi093.stderr: 39300K .......... .......... .......... .......... .......... 23% 1.03M 2m20s 2020-11-20T12:16:29.000 INFO:tasks.workunit.client.0.smithi093.stderr: 39350K .......... .......... .......... .......... .......... 23% 1.54M 2m20s 2020-11-20T12:16:29.054 INFO:tasks.workunit.client.0.smithi093.stderr: 39400K .......... .......... .......... .......... .......... 23% 1000K 2m20s 2020-11-20T12:16:29.077 INFO:tasks.workunit.client.0.smithi093.stderr: 39450K .......... .......... .......... .......... .......... 23% 1.96M 2m20s 2020-11-20T12:16:29.134 INFO:tasks.workunit.client.0.smithi093.stderr: 39500K .......... .......... .......... .......... .......... 23% 840K 2m20s 2020-11-20T12:16:29.167 INFO:tasks.workunit.client.0.smithi093.stderr: 39550K .......... .......... .......... .......... .......... 23% 1.49M 2m20s 2020-11-20T12:16:29.210 INFO:tasks.workunit.client.0.smithi093.stderr: 39600K .......... .......... .......... .......... .......... 23% 1.12M 2m20s 2020-11-20T12:16:29.256 INFO:tasks.workunit.client.0.smithi093.stderr: 39650K .......... .......... .......... .......... .......... 23% 1.06M 2m20s 2020-11-20T12:16:29.292 INFO:tasks.workunit.client.0.smithi093.stderr: 39700K .......... .......... .......... .......... .......... 23% 1.47M 2m19s 2020-11-20T12:16:29.346 INFO:tasks.workunit.client.0.smithi093.stderr: 39750K .......... .......... .......... .......... .......... 23% 916K 2m19s 2020-11-20T12:16:29.373 INFO:tasks.workunit.client.0.smithi093.stderr: 39800K .......... .......... .......... .......... .......... 23% 1.78M 2m19s 2020-11-20T12:16:29.427 INFO:tasks.workunit.client.0.smithi093.stderr: 39850K .......... .......... .......... .......... .......... 23% 898K 2m19s 2020-11-20T12:16:29.476 INFO:tasks.workunit.client.0.smithi093.stderr: 39900K .......... .......... .......... .......... .......... 23% 1.96M 2m19s 2020-11-20T12:16:29.513 INFO:tasks.workunit.client.0.smithi093.stderr: 39950K .......... .......... .......... .......... .......... 23% 817K 2m19s 2020-11-20T12:16:29.553 INFO:tasks.workunit.client.0.smithi093.stderr: 40000K .......... .......... .......... .......... .......... 23% 1.24M 2m19s 2020-11-20T12:16:29.599 INFO:tasks.workunit.client.0.smithi093.stderr: 40050K .......... .......... .......... .......... .......... 23% 1.05M 2m19s 2020-11-20T12:16:29.652 INFO:tasks.workunit.client.0.smithi093.stderr: 40100K .......... .......... .......... .......... .......... 23% 949K 2m19s 2020-11-20T12:16:29.762 INFO:tasks.workunit.client.0.smithi093.stderr: 40150K .......... .......... .......... .......... .......... 23% 456K 2m19s 2020-11-20T12:16:29.762 INFO:tasks.workunit.client.0.smithi093.stderr: 40200K .......... .......... .......... .......... .......... 23% 219M 2m19s 2020-11-20T12:16:29.810 INFO:tasks.workunit.client.0.smithi093.stderr: 40250K .......... .......... .......... .......... .......... 23% 1.09M 2m19s 2020-11-20T12:16:29.857 INFO:tasks.workunit.client.0.smithi093.stderr: 40300K .......... .......... .......... .......... .......... 23% 993K 2m19s 2020-11-20T12:16:29.894 INFO:tasks.workunit.client.0.smithi093.stderr: 40350K .......... .......... .......... .......... .......... 23% 1.32M 2m18s 2020-11-20T12:16:29.947 INFO:tasks.workunit.client.0.smithi093.stderr: 40400K .......... .......... .......... .......... .......... 23% 940K 2m18s 2020-11-20T12:16:30.003 INFO:tasks.workunit.client.0.smithi093.stderr: 40450K .......... .......... .......... .......... .......... 24% 884K 2m18s 2020-11-20T12:16:30.042 INFO:tasks.workunit.client.0.smithi093.stderr: 40500K .......... .......... .......... .......... .......... 24% 1.26M 2m18s 2020-11-20T12:16:30.081 INFO:tasks.workunit.client.0.smithi093.stderr: 40550K .......... .......... .......... .......... .......... 24% 1.24M 2m18s 2020-11-20T12:16:30.142 INFO:tasks.workunit.client.0.smithi093.stderr: 40600K .......... .......... .......... .......... .......... 24% 865K 2m18s 2020-11-20T12:16:30.189 INFO:tasks.workunit.client.0.smithi093.stderr: 40650K .......... .......... .......... .......... .......... 24% 1011K 2m18s 2020-11-20T12:16:30.213 INFO:tasks.workunit.client.0.smithi093.stderr: 40700K .......... .......... .......... .......... .......... 24% 2.05M 2m18s 2020-11-20T12:16:30.271 INFO:tasks.workunit.client.0.smithi093.stderr: 40750K .......... .......... .......... .......... .......... 24% 861K 2m18s 2020-11-20T12:16:30.324 INFO:tasks.workunit.client.0.smithi093.stderr: 40800K .......... .......... .......... .......... .......... 24% 981K 2m18s 2020-11-20T12:16:30.363 INFO:tasks.workunit.client.0.smithi093.stderr: 40850K .......... .......... .......... .......... .......... 24% 1.18M 2m18s 2020-11-20T12:16:30.416 INFO:tasks.workunit.client.0.smithi093.stderr: 40900K .......... .......... .......... .......... .......... 24% 953K 2m18s 2020-11-20T12:16:30.470 INFO:tasks.workunit.client.0.smithi093.stderr: 40950K .......... .......... .......... .......... .......... 24% 923K 2m18s 2020-11-20T12:16:30.508 INFO:tasks.workunit.client.0.smithi093.stderr: 41000K .......... .......... .......... .......... .......... 24% 1.31M 2m17s 2020-11-20T12:16:30.560 INFO:tasks.workunit.client.0.smithi093.stderr: 41050K .......... .......... .......... .......... .......... 24% 941K 2m17s 2020-11-20T12:16:30.616 INFO:tasks.workunit.client.0.smithi093.stderr: 41100K .......... .......... .......... .......... .......... 24% 930K 2m17s 2020-11-20T12:16:30.662 INFO:tasks.workunit.client.0.smithi093.stderr: 41150K .......... .......... .......... .......... .......... 24% 1.02M 2m17s 2020-11-20T12:16:30.719 INFO:tasks.workunit.client.0.smithi093.stderr: 41200K .......... .......... .......... .......... .......... 24% 875K 2m17s 2020-11-20T12:16:30.830 INFO:tasks.workunit.client.0.smithi093.stderr: 41250K .......... .......... .......... .......... .......... 24% 459K 2m17s 2020-11-20T12:16:30.928 INFO:tasks.workunit.client.0.smithi093.stderr: 41300K .......... .......... .......... .......... .......... 24% 503K 2m17s 2020-11-20T12:16:30.929 INFO:tasks.workunit.client.0.smithi093.stderr: 41350K .......... .......... .......... .......... .......... 24% 245M 2m17s 2020-11-20T12:16:30.994 INFO:tasks.workunit.client.0.smithi093.stderr: 41400K .......... .......... .......... .......... .......... 24% 747K 2m17s 2020-11-20T12:16:31.071 INFO:tasks.workunit.client.0.smithi093.stderr: 41450K .......... .......... .......... .......... .......... 24% 651K 2m17s 2020-11-20T12:16:31.146 INFO:tasks.workunit.client.0.smithi093.stderr: 41500K .......... .......... .......... .......... .......... 24% 663K 2m17s 2020-11-20T12:16:31.207 INFO:tasks.workunit.client.0.smithi093.stderr: 41550K .......... .......... .......... .......... .......... 24% 832K 2m17s 2020-11-20T12:16:31.260 INFO:tasks.workunit.client.0.smithi093.stderr: 41600K .......... .......... .......... .......... .......... 24% 996K 2m17s 2020-11-20T12:16:31.311 INFO:tasks.workunit.client.0.smithi093.stderr: 41650K .......... .......... .......... .......... .......... 24% 916K 2m17s 2020-11-20T12:16:31.374 INFO:tasks.workunit.client.0.smithi093.stderr: 41700K .......... .......... .......... .......... .......... 24% 813K 2m17s 2020-11-20T12:16:31.428 INFO:tasks.workunit.client.0.smithi093.stderr: 41750K .......... .......... .......... .......... .......... 24% 905K 2m17s 2020-11-20T12:16:31.482 INFO:tasks.workunit.client.0.smithi093.stderr: 41800K .......... .......... .......... .......... .......... 24% 925K 2m17s 2020-11-20T12:16:31.553 INFO:tasks.workunit.client.0.smithi093.stderr: 41850K .......... .......... .......... .......... .......... 24% 706K 2m17s 2020-11-20T12:16:31.608 INFO:tasks.workunit.client.0.smithi093.stderr: 41900K .......... .......... .......... .......... .......... 24% 926K 2m17s 2020-11-20T12:16:31.664 INFO:tasks.workunit.client.0.smithi093.stderr: 41950K .......... .......... .......... .......... .......... 24% 952K 2m17s 2020-11-20T12:16:31.723 INFO:tasks.workunit.client.0.smithi093.stderr: 42000K .......... .......... .......... .......... .......... 24% 789K 2m17s 2020-11-20T12:16:31.784 INFO:tasks.workunit.client.0.smithi093.stderr: 42050K .......... .......... .......... .......... .......... 24% 820K 2m17s 2020-11-20T12:16:31.842 INFO:tasks.workunit.client.0.smithi093.stderr: 42100K .......... .......... .......... .......... .......... 25% 851K 2m17s 2020-11-20T12:16:31.901 INFO:tasks.workunit.client.0.smithi093.stderr: 42150K .......... .......... .......... .......... .......... 25% 853K 2m17s 2020-11-20T12:16:31.962 INFO:tasks.workunit.client.0.smithi093.stderr: 42200K .......... .......... .......... .......... .......... 25% 816K 2m17s 2020-11-20T12:16:32.016 INFO:tasks.workunit.client.0.smithi093.stderr: 42250K .......... .......... .......... .......... .......... 25% 926K 2m17s 2020-11-20T12:16:32.079 INFO:tasks.workunit.client.0.smithi093.stderr: 42300K .......... .......... .......... .......... .......... 25% 802K 2m17s 2020-11-20T12:16:32.137 INFO:tasks.workunit.client.0.smithi093.stderr: 42350K .......... .......... .......... .......... .......... 25% 860K 2m17s 2020-11-20T12:16:32.202 INFO:tasks.workunit.client.0.smithi093.stderr: 42400K .......... .......... .......... .......... .......... 25% 769K 2m16s 2020-11-20T12:16:32.245 INFO:tasks.workunit.client.0.smithi093.stderr: 42450K .......... .......... .......... .......... .......... 25% 1.14M 2m16s 2020-11-20T12:16:32.309 INFO:tasks.workunit.client.0.smithi093.stderr: 42500K .......... .......... .......... .......... .......... 25% 838K 2m16s 2020-11-20T12:16:32.366 INFO:tasks.workunit.client.0.smithi093.stderr: 42550K .......... .......... .......... .......... .......... 25% 814K 2m16s 2020-11-20T12:16:32.427 INFO:tasks.workunit.client.0.smithi093.stderr: 42600K .......... .......... .......... .......... .......... 25% 869K 2m16s 2020-11-20T12:16:32.494 INFO:tasks.workunit.client.0.smithi093.stderr: 42650K .......... .......... .......... .......... .......... 25% 709K 2m16s 2020-11-20T12:16:32.555 INFO:tasks.workunit.client.0.smithi093.stderr: 42700K .......... .......... .......... .......... .......... 25% 822K 2m16s 2020-11-20T12:16:32.615 INFO:tasks.workunit.client.0.smithi093.stderr: 42750K .......... .......... .......... .......... .......... 25% 924K 2m16s 2020-11-20T12:16:32.670 INFO:tasks.workunit.client.0.smithi093.stderr: 42800K .......... .......... .......... .......... .......... 25% 816K 2m16s 2020-11-20T12:16:32.718 INFO:tasks.workunit.client.0.smithi093.stderr: 42850K .......... .......... .......... .......... .......... 25% 1.01M 2m16s 2020-11-20T12:16:32.775 INFO:tasks.workunit.client.0.smithi093.stderr: 42900K .......... .......... .......... .......... .......... 25% 880K 2m16s 2020-11-20T12:16:32.837 INFO:tasks.workunit.client.0.smithi093.stderr: 42950K .......... .......... .......... .......... .......... 25% 814K 2m16s 2020-11-20T12:16:32.903 INFO:tasks.workunit.client.0.smithi093.stderr: 43000K .......... .......... .......... .......... .......... 25% 751K 2m16s 2020-11-20T12:16:32.965 INFO:tasks.workunit.client.0.smithi093.stderr: 43050K .......... .......... .......... .......... .......... 25% 942K 2m16s 2020-11-20T12:16:33.021 INFO:tasks.workunit.client.0.smithi093.stderr: 43100K .......... .......... .......... .......... .......... 25% 772K 2m16s 2020-11-20T12:16:33.070 INFO:tasks.workunit.client.0.smithi093.stderr: 43150K .......... .......... .......... .......... .......... 25% 1008K 2m16s 2020-11-20T12:16:33.126 INFO:tasks.workunit.client.0.smithi093.stderr: 43200K .......... .......... .......... .......... .......... 25% 923K 2m16s 2020-11-20T12:16:33.179 INFO:tasks.workunit.client.0.smithi093.stderr: 43250K .......... .......... .......... .......... .......... 25% 915K 2m16s 2020-11-20T12:16:33.241 INFO:tasks.workunit.client.0.smithi093.stderr: 43300K .......... .......... .......... .......... .......... 25% 806K 2m16s 2020-11-20T12:16:33.297 INFO:tasks.workunit.client.0.smithi093.stderr: 43350K .......... .......... .......... .......... .......... 25% 895K 2m16s 2020-11-20T12:16:33.366 INFO:tasks.workunit.client.0.smithi093.stderr: 43400K .......... .......... .......... .......... .......... 25% 731K 2m16s 2020-11-20T12:16:33.421 INFO:tasks.workunit.client.0.smithi093.stderr: 43450K .......... .......... .......... .......... .......... 25% 903K 2m16s 2020-11-20T12:16:33.490 INFO:tasks.workunit.client.0.smithi093.stderr: 43500K .......... .......... .......... .......... .......... 25% 986K 2m16s 2020-11-20T12:16:33.529 INFO:tasks.workunit.client.0.smithi093.stderr: 43550K .......... .......... .......... .......... .......... 25% 877K 2m15s 2020-11-20T12:16:33.586 INFO:tasks.workunit.client.0.smithi093.stderr: 43600K .......... .......... .......... .......... .......... 25% 872K 2m15s 2020-11-20T12:16:33.651 INFO:tasks.workunit.client.0.smithi093.stderr: 43650K .......... .......... .......... .......... .......... 25% 771K 2m15s 2020-11-20T12:16:33.780 INFO:tasks.workunit.client.0.smithi093.stderr: 43700K .......... .......... .......... .......... .......... 25% 391K 2m16s 2020-11-20T12:16:33.781 INFO:tasks.workunit.client.0.smithi093.stderr: 43750K .......... .......... .......... .......... .......... 25% 233M 2m15s 2020-11-20T12:16:33.849 INFO:tasks.workunit.client.0.smithi093.stderr: 43800K .......... .......... .......... .......... .......... 26% 723K 2m15s 2020-11-20T12:16:33.925 INFO:tasks.workunit.client.0.smithi093.stderr: 43850K .......... .......... .......... .......... .......... 26% 671K 2m15s 2020-11-20T12:16:33.999 INFO:tasks.workunit.client.0.smithi093.stderr: 43900K .......... .......... .......... .......... .......... 26% 659K 2m15s 2020-11-20T12:16:34.067 INFO:tasks.workunit.client.0.smithi093.stderr: 43950K .......... .......... .......... .......... .......... 26% 860K 2m15s 2020-11-20T12:16:34.129 INFO:tasks.workunit.client.0.smithi093.stderr: 44000K .......... .......... .......... .......... .......... 26% 692K 2m15s 2020-11-20T12:16:34.203 INFO:tasks.workunit.client.0.smithi093.stderr: 44050K .......... .......... .......... .......... .......... 26% 674K 2m15s 2020-11-20T12:16:34.272 INFO:tasks.workunit.client.0.smithi093.stderr: 44100K .......... .......... .......... .......... .......... 26% 733K 2m15s 2020-11-20T12:16:34.337 INFO:tasks.workunit.client.0.smithi093.stderr: 44150K .......... .......... .......... .......... .......... 26% 770K 2m15s 2020-11-20T12:16:34.410 INFO:tasks.workunit.client.0.smithi093.stderr: 44200K .......... .......... .......... .......... .......... 26% 679K 2m15s 2020-11-20T12:16:34.464 INFO:tasks.workunit.client.0.smithi093.stderr: 44250K .......... .......... .......... .......... .......... 26% 922K 2m15s 2020-11-20T12:16:34.533 INFO:tasks.workunit.client.0.smithi093.stderr: 44300K .......... .......... .......... .......... .......... 26% 727K 2m15s 2020-11-20T12:16:34.592 INFO:tasks.workunit.client.0.smithi093.stderr: 44350K .......... .......... .......... .......... .......... 26% 844K 2m15s 2020-11-20T12:16:34.665 INFO:tasks.workunit.client.0.smithi093.stderr: 44400K .......... .......... .......... .......... .......... 26% 689K 2m15s 2020-11-20T12:16:34.725 INFO:tasks.workunit.client.0.smithi093.stderr: 44450K .......... .......... .......... .......... .......... 26% 821K 2m15s 2020-11-20T12:16:34.783 INFO:tasks.workunit.client.0.smithi093.stderr: 44500K .......... .......... .......... .......... .......... 26% 876K 2m15s 2020-11-20T12:16:34.857 INFO:tasks.workunit.client.0.smithi093.stderr: 44550K .......... .......... .......... .......... .......... 26% 703K 2m15s 2020-11-20T12:16:34.911 INFO:tasks.workunit.client.0.smithi093.stderr: 44600K .......... .......... .......... .......... .......... 26% 877K 2m15s 2020-11-20T12:16:34.981 INFO:tasks.workunit.client.0.smithi093.stderr: 44650K .......... .......... .......... .......... .......... 26% 717K 2m15s 2020-11-20T12:16:35.044 INFO:tasks.workunit.client.0.smithi093.stderr: 44700K .......... .......... .......... .......... .......... 26% 794K 2m15s 2020-11-20T12:16:35.100 INFO:tasks.workunit.client.0.smithi093.stderr: 44750K .......... .......... .......... .......... .......... 26% 901K 2m15s 2020-11-20T12:16:35.165 INFO:tasks.workunit.client.0.smithi093.stderr: 44800K .......... .......... .......... .......... .......... 26% 755K 2m15s 2020-11-20T12:16:35.219 INFO:tasks.workunit.client.0.smithi093.stderr: 44850K .......... .......... .......... .......... .......... 26% 967K 2m15s 2020-11-20T12:16:35.269 INFO:tasks.workunit.client.0.smithi093.stderr: 44900K .......... .......... .......... .......... .......... 26% 972K 2m15s 2020-11-20T12:16:35.322 INFO:tasks.workunit.client.0.smithi093.stderr: 44950K .......... .......... .......... .......... .......... 26% 959K 2m15s 2020-11-20T12:16:35.379 INFO:tasks.workunit.client.0.smithi093.stderr: 45000K .......... .......... .......... .......... .......... 26% 887K 2m15s 2020-11-20T12:16:35.425 INFO:tasks.workunit.client.0.smithi093.stderr: 45050K .......... .......... .......... .......... .......... 26% 1.00M 2m15s 2020-11-20T12:16:35.473 INFO:tasks.workunit.client.0.smithi093.stderr: 45100K .......... .......... .......... .......... .......... 26% 1.09M 2m15s 2020-11-20T12:16:35.525 INFO:tasks.workunit.client.0.smithi093.stderr: 45150K .......... .......... .......... .......... .......... 26% 932K 2m14s 2020-11-20T12:16:35.586 INFO:tasks.workunit.client.0.smithi093.stderr: 45200K .......... .......... .......... .......... .......... 26% 994K 2m14s 2020-11-20T12:16:35.635 INFO:tasks.workunit.client.0.smithi093.stderr: 45250K .......... .......... .......... .......... .......... 26% 828K 2m14s 2020-11-20T12:16:35.681 INFO:tasks.workunit.client.0.smithi093.stderr: 45300K .......... .......... .......... .......... .......... 26% 1.06M 2m14s 2020-11-20T12:16:35.738 INFO:tasks.workunit.client.0.smithi093.stderr: 45350K .......... .......... .......... .......... .......... 26% 884K 2m14s 2020-11-20T12:16:35.788 INFO:tasks.workunit.client.0.smithi093.stderr: 45400K .......... .......... .......... .......... .......... 26% 986K 2m14s 2020-11-20T12:16:35.856 INFO:tasks.workunit.client.0.smithi093.stderr: 45450K .......... .......... .......... .......... .......... 26% 987K 2m14s 2020-11-20T12:16:35.896 INFO:tasks.workunit.client.0.smithi093.stderr: 45500K .......... .......... .......... .......... .......... 27% 902K 2m14s 2020-11-20T12:16:35.966 INFO:tasks.workunit.client.0.smithi093.stderr: 45550K .......... .......... .......... .......... .......... 27% 701K 2m14s 2020-11-20T12:16:36.010 INFO:tasks.workunit.client.0.smithi093.stderr: 45600K .......... .......... .......... .......... .......... 27% 1.09M 2m14s 2020-11-20T12:16:36.072 INFO:tasks.workunit.client.0.smithi093.stderr: 45650K .......... .......... .......... .......... .......... 27% 923K 2m14s 2020-11-20T12:16:36.127 INFO:tasks.workunit.client.0.smithi093.stderr: 45700K .......... .......... .......... .......... .......... 27% 839K 2m14s 2020-11-20T12:16:36.179 INFO:tasks.workunit.client.0.smithi093.stderr: 45750K .......... .......... .......... .......... .......... 27% 921K 2m14s 2020-11-20T12:16:36.235 INFO:tasks.workunit.client.0.smithi093.stderr: 45800K .......... .......... .......... .......... .......... 27% 889K 2m14s 2020-11-20T12:16:36.287 INFO:tasks.workunit.client.0.smithi093.stderr: 45850K .......... .......... .......... .......... .......... 27% 982K 2m14s 2020-11-20T12:16:36.354 INFO:tasks.workunit.client.0.smithi093.stderr: 45900K .......... .......... .......... .......... .......... 27% 753K 2m14s 2020-11-20T12:16:36.405 INFO:tasks.workunit.client.0.smithi093.stderr: 45950K .......... .......... .......... .......... .......... 27% 956K 2m14s 2020-11-20T12:16:36.451 INFO:tasks.workunit.client.0.smithi093.stderr: 46000K .......... .......... .......... .......... .......... 27% 1.62M 2m13s 2020-11-20T12:16:36.504 INFO:tasks.workunit.client.0.smithi093.stderr: 46050K .......... .......... .......... .......... .......... 27% 725K 2m13s 2020-11-20T12:16:36.555 INFO:tasks.workunit.client.0.smithi093.stderr: 46100K .......... .......... .......... .......... .......... 27% 990K 2m13s 2020-11-20T12:16:36.599 INFO:tasks.workunit.client.0.smithi093.stderr: 46150K .......... .......... .......... .......... .......... 27% 1.09M 2m13s 2020-11-20T12:16:36.654 INFO:tasks.workunit.client.0.smithi093.stderr: 46200K .......... .......... .......... .......... .......... 27% 912K 2m13s 2020-11-20T12:16:36.709 INFO:tasks.workunit.client.0.smithi093.stderr: 46250K .......... .......... .......... .......... .......... 27% 927K 2m13s 2020-11-20T12:16:36.755 INFO:tasks.workunit.client.0.smithi093.stderr: 46300K .......... .......... .......... .......... .......... 27% 1.03M 2m13s 2020-11-20T12:16:36.811 INFO:tasks.workunit.client.0.smithi093.stderr: 46350K .......... .......... .......... .......... .......... 27% 904K 2m13s 2020-11-20T12:16:36.858 INFO:tasks.workunit.client.0.smithi093.stderr: 46400K .......... .......... .......... .......... .......... 27% 1.03M 2m13s 2020-11-20T12:16:36.979 INFO:tasks.workunit.client.0.smithi093.stderr: 46450K .......... .......... .......... .......... .......... 27% 414K 2m13s 2020-11-20T12:16:37.021 INFO:tasks.workunit.client.0.smithi093.stderr: 46500K .......... .......... .......... .......... .......... 27% 1.17M 2m13s 2020-11-20T12:16:37.065 INFO:tasks.workunit.client.0.smithi093.stderr: 46550K .......... .......... .......... .......... .......... 27% 1.11M 2m13s 2020-11-20T12:16:37.137 INFO:tasks.workunit.client.0.smithi093.stderr: 46600K .......... .......... .......... .......... .......... 27% 693K 2m13s 2020-11-20T12:16:37.200 INFO:tasks.workunit.client.0.smithi093.stderr: 46650K .......... .......... .......... .......... .......... 27% 788K 2m13s 2020-11-20T12:16:37.261 INFO:tasks.workunit.client.0.smithi093.stderr: 46700K .......... .......... .......... .......... .......... 27% 822K 2m13s 2020-11-20T12:16:37.308 INFO:tasks.workunit.client.0.smithi093.stderr: 46750K .......... .......... .......... .......... .......... 27% 1.04M 2m13s 2020-11-20T12:16:37.371 INFO:tasks.workunit.client.0.smithi093.stderr: 46800K .......... .......... .......... .......... .......... 27% 882K 2m13s 2020-11-20T12:16:37.436 INFO:tasks.workunit.client.0.smithi093.stderr: 46850K .......... .......... .......... .......... .......... 27% 766K 2m13s 2020-11-20T12:16:37.489 INFO:tasks.workunit.client.0.smithi093.stderr: 46900K .......... .......... .......... .......... .......... 27% 843K 2m13s 2020-11-20T12:16:37.547 INFO:tasks.workunit.client.0.smithi093.stderr: 46950K .......... .......... .......... .......... .......... 27% 861K 2m13s 2020-11-20T12:16:37.596 INFO:tasks.workunit.client.0.smithi093.stderr: 47000K .......... .......... .......... .......... .......... 27% 1.01M 2m13s 2020-11-20T12:16:37.663 INFO:tasks.workunit.client.0.smithi093.stderr: 47050K .......... .......... .......... .......... .......... 27% 738K 2m13s 2020-11-20T12:16:37.721 INFO:tasks.workunit.client.0.smithi093.stderr: 47100K .......... .......... .......... .......... .......... 27% 855K 2m13s 2020-11-20T12:16:37.785 INFO:tasks.workunit.client.0.smithi093.stderr: 47150K .......... .......... .......... .......... .......... 28% 787K 2m12s 2020-11-20T12:16:37.826 INFO:tasks.workunit.client.0.smithi093.stderr: 47200K .......... .......... .......... .......... .......... 28% 1.20M 2m12s 2020-11-20T12:16:37.895 INFO:tasks.workunit.client.0.smithi093.stderr: 47250K .......... .......... .......... .......... .......... 28% 788K 2m12s 2020-11-20T12:16:37.961 INFO:tasks.workunit.client.0.smithi093.stderr: 47300K .......... .......... .......... .......... .......... 28% 694K 2m12s 2020-11-20T12:16:38.017 INFO:tasks.workunit.client.0.smithi093.stderr: 47350K .......... .......... .......... .......... .......... 28% 908K 2m12s 2020-11-20T12:16:38.064 INFO:tasks.workunit.client.0.smithi093.stderr: 47400K .......... .......... .......... .......... .......... 28% 1.02M 2m12s 2020-11-20T12:16:38.129 INFO:tasks.workunit.client.0.smithi093.stderr: 47450K .......... .......... .......... .......... .......... 28% 769K 2m12s 2020-11-20T12:16:38.192 INFO:tasks.workunit.client.0.smithi093.stderr: 47500K .......... .......... .......... .......... .......... 28% 795K 2m12s 2020-11-20T12:16:38.230 INFO:tasks.workunit.client.0.smithi093.stderr: 47550K .......... .......... .......... .......... .......... 28% 1.27M 2m12s 2020-11-20T12:16:38.285 INFO:tasks.workunit.client.0.smithi093.stderr: 47600K .......... .......... .......... .......... .......... 28% 932K 2m12s 2020-11-20T12:16:38.344 INFO:tasks.workunit.client.0.smithi093.stderr: 47650K .......... .......... .......... .......... .......... 28% 842K 2m12s 2020-11-20T12:16:38.382 INFO:tasks.workunit.client.0.smithi093.stderr: 47700K .......... .......... .......... .......... .......... 28% 1.28M 2m12s 2020-11-20T12:16:38.437 INFO:tasks.workunit.client.0.smithi093.stderr: 47750K .......... .......... .......... .......... .......... 28% 896K 2m12s 2020-11-20T12:16:38.491 INFO:tasks.workunit.client.0.smithi093.stderr: 47800K .......... .......... .......... .......... .......... 28% 925K 2m12s 2020-11-20T12:16:38.527 INFO:tasks.workunit.client.0.smithi093.stderr: 47850K .......... .......... .......... .......... .......... 28% 1.37M 2m12s 2020-11-20T12:16:38.589 INFO:tasks.workunit.client.0.smithi093.stderr: 47900K .......... .......... .......... .......... .......... 28% 861K 2m12s 2020-11-20T12:16:38.647 INFO:tasks.workunit.client.0.smithi093.stderr: 47950K .......... .......... .......... .......... .......... 28% 804K 2m12s 2020-11-20T12:16:38.673 INFO:tasks.workunit.client.0.smithi093.stderr: 48000K .......... .......... .......... .......... .......... 28% 1.92M 2m11s 2020-11-20T12:16:38.738 INFO:tasks.workunit.client.0.smithi093.stderr: 48050K .......... .......... .......... .......... .......... 28% 765K 2m11s 2020-11-20T12:16:38.799 INFO:tasks.workunit.client.0.smithi093.stderr: 48100K .......... .......... .......... .......... .......... 28% 826K 2m11s 2020-11-20T12:16:38.830 INFO:tasks.workunit.client.0.smithi093.stderr: 48150K .......... .......... .......... .......... .......... 28% 1.54M 2m11s 2020-11-20T12:16:38.896 INFO:tasks.workunit.client.0.smithi093.stderr: 48200K .......... .......... .......... .......... .......... 28% 763K 2m11s 2020-11-20T12:16:38.954 INFO:tasks.workunit.client.0.smithi093.stderr: 48250K .......... .......... .......... .......... .......... 28% 855K 2m11s 2020-11-20T12:16:38.983 INFO:tasks.workunit.client.0.smithi093.stderr: 48300K .......... .......... .......... .......... .......... 28% 1.67M 2m11s 2020-11-20T12:16:39.050 INFO:tasks.workunit.client.0.smithi093.stderr: 48350K .......... .......... .......... .......... .......... 28% 757K 2m11s 2020-11-20T12:16:39.109 INFO:tasks.workunit.client.0.smithi093.stderr: 48400K .......... .......... .......... .......... .......... 28% 835K 2m11s 2020-11-20T12:16:39.139 INFO:tasks.workunit.client.0.smithi093.stderr: 48450K .......... .......... .......... .......... .......... 28% 1.64M 2m11s 2020-11-20T12:16:39.210 INFO:tasks.workunit.client.0.smithi093.stderr: 48500K .......... .......... .......... .......... .......... 28% 710K 2m11s 2020-11-20T12:16:39.267 INFO:tasks.workunit.client.0.smithi093.stderr: 48550K .......... .......... .......... .......... .......... 28% 865K 2m11s 2020-11-20T12:16:39.297 INFO:tasks.workunit.client.0.smithi093.stderr: 48600K .......... .......... .......... .......... .......... 28% 1.81M 2m11s 2020-11-20T12:16:39.365 INFO:tasks.workunit.client.0.smithi093.stderr: 48650K .......... .......... .......... .......... .......... 28% 704K 2m11s 2020-11-20T12:16:39.429 INFO:tasks.workunit.client.0.smithi093.stderr: 48700K .......... .......... .......... .......... .......... 28% 861K 2m11s 2020-11-20T12:16:39.458 INFO:tasks.workunit.client.0.smithi093.stderr: 48750K .......... .......... .......... .......... .......... 28% 1.44M 2m11s 2020-11-20T12:16:39.523 INFO:tasks.workunit.client.0.smithi093.stderr: 48800K .......... .......... .......... .......... .......... 28% 780K 2m11s 2020-11-20T12:16:39.563 INFO:tasks.workunit.client.0.smithi093.stderr: 48850K .......... .......... .......... .......... .......... 29% 1.17M 2m10s 2020-11-20T12:16:39.603 INFO:tasks.workunit.client.0.smithi093.stderr: 48900K .......... .......... .......... .......... .......... 29% 1.22M 2m10s 2020-11-20T12:16:39.655 INFO:tasks.workunit.client.0.smithi093.stderr: 48950K .......... .......... .......... .......... .......... 29% 971K 2m10s 2020-11-20T12:16:39.681 INFO:tasks.workunit.client.0.smithi093.stderr: 49000K .......... .......... .......... .......... .......... 29% 1.83M 2m10s 2020-11-20T12:16:39.731 INFO:tasks.workunit.client.0.smithi093.stderr: 49050K .......... .......... .......... .......... .......... 29% 996K 2m10s 2020-11-20T12:16:39.773 INFO:tasks.workunit.client.0.smithi093.stderr: 49100K .......... .......... .......... .......... .......... 29% 1.17M 2m10s 2020-11-20T12:16:39.801 INFO:tasks.workunit.client.0.smithi093.stderr: 49150K .......... .......... .......... .......... .......... 29% 1.81M 2m10s 2020-11-20T12:16:39.850 INFO:tasks.workunit.client.0.smithi093.stderr: 49200K .......... .......... .......... .......... .......... 29% 1002K 2m10s 2020-11-20T12:16:39.886 INFO:tasks.workunit.client.0.smithi093.stderr: 49250K .......... .......... .......... .......... .......... 29% 1.80M 2m10s 2020-11-20T12:16:39.918 INFO:tasks.workunit.client.0.smithi093.stderr: 49300K .......... .......... .......... .......... .......... 29% 1.19M 2m10s 2020-11-20T12:16:39.962 INFO:tasks.workunit.client.0.smithi093.stderr: 49350K .......... .......... .......... .......... .......... 29% 1.11M 2m10s 2020-11-20T12:16:39.993 INFO:tasks.workunit.client.0.smithi093.stderr: 49400K .......... .......... .......... .......... .......... 29% 1.55M 2m9s 2020-11-20T12:16:40.043 INFO:tasks.workunit.client.0.smithi093.stderr: 49450K .......... .......... .......... .......... .......... 29% 1010K 2m9s 2020-11-20T12:16:40.089 INFO:tasks.workunit.client.0.smithi093.stderr: 49500K .......... .......... .......... .......... .......... 29% 1.16M 2m9s 2020-11-20T12:16:40.120 INFO:tasks.workunit.client.0.smithi093.stderr: 49550K .......... .......... .......... .......... .......... 29% 1.41M 2m9s 2020-11-20T12:16:40.168 INFO:tasks.workunit.client.0.smithi093.stderr: 49600K .......... .......... .......... .......... .......... 29% 1.21M 2m9s 2020-11-20T12:16:40.197 INFO:tasks.workunit.client.0.smithi093.stderr: 49650K .......... .......... .......... .......... .......... 29% 1.33M 2m9s 2020-11-20T12:16:40.247 INFO:tasks.workunit.client.0.smithi093.stderr: 49700K .......... .......... .......... .......... .......... 29% 998K 2m9s 2020-11-20T12:16:40.286 INFO:tasks.workunit.client.0.smithi093.stderr: 49750K .......... .......... .......... .......... .......... 29% 1.25M 2m9s 2020-11-20T12:16:40.323 INFO:tasks.workunit.client.0.smithi093.stderr: 49800K .......... .......... .......... .......... .......... 29% 1.35M 2m9s 2020-11-20T12:16:40.365 INFO:tasks.workunit.client.0.smithi093.stderr: 49850K .......... .......... .......... .......... .......... 29% 1.13M 2m9s 2020-11-20T12:16:40.403 INFO:tasks.workunit.client.0.smithi093.stderr: 49900K .......... .......... .......... .......... .......... 29% 1.31M 2m9s 2020-11-20T12:16:40.459 INFO:tasks.workunit.client.0.smithi093.stderr: 49950K .......... .......... .......... .......... .......... 29% 973K 2m9s 2020-11-20T12:16:40.489 INFO:tasks.workunit.client.0.smithi093.stderr: 50000K .......... .......... .......... .......... .......... 29% 1.38M 2m8s 2020-11-20T12:16:40.537 INFO:tasks.workunit.client.0.smithi093.stderr: 50050K .......... .......... .......... .......... .......... 29% 1.12M 2m8s 2020-11-20T12:16:40.582 INFO:tasks.workunit.client.0.smithi093.stderr: 50100K .......... .......... .......... .......... .......... 29% 1006K 2m8s 2020-11-20T12:16:40.618 INFO:tasks.workunit.client.0.smithi093.stderr: 50150K .......... .......... .......... .......... .......... 29% 1.59M 2m8s 2020-11-20T12:16:40.664 INFO:tasks.workunit.client.0.smithi093.stderr: 50200K .......... .......... .......... .......... .......... 29% 979K 2m8s 2020-11-20T12:16:40.694 INFO:tasks.workunit.client.0.smithi093.stderr: 50250K .......... .......... .......... .......... .......... 29% 1.59M 2m8s 2020-11-20T12:16:40.755 INFO:tasks.workunit.client.0.smithi093.stderr: 50300K .......... .......... .......... .......... .......... 29% 941K 2m8s 2020-11-20T12:16:40.775 INFO:tasks.workunit.client.0.smithi093.stderr: 50350K .......... .......... .......... .......... .......... 29% 1.83M 2m8s 2020-11-20T12:16:40.833 INFO:tasks.workunit.client.0.smithi093.stderr: 50400K .......... .......... .......... .......... .......... 29% 919K 2m8s 2020-11-20T12:16:40.883 INFO:tasks.workunit.client.0.smithi093.stderr: 50450K .......... .......... .......... .......... .......... 29% 919K 2m8s 2020-11-20T12:16:40.921 INFO:tasks.workunit.client.0.smithi093.stderr: 50500K .......... .......... .......... .......... .......... 29% 1.48M 2m8s 2020-11-20T12:16:40.968 INFO:tasks.workunit.client.0.smithi093.stderr: 50550K .......... .......... .......... .......... .......... 30% 962K 2m8s 2020-11-20T12:16:41.007 INFO:tasks.workunit.client.0.smithi093.stderr: 50600K .......... .......... .......... .......... .......... 30% 1.43M 2m7s 2020-11-20T12:16:41.053 INFO:tasks.workunit.client.0.smithi093.stderr: 50650K .......... .......... .......... .......... .......... 30% 997K 2m7s 2020-11-20T12:16:41.085 INFO:tasks.workunit.client.0.smithi093.stderr: 50700K .......... .......... .......... .......... .......... 30% 1.48M 2m7s 2020-11-20T12:16:41.140 INFO:tasks.workunit.client.0.smithi093.stderr: 50750K .......... .......... .......... .......... .......... 30% 923K 2m7s 2020-11-20T12:16:41.168 INFO:tasks.workunit.client.0.smithi093.stderr: 50800K .......... .......... .......... .......... .......... 30% 1.74M 2m7s 2020-11-20T12:16:41.226 INFO:tasks.workunit.client.0.smithi093.stderr: 50850K .......... .......... .......... .......... .......... 30% 901K 2m7s 2020-11-20T12:16:41.260 INFO:tasks.workunit.client.0.smithi093.stderr: 50900K .......... .......... .......... .......... .......... 30% 1.83M 2m7s 2020-11-20T12:16:41.304 INFO:tasks.workunit.client.0.smithi093.stderr: 50950K .......... .......... .......... .......... .......... 30% 955K 2m7s 2020-11-20T12:16:41.336 INFO:tasks.workunit.client.0.smithi093.stderr: 51000K .......... .......... .......... .......... .......... 30% 1.46M 2m7s 2020-11-20T12:16:41.386 INFO:tasks.workunit.client.0.smithi093.stderr: 51050K .......... .......... .......... .......... .......... 30% 1.13M 2m7s 2020-11-20T12:16:41.419 INFO:tasks.workunit.client.0.smithi093.stderr: 51100K .......... .......... .......... .......... .......... 30% 1.22M 2m7s 2020-11-20T12:16:41.455 INFO:tasks.workunit.client.0.smithi093.stderr: 51150K .......... .......... .......... .......... .......... 30% 1.35M 2m7s 2020-11-20T12:16:41.495 INFO:tasks.workunit.client.0.smithi093.stderr: 51200K .......... .......... .......... .......... .......... 30% 1.29M 2m6s 2020-11-20T12:16:41.527 INFO:tasks.workunit.client.0.smithi093.stderr: 51250K .......... .......... .......... .......... .......... 30% 1.43M 2m6s 2020-11-20T12:16:41.563 INFO:tasks.workunit.client.0.smithi093.stderr: 51300K .......... .......... .......... .......... .......... 30% 1.38M 2m6s 2020-11-20T12:16:41.599 INFO:tasks.workunit.client.0.smithi093.stderr: 51350K .......... .......... .......... .......... .......... 30% 1.39M 2m6s 2020-11-20T12:16:41.635 INFO:tasks.workunit.client.0.smithi093.stderr: 51400K .......... .......... .......... .......... .......... 30% 1.34M 2m6s 2020-11-20T12:16:41.667 INFO:tasks.workunit.client.0.smithi093.stderr: 51450K .......... .......... .......... .......... .......... 30% 1.51M 2m6s 2020-11-20T12:16:41.704 INFO:tasks.workunit.client.0.smithi093.stderr: 51500K .......... .......... .......... .......... .......... 30% 1.33M 2m6s 2020-11-20T12:16:41.741 INFO:tasks.workunit.client.0.smithi093.stderr: 51550K .......... .......... .......... .......... .......... 30% 1.33M 2m6s 2020-11-20T12:16:41.776 INFO:tasks.workunit.client.0.smithi093.stderr: 51600K .......... .......... .......... .......... .......... 30% 1.36M 2m6s 2020-11-20T12:16:41.809 INFO:tasks.workunit.client.0.smithi093.stderr: 51650K .......... .......... .......... .......... .......... 30% 1.63M 2m6s 2020-11-20T12:16:41.850 INFO:tasks.workunit.client.0.smithi093.stderr: 51700K .......... .......... .......... .......... .......... 30% 1.12M 2m5s 2020-11-20T12:16:41.884 INFO:tasks.workunit.client.0.smithi093.stderr: 51750K .......... .......... .......... .......... .......... 30% 1.62M 2m5s 2020-11-20T12:16:41.927 INFO:tasks.workunit.client.0.smithi093.stderr: 51800K .......... .......... .......... .......... .......... 30% 1.05M 2m5s 2020-11-20T12:16:41.957 INFO:tasks.workunit.client.0.smithi093.stderr: 51850K .......... .......... .......... .......... .......... 30% 1.73M 2m5s 2020-11-20T12:16:42.003 INFO:tasks.workunit.client.0.smithi093.stderr: 51900K .......... .......... .......... .......... .......... 30% 1.04M 2m5s 2020-11-20T12:16:42.033 INFO:tasks.workunit.client.0.smithi093.stderr: 51950K .......... .......... .......... .......... .......... 30% 1.84M 2m5s 2020-11-20T12:16:42.079 INFO:tasks.workunit.client.0.smithi093.stderr: 52000K .......... .......... .......... .......... .......... 30% 1021K 2m5s 2020-11-20T12:16:42.102 INFO:tasks.workunit.client.0.smithi093.stderr: 52050K .......... .......... .......... .......... .......... 30% 1.96M 2m5s 2020-11-20T12:16:42.152 INFO:tasks.workunit.client.0.smithi093.stderr: 52100K .......... .......... .......... .......... .......... 30% 1.00M 2m5s 2020-11-20T12:16:42.175 INFO:tasks.workunit.client.0.smithi093.stderr: 52150K .......... .......... .......... .......... .......... 30% 2.02M 2m5s 2020-11-20T12:16:42.231 INFO:tasks.workunit.client.0.smithi093.stderr: 52200K .......... .......... .......... .......... .......... 30% 890K 2m5s 2020-11-20T12:16:42.253 INFO:tasks.workunit.client.0.smithi093.stderr: 52250K .......... .......... .......... .......... .......... 31% 2.27M 2m4s 2020-11-20T12:16:42.309 INFO:tasks.workunit.client.0.smithi093.stderr: 52300K .......... .......... .......... .......... .......... 31% 1016K 2m4s 2020-11-20T12:16:42.332 INFO:tasks.workunit.client.0.smithi093.stderr: 52350K .......... .......... .......... .......... .......... 31% 1.75M 2m4s 2020-11-20T12:16:42.377 INFO:tasks.workunit.client.0.smithi093.stderr: 52400K .......... .......... .......... .......... .......... 31% 1.04M 2m4s 2020-11-20T12:16:42.406 INFO:tasks.workunit.client.0.smithi093.stderr: 52450K .......... .......... .......... .......... .......... 31% 1.68M 2m4s 2020-11-20T12:16:42.442 INFO:tasks.workunit.client.0.smithi093.stderr: 52500K .......... .......... .......... .......... .......... 31% 1.35M 2m4s 2020-11-20T12:16:42.481 INFO:tasks.workunit.client.0.smithi093.stderr: 52550K .......... .......... .......... .......... .......... 31% 1.24M 2m4s 2020-11-20T12:16:42.526 INFO:tasks.workunit.client.0.smithi093.stderr: 52600K .......... .......... .......... .......... .......... 31% 1.11M 2m4s 2020-11-20T12:16:42.560 INFO:tasks.workunit.client.0.smithi093.stderr: 52650K .......... .......... .......... .......... .......... 31% 1.39M 2m4s 2020-11-20T12:16:42.601 INFO:tasks.workunit.client.0.smithi093.stderr: 52700K .......... .......... .......... .......... .......... 31% 1.24M 2m4s 2020-11-20T12:16:42.635 INFO:tasks.workunit.client.0.smithi093.stderr: 52750K .......... .......... .......... .......... .......... 31% 1.55M 2m4s 2020-11-20T12:16:42.679 INFO:tasks.workunit.client.0.smithi093.stderr: 52800K .......... .......... .......... .......... .......... 31% 1.03M 2m4s 2020-11-20T12:16:42.703 INFO:tasks.workunit.client.0.smithi093.stderr: 52850K .......... .......... .......... .......... .......... 31% 2.05M 2m3s 2020-11-20T12:16:42.755 INFO:tasks.workunit.client.0.smithi093.stderr: 52900K .......... .......... .......... .......... .......... 31% 966K 2m3s 2020-11-20T12:16:42.779 INFO:tasks.workunit.client.0.smithi093.stderr: 52950K .......... .......... .......... .......... .......... 31% 2.19M 2m3s 2020-11-20T12:16:42.833 INFO:tasks.workunit.client.0.smithi093.stderr: 53000K .......... .......... .......... .......... .......... 31% 914K 2m3s 2020-11-20T12:16:42.855 INFO:tasks.workunit.client.0.smithi093.stderr: 53050K .......... .......... .......... .......... .......... 31% 2.08M 2m3s 2020-11-20T12:16:42.910 INFO:tasks.workunit.client.0.smithi093.stderr: 53100K .......... .......... .......... .......... .......... 31% 1.37M 2m3s 2020-11-20T12:16:42.930 INFO:tasks.workunit.client.0.smithi093.stderr: 53150K .......... .......... .......... .......... .......... 31% 1.25M 2m3s 2020-11-20T12:16:42.960 INFO:tasks.workunit.client.0.smithi093.stderr: 53200K .......... .......... .......... .......... .......... 31% 1.68M 2m3s 2020-11-20T12:16:42.991 INFO:tasks.workunit.client.0.smithi093.stderr: 53250K .......... .......... .......... .......... .......... 31% 1.52M 2m3s 2020-11-20T12:16:43.035 INFO:tasks.workunit.client.0.smithi093.stderr: 53300K .......... .......... .......... .......... .......... 31% 1.33M 2m3s 2020-11-20T12:16:43.062 INFO:tasks.workunit.client.0.smithi093.stderr: 53350K .......... .......... .......... .......... .......... 31% 1.45M 2m3s 2020-11-20T12:16:43.089 INFO:tasks.workunit.client.0.smithi093.stderr: 53400K .......... .......... .......... .......... .......... 31% 1.75M 2m2s 2020-11-20T12:16:43.129 INFO:tasks.workunit.client.0.smithi093.stderr: 53450K .......... .......... .......... .......... .......... 31% 1.27M 2m2s 2020-11-20T12:16:43.158 INFO:tasks.workunit.client.0.smithi093.stderr: 53500K .......... .......... .......... .......... .......... 31% 1.65M 2m2s 2020-11-20T12:16:43.196 INFO:tasks.workunit.client.0.smithi093.stderr: 53550K .......... .......... .......... .......... .......... 31% 1.28M 2m2s 2020-11-20T12:16:43.221 INFO:tasks.workunit.client.0.smithi093.stderr: 53600K .......... .......... .......... .......... .......... 31% 1.88M 2m2s 2020-11-20T12:16:43.250 INFO:tasks.workunit.client.0.smithi093.stderr: 53650K .......... .......... .......... .......... .......... 31% 1.79M 2m2s 2020-11-20T12:16:43.270 INFO:tasks.workunit.client.0.smithi093.stderr: 53700K .......... .......... .......... .......... .......... 31% 2.41M 2m2s 2020-11-20T12:16:43.313 INFO:tasks.workunit.client.0.smithi093.stderr: 53750K .......... .......... .......... .......... .......... 31% 1.12M 2m2s 2020-11-20T12:16:43.331 INFO:tasks.workunit.client.0.smithi093.stderr: 53800K .......... .......... .......... .......... .......... 31% 2.99M 2m2s 2020-11-20T12:16:43.361 INFO:tasks.workunit.client.0.smithi093.stderr: 53850K .......... .......... .......... .......... .......... 31% 1.54M 2m1s 2020-11-20T12:16:43.399 INFO:tasks.workunit.client.0.smithi093.stderr: 53900K .......... .......... .......... .......... .......... 32% 1.31M 2m1s 2020-11-20T12:16:43.425 INFO:tasks.workunit.client.0.smithi093.stderr: 53950K .......... .......... .......... .......... .......... 32% 1.83M 2m1s 2020-11-20T12:16:43.465 INFO:tasks.workunit.client.0.smithi093.stderr: 54000K .......... .......... .......... .......... .......... 32% 1.44M 2m1s 2020-11-20T12:16:43.489 INFO:tasks.workunit.client.0.smithi093.stderr: 54050K .......... .......... .......... .......... .......... 32% 1.61M 2m1s 2020-11-20T12:16:43.519 INFO:tasks.workunit.client.0.smithi093.stderr: 54100K .......... .......... .......... .......... .......... 32% 1.64M 2m1s 2020-11-20T12:16:43.541 INFO:tasks.workunit.client.0.smithi093.stderr: 54150K .......... .......... .......... .......... .......... 32% 2.22M 2m1s 2020-11-20T12:16:43.578 INFO:tasks.workunit.client.0.smithi093.stderr: 54200K .......... .......... .......... .......... .......... 32% 1.30M 2m1s 2020-11-20T12:16:43.610 INFO:tasks.workunit.client.0.smithi093.stderr: 54250K .......... .......... .......... .......... .......... 32% 1.57M 2m1s 2020-11-20T12:16:43.638 INFO:tasks.workunit.client.0.smithi093.stderr: 54300K .......... .......... .......... .......... .......... 32% 1.71M 2m1s 2020-11-20T12:16:43.680 INFO:tasks.workunit.client.0.smithi093.stderr: 54350K .......... .......... .......... .......... .......... 32% 1.41M 2m0s 2020-11-20T12:16:43.704 INFO:tasks.workunit.client.0.smithi093.stderr: 54400K .......... .......... .......... .......... .......... 32% 1.83M 2m0s 2020-11-20T12:16:43.737 INFO:tasks.workunit.client.0.smithi093.stderr: 54450K .......... .......... .......... .......... .......... 32% 1.34M 2m0s 2020-11-20T12:16:43.758 INFO:tasks.workunit.client.0.smithi093.stderr: 54500K .......... .......... .......... .......... .......... 32% 2.19M 2m0s 2020-11-20T12:16:43.795 INFO:tasks.workunit.client.0.smithi093.stderr: 54550K .......... .......... .......... .......... .......... 32% 1.71M 2m0s 2020-11-20T12:16:43.830 INFO:tasks.workunit.client.0.smithi093.stderr: 54600K .......... .......... .......... .......... .......... 32% 1.12M 2m0s 2020-11-20T12:16:43.855 INFO:tasks.workunit.client.0.smithi093.stderr: 54650K .......... .......... .......... .......... .......... 32% 1.97M 2m0s 2020-11-20T12:16:43.889 INFO:tasks.workunit.client.0.smithi093.stderr: 54700K .......... .......... .......... .......... .......... 32% 1.42M 2m0s 2020-11-20T12:16:43.916 INFO:tasks.workunit.client.0.smithi093.stderr: 54750K .......... .......... .......... .......... .......... 32% 1.79M 2m0s 2020-11-20T12:16:43.963 INFO:tasks.workunit.client.0.smithi093.stderr: 54800K .......... .......... .......... .......... .......... 32% 1.33M 2m0s 2020-11-20T12:16:43.986 INFO:tasks.workunit.client.0.smithi093.stderr: 54850K .......... .......... .......... .......... .......... 32% 1.48M 2m0s 2020-11-20T12:16:44.014 INFO:tasks.workunit.client.0.smithi093.stderr: 54900K .......... .......... .......... .......... .......... 32% 1.75M 1m59s 2020-11-20T12:16:44.056 INFO:tasks.workunit.client.0.smithi093.stderr: 54950K .......... .......... .......... .......... .......... 32% 1.16M 1m59s 2020-11-20T12:16:44.078 INFO:tasks.workunit.client.0.smithi093.stderr: 55000K .......... .......... .......... .......... .......... 32% 2.30M 1m59s 2020-11-20T12:16:44.117 INFO:tasks.workunit.client.0.smithi093.stderr: 55050K .......... .......... .......... .......... .......... 32% 1.21M 1m59s 2020-11-20T12:16:44.142 INFO:tasks.workunit.client.0.smithi093.stderr: 55100K .......... .......... .......... .......... .......... 32% 1.99M 1m59s 2020-11-20T12:16:44.186 INFO:tasks.workunit.client.0.smithi093.stderr: 55150K .......... .......... .......... .......... .......... 32% 1.13M 1m59s 2020-11-20T12:16:44.216 INFO:tasks.workunit.client.0.smithi093.stderr: 55200K .......... .......... .......... .......... .......... 32% 1.60M 1m59s 2020-11-20T12:16:44.240 INFO:tasks.workunit.client.0.smithi093.stderr: 55250K .......... .......... .......... .......... .......... 32% 2.06M 1m59s 2020-11-20T12:16:44.359 INFO:tasks.workunit.client.0.smithi093.stderr: 55300K .......... .......... .......... .......... .......... 32% 425K 1m59s 2020-11-20T12:16:44.359 INFO:tasks.workunit.client.0.smithi093.stderr: 55350K .......... .......... .......... .......... .......... 32% 427M 1m59s 2020-11-20T12:16:44.359 INFO:tasks.workunit.client.0.smithi093.stderr: 55400K .......... .......... .......... .......... .......... 32% 504M 1m59s 2020-11-20T12:16:44.386 INFO:tasks.workunit.client.0.smithi093.stderr: 55450K .......... .......... .......... .......... .......... 32% 1.73M 1m58s 2020-11-20T12:16:44.444 INFO:tasks.workunit.client.0.smithi093.stderr: 55500K .......... .......... .......... .......... .......... 32% 992K 1m58s 2020-11-20T12:16:44.476 INFO:tasks.workunit.client.0.smithi093.stderr: 55550K .......... .......... .......... .......... .......... 32% 1.22M 1m58s 2020-11-20T12:16:44.526 INFO:tasks.workunit.client.0.smithi093.stderr: 55600K .......... .......... .......... .......... .......... 33% 1003K 1m58s 2020-11-20T12:16:44.561 INFO:tasks.workunit.client.0.smithi093.stderr: 55650K .......... .......... .......... .......... .......... 33% 1.43M 1m58s 2020-11-20T12:16:44.605 INFO:tasks.workunit.client.0.smithi093.stderr: 55700K .......... .......... .......... .......... .......... 33% 1.10M 1m58s 2020-11-20T12:16:44.650 INFO:tasks.workunit.client.0.smithi093.stderr: 55750K .......... .......... .......... .......... .......... 33% 1.09M 1m58s 2020-11-20T12:16:44.683 INFO:tasks.workunit.client.0.smithi093.stderr: 55800K .......... .......... .......... .......... .......... 33% 1.50M 1m58s 2020-11-20T12:16:44.726 INFO:tasks.workunit.client.0.smithi093.stderr: 55850K .......... .......... .......... .......... .......... 33% 1.12M 1m58s 2020-11-20T12:16:44.760 INFO:tasks.workunit.client.0.smithi093.stderr: 55900K .......... .......... .......... .......... .......... 33% 1.47M 1m58s 2020-11-20T12:16:44.807 INFO:tasks.workunit.client.0.smithi093.stderr: 55950K .......... .......... .......... .......... .......... 33% 1.02M 1m58s 2020-11-20T12:16:44.836 INFO:tasks.workunit.client.0.smithi093.stderr: 56000K .......... .......... .......... .......... .......... 33% 1.65M 1m58s 2020-11-20T12:16:44.883 INFO:tasks.workunit.client.0.smithi093.stderr: 56050K .......... .......... .......... .......... .......... 33% 1.04M 1m58s 2020-11-20T12:16:44.918 INFO:tasks.workunit.client.0.smithi093.stderr: 56100K .......... .......... .......... .......... .......... 33% 1.41M 1m57s 2020-11-20T12:16:44.961 INFO:tasks.workunit.client.0.smithi093.stderr: 56150K .......... .......... .......... .......... .......... 33% 1.11M 1m57s 2020-11-20T12:16:44.995 INFO:tasks.workunit.client.0.smithi093.stderr: 56200K .......... .......... .......... .......... .......... 33% 1.43M 1m57s 2020-11-20T12:16:45.041 INFO:tasks.workunit.client.0.smithi093.stderr: 56250K .......... .......... .......... .......... .......... 33% 1.07M 1m57s 2020-11-20T12:16:45.077 INFO:tasks.workunit.client.0.smithi093.stderr: 56300K .......... .......... .......... .......... .......... 33% 1.37M 1m57s 2020-11-20T12:16:45.123 INFO:tasks.workunit.client.0.smithi093.stderr: 56350K .......... .......... .......... .......... .......... 33% 1.19M 1m57s 2020-11-20T12:16:45.155 INFO:tasks.workunit.client.0.smithi093.stderr: 56400K .......... .......... .......... .......... .......... 33% 1.31M 1m57s 2020-11-20T12:16:45.195 INFO:tasks.workunit.client.0.smithi093.stderr: 56450K .......... .......... .......... .......... .......... 33% 1.23M 1m57s 2020-11-20T12:16:45.230 INFO:tasks.workunit.client.0.smithi093.stderr: 56500K .......... .......... .......... .......... .......... 33% 1.40M 1m57s 2020-11-20T12:16:45.267 INFO:tasks.workunit.client.0.smithi093.stderr: 56550K .......... .......... .......... .......... .......... 33% 1.31M 1m57s 2020-11-20T12:16:45.303 INFO:tasks.workunit.client.0.smithi093.stderr: 56600K .......... .......... .......... .......... .......... 33% 1.46M 1m57s 2020-11-20T12:16:45.340 INFO:tasks.workunit.client.0.smithi093.stderr: 56650K .......... .......... .......... .......... .......... 33% 1.23M 1m57s 2020-11-20T12:16:45.372 INFO:tasks.workunit.client.0.smithi093.stderr: 56700K .......... .......... .......... .......... .......... 33% 1.59M 1m56s 2020-11-20T12:16:45.403 INFO:tasks.workunit.client.0.smithi093.stderr: 56750K .......... .......... .......... .......... .......... 33% 1.50M 1m56s 2020-11-20T12:16:45.441 INFO:tasks.workunit.client.0.smithi093.stderr: 56800K .......... .......... .......... .......... .......... 33% 1.34M 1m56s 2020-11-20T12:16:45.471 INFO:tasks.workunit.client.0.smithi093.stderr: 56850K .......... .......... .......... .......... .......... 33% 1.71M 1m56s 2020-11-20T12:16:45.502 INFO:tasks.workunit.client.0.smithi093.stderr: 56900K .......... .......... .......... .......... .......... 33% 1.75M 1m56s 2020-11-20T12:16:45.532 INFO:tasks.workunit.client.0.smithi093.stderr: 56950K .......... .......... .......... .......... .......... 33% 1.44M 1m56s 2020-11-20T12:16:45.559 INFO:tasks.workunit.client.0.smithi093.stderr: 57000K .......... .......... .......... .......... .......... 33% 1.72M 1m56s 2020-11-20T12:16:45.579 INFO:tasks.workunit.client.0.smithi093.stderr: 57050K .......... .......... .......... .......... .......... 33% 2.37M 1m56s 2020-11-20T12:16:45.629 INFO:tasks.workunit.client.0.smithi093.stderr: 57100K .......... .......... .......... .......... .......... 33% 1.06M 1m56s 2020-11-20T12:16:45.646 INFO:tasks.workunit.client.0.smithi093.stderr: 57150K .......... .......... .......... .......... .......... 33% 2.38M 1m56s 2020-11-20T12:16:45.687 INFO:tasks.workunit.client.0.smithi093.stderr: 57200K .......... .......... .......... .......... .......... 33% 1.25M 1m56s 2020-11-20T12:16:45.713 INFO:tasks.workunit.client.0.smithi093.stderr: 57250K .......... .......... .......... .......... .......... 33% 1.76M 1m55s 2020-11-20T12:16:45.746 INFO:tasks.workunit.client.0.smithi093.stderr: 57300K .......... .......... .......... .......... .......... 34% 1.50M 1m55s 2020-11-20T12:16:45.775 INFO:tasks.workunit.client.0.smithi093.stderr: 57350K .......... .......... .......... .......... .......... 34% 1.73M 1m55s 2020-11-20T12:16:45.802 INFO:tasks.workunit.client.0.smithi093.stderr: 57400K .......... .......... .......... .......... .......... 34% 1.79M 1m55s 2020-11-20T12:16:45.845 INFO:tasks.workunit.client.0.smithi093.stderr: 57450K .......... .......... .......... .......... .......... 34% 1.11M 1m55s 2020-11-20T12:16:45.873 INFO:tasks.workunit.client.0.smithi093.stderr: 57500K .......... .......... .......... .......... .......... 34% 1.80M 1m55s 2020-11-20T12:16:45.914 INFO:tasks.workunit.client.0.smithi093.stderr: 57550K .......... .......... .......... .......... .......... 34% 1.17M 1m55s 2020-11-20T12:16:45.935 INFO:tasks.workunit.client.0.smithi093.stderr: 57600K .......... .......... .......... .......... .......... 34% 2.33M 1m55s 2020-11-20T12:16:45.978 INFO:tasks.workunit.client.0.smithi093.stderr: 57650K .......... .......... .......... .......... .......... 34% 1.27M 1m55s 2020-11-20T12:16:46.006 INFO:tasks.workunit.client.0.smithi093.stderr: 57700K .......... .......... .......... .......... .......... 34% 2.09M 1m55s 2020-11-20T12:16:46.037 INFO:tasks.workunit.client.0.smithi093.stderr: 57750K .......... .......... .......... .......... .......... 34% 1.21M 1m55s 2020-11-20T12:16:46.070 INFO:tasks.workunit.client.0.smithi093.stderr: 57800K .......... .......... .......... .......... .......... 34% 1.52M 1m54s 2020-11-20T12:16:46.095 INFO:tasks.workunit.client.0.smithi093.stderr: 57850K .......... .......... .......... .......... .......... 34% 1.86M 1m54s 2020-11-20T12:16:46.142 INFO:tasks.workunit.client.0.smithi093.stderr: 57900K .......... .......... .......... .......... .......... 34% 1.14M 1m54s 2020-11-20T12:16:46.246 INFO:tasks.workunit.client.0.smithi093.stderr: 57950K .......... .......... .......... .......... .......... 34% 466K 1m54s 2020-11-20T12:16:46.266 INFO:tasks.workunit.client.0.smithi093.stderr: 58000K .......... .......... .......... .......... .......... 34% 2.42M 1m54s 2020-11-20T12:16:46.267 INFO:tasks.workunit.client.0.smithi093.stderr: 58050K .......... .......... .......... .......... .......... 34% 407M 1m54s 2020-11-20T12:16:46.298 INFO:tasks.workunit.client.0.smithi093.stderr: 58100K .......... .......... .......... .......... .......... 34% 1.49M 1m54s 2020-11-20T12:16:46.339 INFO:tasks.workunit.client.0.smithi093.stderr: 58150K .......... .......... .......... .......... .......... 34% 1.22M 1m54s 2020-11-20T12:16:46.377 INFO:tasks.workunit.client.0.smithi093.stderr: 58200K .......... .......... .......... .......... .......... 34% 1.33M 1m54s 2020-11-20T12:16:46.429 INFO:tasks.workunit.client.0.smithi093.stderr: 58250K .......... .......... .......... .......... .......... 34% 938K 1m54s 2020-11-20T12:16:46.462 INFO:tasks.workunit.client.0.smithi093.stderr: 58300K .......... .......... .......... .......... .......... 34% 1.47M 1m54s 2020-11-20T12:16:46.508 INFO:tasks.workunit.client.0.smithi093.stderr: 58350K .......... .......... .......... .......... .......... 34% 1.05M 1m54s 2020-11-20T12:16:46.544 INFO:tasks.workunit.client.0.smithi093.stderr: 58400K .......... .......... .......... .......... .......... 34% 1.58M 1m54s 2020-11-20T12:16:46.581 INFO:tasks.workunit.client.0.smithi093.stderr: 58450K .......... .......... .......... .......... .......... 34% 1.20M 1m53s 2020-11-20T12:16:46.632 INFO:tasks.workunit.client.0.smithi093.stderr: 58500K .......... .......... .......... .......... .......... 34% 1.17M 1m53s 2020-11-20T12:16:46.652 INFO:tasks.workunit.client.0.smithi093.stderr: 58550K .......... .......... .......... .......... .......... 34% 1.61M 1m53s 2020-11-20T12:16:46.710 INFO:tasks.workunit.client.0.smithi093.stderr: 58600K .......... .......... .......... .......... .......... 34% 861K 1m53s 2020-11-20T12:16:46.743 INFO:tasks.workunit.client.0.smithi093.stderr: 58650K .......... .......... .......... .......... .......... 34% 1.46M 1m53s 2020-11-20T12:16:46.788 INFO:tasks.workunit.client.0.smithi093.stderr: 58700K .......... .......... .......... .......... .......... 34% 1.11M 1m53s 2020-11-20T12:16:46.818 INFO:tasks.workunit.client.0.smithi093.stderr: 58750K .......... .......... .......... .......... .......... 34% 1.59M 1m53s 2020-11-20T12:16:46.860 INFO:tasks.workunit.client.0.smithi093.stderr: 58800K .......... .......... .......... .......... .......... 34% 1.14M 1m53s 2020-11-20T12:16:46.903 INFO:tasks.workunit.client.0.smithi093.stderr: 58850K .......... .......... .......... .......... .......... 34% 1.40M 1m53s 2020-11-20T12:16:46.938 INFO:tasks.workunit.client.0.smithi093.stderr: 58900K .......... .......... .......... .......... .......... 34% 1.16M 1m53s 2020-11-20T12:16:46.988 INFO:tasks.workunit.client.0.smithi093.stderr: 58950K .......... .......... .......... .......... .......... 35% 1.11M 1m53s 2020-11-20T12:16:47.019 INFO:tasks.workunit.client.0.smithi093.stderr: 59000K .......... .......... .......... .......... .......... 35% 1.31M 1m53s 2020-11-20T12:16:47.070 INFO:tasks.workunit.client.0.smithi093.stderr: 59050K .......... .......... .......... .......... .......... 35% 991K 1m53s 2020-11-20T12:16:47.115 INFO:tasks.workunit.client.0.smithi093.stderr: 59100K .......... .......... .......... .......... .......... 35% 1.09M 1m53s 2020-11-20T12:16:47.154 INFO:tasks.workunit.client.0.smithi093.stderr: 59150K .......... .......... .......... .......... .......... 35% 1.25M 1m52s 2020-11-20T12:16:47.194 INFO:tasks.workunit.client.0.smithi093.stderr: 59200K .......... .......... .......... .......... .......... 35% 1.27M 1m52s 2020-11-20T12:16:47.236 INFO:tasks.workunit.client.0.smithi093.stderr: 59250K .......... .......... .......... .......... .......... 35% 1.09M 1m52s 2020-11-20T12:16:47.280 INFO:tasks.workunit.client.0.smithi093.stderr: 59300K .......... .......... .......... .......... .......... 35% 1.37M 1m52s 2020-11-20T12:16:47.320 INFO:tasks.workunit.client.0.smithi093.stderr: 59350K .......... .......... .......... .......... .......... 35% 1.01M 1m52s 2020-11-20T12:16:47.360 INFO:tasks.workunit.client.0.smithi093.stderr: 59400K .......... .......... .......... .......... .......... 35% 1.23M 1m52s 2020-11-20T12:16:47.455 INFO:tasks.workunit.client.0.smithi093.stderr: 59450K .......... .......... .......... .......... .......... 35% 532K 1m52s 2020-11-20T12:16:47.455 INFO:tasks.workunit.client.0.smithi093.stderr: 59500K .......... .......... .......... .......... .......... 35% 457M 1m52s 2020-11-20T12:16:47.503 INFO:tasks.workunit.client.0.smithi093.stderr: 59550K .......... .......... .......... .......... .......... 35% 1021K 1m52s 2020-11-20T12:16:47.543 INFO:tasks.workunit.client.0.smithi093.stderr: 59600K .......... .......... .......... .......... .......... 35% 1.25M 1m52s 2020-11-20T12:16:47.592 INFO:tasks.workunit.client.0.smithi093.stderr: 59650K .......... .......... .......... .......... .......... 35% 1.02M 1m52s 2020-11-20T12:16:47.632 INFO:tasks.workunit.client.0.smithi093.stderr: 59700K .......... .......... .......... .......... .......... 35% 1.14M 1m52s 2020-11-20T12:16:47.670 INFO:tasks.workunit.client.0.smithi093.stderr: 59750K .......... .......... .......... .......... .......... 35% 1.30M 1m52s 2020-11-20T12:16:47.725 INFO:tasks.workunit.client.0.smithi093.stderr: 59800K .......... .......... .......... .......... .......... 35% 916K 1m52s 2020-11-20T12:16:47.764 INFO:tasks.workunit.client.0.smithi093.stderr: 59850K .......... .......... .......... .......... .......... 35% 1.40M 1m52s 2020-11-20T12:16:47.804 INFO:tasks.workunit.client.0.smithi093.stderr: 59900K .......... .......... .......... .......... .......... 35% 1.11M 1m52s 2020-11-20T12:16:47.846 INFO:tasks.workunit.client.0.smithi093.stderr: 59950K .......... .......... .......... .......... .......... 35% 1.15M 1m51s 2020-11-20T12:16:47.894 INFO:tasks.workunit.client.0.smithi093.stderr: 60000K .......... .......... .......... .......... .......... 35% 1.00M 1m51s 2020-11-20T12:16:47.931 INFO:tasks.workunit.client.0.smithi093.stderr: 60050K .......... .......... .......... .......... .......... 35% 1.32M 1m51s 2020-11-20T12:16:47.973 INFO:tasks.workunit.client.0.smithi093.stderr: 60100K .......... .......... .......... .......... .......... 35% 1.18M 1m51s 2020-11-20T12:16:48.029 INFO:tasks.workunit.client.0.smithi093.stderr: 60150K .......... .......... .......... .......... .......... 35% 893K 1m51s 2020-11-20T12:16:48.063 INFO:tasks.workunit.client.0.smithi093.stderr: 60200K .......... .......... .......... .......... .......... 35% 1.42M 1m51s 2020-11-20T12:16:48.106 INFO:tasks.workunit.client.0.smithi093.stderr: 60250K .......... .......... .......... .......... .......... 35% 1.13M 1m51s 2020-11-20T12:16:48.167 INFO:tasks.workunit.client.0.smithi093.stderr: 60300K .......... .......... .......... .......... .......... 35% 825K 1m51s 2020-11-20T12:16:48.199 INFO:tasks.workunit.client.0.smithi093.stderr: 60350K .......... .......... .......... .......... .......... 35% 1.52M 1m51s 2020-11-20T12:16:48.239 INFO:tasks.workunit.client.0.smithi093.stderr: 60400K .......... .......... .......... .......... .......... 35% 1.19M 1m51s 2020-11-20T12:16:48.302 INFO:tasks.workunit.client.0.smithi093.stderr: 60450K .......... .......... .......... .......... .......... 35% 815K 1m51s 2020-11-20T12:16:48.330 INFO:tasks.workunit.client.0.smithi093.stderr: 60500K .......... .......... .......... .......... .......... 35% 1.67M 1m51s 2020-11-20T12:16:48.381 INFO:tasks.workunit.client.0.smithi093.stderr: 60550K .......... .......... .......... .......... .......... 35% 979K 1m51s 2020-11-20T12:16:48.438 INFO:tasks.workunit.client.0.smithi093.stderr: 60600K .......... .......... .......... .......... .......... 35% 876K 1m51s 2020-11-20T12:16:48.471 INFO:tasks.workunit.client.0.smithi093.stderr: 60650K .......... .......... .......... .......... .......... 36% 1.70M 1m51s 2020-11-20T12:16:48.520 INFO:tasks.workunit.client.0.smithi093.stderr: 60700K .......... .......... .......... .......... .......... 36% 938K 1m50s 2020-11-20T12:16:48.572 INFO:tasks.workunit.client.0.smithi093.stderr: 60750K .......... .......... .......... .......... .......... 36% 1011K 1m50s 2020-11-20T12:16:48.611 INFO:tasks.workunit.client.0.smithi093.stderr: 60800K .......... .......... .......... .......... .......... 36% 1.18M 1m50s 2020-11-20T12:16:48.660 INFO:tasks.workunit.client.0.smithi093.stderr: 60850K .......... .......... .......... .......... .......... 36% 1.01M 1m50s 2020-11-20T12:16:48.705 INFO:tasks.workunit.client.0.smithi093.stderr: 60900K .......... .......... .......... .......... .......... 36% 1.06M 1m50s 2020-11-20T12:16:48.755 INFO:tasks.workunit.client.0.smithi093.stderr: 60950K .......... .......... .......... .......... .......... 36% 1015K 1m50s 2020-11-20T12:16:48.804 INFO:tasks.workunit.client.0.smithi093.stderr: 61000K .......... .......... .......... .......... .......... 36% 1.03M 1m50s 2020-11-20T12:16:48.842 INFO:tasks.workunit.client.0.smithi093.stderr: 61050K .......... .......... .......... .......... .......... 36% 1.21M 1m50s 2020-11-20T12:16:48.895 INFO:tasks.workunit.client.0.smithi093.stderr: 61100K .......... .......... .......... .......... .......... 36% 956K 1m50s 2020-11-20T12:16:48.952 INFO:tasks.workunit.client.0.smithi093.stderr: 61150K .......... .......... .......... .......... .......... 36% 866K 1m50s 2020-11-20T12:16:48.994 INFO:tasks.workunit.client.0.smithi093.stderr: 61200K .......... .......... .......... .......... .......... 36% 1.18M 1m50s 2020-11-20T12:16:49.038 INFO:tasks.workunit.client.0.smithi093.stderr: 61250K .......... .......... .......... .......... .......... 36% 1.11M 1m50s 2020-11-20T12:16:49.088 INFO:tasks.workunit.client.0.smithi093.stderr: 61300K .......... .......... .......... .......... .......... 36% 1.16M 1m50s 2020-11-20T12:16:49.127 INFO:tasks.workunit.client.0.smithi093.stderr: 61350K .......... .......... .......... .......... .......... 36% 1.02M 1m50s 2020-11-20T12:16:49.187 INFO:tasks.workunit.client.0.smithi093.stderr: 61400K .......... .......... .......... .......... .......... 36% 839K 1m50s 2020-11-20T12:16:49.232 INFO:tasks.workunit.client.0.smithi093.stderr: 61450K .......... .......... .......... .......... .......... 36% 1.08M 1m50s 2020-11-20T12:16:49.277 INFO:tasks.workunit.client.0.smithi093.stderr: 61500K .......... .......... .......... .......... .......... 36% 1.07M 1m50s 2020-11-20T12:16:49.321 INFO:tasks.workunit.client.0.smithi093.stderr: 61550K .......... .......... .......... .......... .......... 36% 1.14M 1m50s 2020-11-20T12:16:49.369 INFO:tasks.workunit.client.0.smithi093.stderr: 61600K .......... .......... .......... .......... .......... 36% 1.07M 1m49s 2020-11-20T12:16:49.425 INFO:tasks.workunit.client.0.smithi093.stderr: 61650K .......... .......... .......... .......... .......... 36% 941K 1m49s 2020-11-20T12:16:49.467 INFO:tasks.workunit.client.0.smithi093.stderr: 61700K .......... .......... .......... .......... .......... 36% 1.03M 1m49s 2020-11-20T12:16:49.511 INFO:tasks.workunit.client.0.smithi093.stderr: 61750K .......... .......... .......... .......... .......... 36% 1.24M 1m49s 2020-11-20T12:16:49.574 INFO:tasks.workunit.client.0.smithi093.stderr: 61800K .......... .......... .......... .......... .......... 36% 1.09M 1m49s 2020-11-20T12:16:49.596 INFO:tasks.workunit.client.0.smithi093.stderr: 61850K .......... .......... .......... .......... .......... 36% 1.08M 1m49s 2020-11-20T12:16:49.640 INFO:tasks.workunit.client.0.smithi093.stderr: 61900K .......... .......... .......... .......... .......... 36% 1.16M 1m49s 2020-11-20T12:16:49.692 INFO:tasks.workunit.client.0.smithi093.stderr: 61950K .......... .......... .......... .......... .......... 36% 1.53M 1m49s 2020-11-20T12:16:49.725 INFO:tasks.workunit.client.0.smithi093.stderr: 62000K .......... .......... .......... .......... .......... 36% 937K 1m49s 2020-11-20T12:16:49.769 INFO:tasks.workunit.client.0.smithi093.stderr: 62050K .......... .......... .......... .......... .......... 36% 1.10M 1m49s 2020-11-20T12:16:49.803 INFO:tasks.workunit.client.0.smithi093.stderr: 62100K .......... .......... .......... .......... .......... 36% 1.48M 1m49s 2020-11-20T12:16:49.852 INFO:tasks.workunit.client.0.smithi093.stderr: 62150K .......... .......... .......... .......... .......... 36% 985K 1m49s 2020-11-20T12:16:49.889 INFO:tasks.workunit.client.0.smithi093.stderr: 62200K .......... .......... .......... .......... .......... 36% 1.44M 1m49s 2020-11-20T12:16:49.932 INFO:tasks.workunit.client.0.smithi093.stderr: 62250K .......... .......... .......... .......... .......... 36% 1.05M 1m49s 2020-11-20T12:16:49.976 INFO:tasks.workunit.client.0.smithi093.stderr: 62300K .......... .......... .......... .......... .......... 36% 1.13M 1m49s 2020-11-20T12:16:50.030 INFO:tasks.workunit.client.0.smithi093.stderr: 62350K .......... .......... .......... .......... .......... 37% 922K 1m48s 2020-11-20T12:16:50.070 INFO:tasks.workunit.client.0.smithi093.stderr: 62400K .......... .......... .......... .......... .......... 37% 1.20M 1m48s 2020-11-20T12:16:50.197 INFO:tasks.workunit.client.0.smithi093.stderr: 62450K .......... .......... .......... .......... .......... 37% 396K 1m49s 2020-11-20T12:16:50.198 INFO:tasks.workunit.client.0.smithi093.stderr: 62500K .......... .......... .......... .......... .......... 37% 260M 1m48s 2020-11-20T12:16:50.211 INFO:tasks.workunit.client.0.smithi093.stderr: 62550K .......... .......... .......... .......... .......... 37% 3.30M 1m48s 2020-11-20T12:16:50.272 INFO:tasks.workunit.client.0.smithi093.stderr: 62600K .......... .......... .......... .......... .......... 37% 826K 1m48s 2020-11-20T12:16:50.322 INFO:tasks.workunit.client.0.smithi093.stderr: 62650K .......... .......... .......... .......... .......... 37% 988K 1m48s 2020-11-20T12:16:50.391 INFO:tasks.workunit.client.0.smithi093.stderr: 62700K .......... .......... .......... .......... .......... 37% 729K 1m48s 2020-11-20T12:16:50.441 INFO:tasks.workunit.client.0.smithi093.stderr: 62750K .......... .......... .......... .......... .......... 37% 1003K 1m48s 2020-11-20T12:16:50.498 INFO:tasks.workunit.client.0.smithi093.stderr: 62800K .......... .......... .......... .......... .......... 37% 892K 1m48s 2020-11-20T12:16:50.507 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:50.510 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:50.514 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:16:50.550 INFO:tasks.workunit.client.0.smithi093.stderr: 62850K .......... .......... .......... .......... .......... 37% 950K 1m48s 2020-11-20T12:16:50.611 INFO:tasks.workunit.client.0.smithi093.stderr: 62900K .......... .......... .......... .......... .......... 37% 858K 1m48s 2020-11-20T12:16:50.659 INFO:tasks.workunit.client.0.smithi093.stderr: 62950K .......... .......... .......... .......... .......... 37% 982K 1m48s 2020-11-20T12:16:50.707 INFO:tasks.workunit.client.0.smithi093.stderr: 63000K .......... .......... .......... .......... .......... 37% 1.07M 1m48s 2020-11-20T12:16:50.770 INFO:tasks.workunit.client.0.smithi093.stderr: 63050K .......... .......... .......... .......... .......... 37% 760K 1m48s 2020-11-20T12:16:50.816 INFO:tasks.workunit.client.0.smithi093.stderr: 63100K .......... .......... .......... .......... .......... 37% 1.06M 1m48s 2020-11-20T12:16:50.865 INFO:tasks.workunit.client.0.smithi093.stderr: 63150K .......... .......... .......... .......... .......... 37% 1018K 1m48s 2020-11-20T12:16:51.000 INFO:tasks.workunit.client.0.smithi093.stderr: 63200K .......... .......... .......... .......... .......... 37% 374K 1m48s 2020-11-20T12:16:51.000 INFO:tasks.workunit.client.0.smithi093.stderr: 63250K .......... .......... .......... .......... .......... 37% 517M 1m48s 2020-11-20T12:16:51.043 INFO:tasks.workunit.client.0.smithi093.stderr: 63300K .......... .......... .......... .......... .......... 37% 1.11M 1m48s 2020-11-20T12:16:51.113 INFO:tasks.workunit.client.0.smithi093.stderr: 63350K .......... .......... .......... .......... .......... 37% 869K 1m48s 2020-11-20T12:16:51.169 INFO:tasks.workunit.client.0.smithi093.stderr: 63400K .......... .......... .......... .......... .......... 37% 723K 1m48s 2020-11-20T12:16:51.239 INFO:tasks.workunit.client.0.smithi093.stderr: 63450K .......... .......... .......... .......... .......... 37% 767K 1m48s 2020-11-20T12:16:51.306 INFO:tasks.workunit.client.0.smithi093.stderr: 63500K .......... .......... .......... .......... .......... 37% 706K 1m47s 2020-11-20T12:16:51.370 INFO:tasks.workunit.client.0.smithi093.stderr: 63550K .......... .......... .......... .......... .......... 37% 770K 1m47s 2020-11-20T12:16:51.437 INFO:tasks.workunit.client.0.smithi093.stderr: 63600K .......... .......... .......... .......... .......... 37% 756K 1m47s 2020-11-20T12:16:51.491 INFO:tasks.workunit.client.0.smithi093.stderr: 63650K .......... .......... .......... .......... .......... 37% 921K 1m47s 2020-11-20T12:16:51.556 INFO:tasks.workunit.client.0.smithi093.stderr: 63700K .......... .......... .......... .......... .......... 37% 774K 1m47s 2020-11-20T12:16:51.607 INFO:tasks.workunit.client.0.smithi093.stderr: 63750K .......... .......... .......... .......... .......... 37% 966K 1m47s 2020-11-20T12:16:51.680 INFO:tasks.workunit.client.0.smithi093.stderr: 63800K .......... .......... .......... .......... .......... 37% 688K 1m47s 2020-11-20T12:16:51.755 INFO:tasks.workunit.client.0.smithi093.stderr: 63850K .......... .......... .......... .......... .......... 37% 668K 1m47s 2020-11-20T12:16:51.808 INFO:tasks.workunit.client.0.smithi093.stderr: 63900K .......... .......... .......... .......... .......... 37% 1.03M 1m47s 2020-11-20T12:16:51.867 INFO:tasks.workunit.client.0.smithi093.stderr: 63950K .......... .......... .......... .......... .......... 37% 772K 1m47s 2020-11-20T12:16:51.924 INFO:tasks.workunit.client.0.smithi093.stderr: 64000K .......... .......... .......... .......... .......... 37% 881K 1m47s 2020-11-20T12:16:51.998 INFO:tasks.workunit.client.0.smithi093.stderr: 64050K .......... .......... .......... .......... .......... 38% 674K 1m47s 2020-11-20T12:16:52.060 INFO:tasks.workunit.client.0.smithi093.stderr: 64100K .......... .......... .......... .......... .......... 38% 804K 1m47s 2020-11-20T12:16:52.109 INFO:tasks.workunit.client.0.smithi093.stderr: 64150K .......... .......... .......... .......... .......... 38% 1.12M 1m47s 2020-11-20T12:16:52.164 INFO:tasks.workunit.client.0.smithi093.stderr: 64200K .......... .......... .......... .......... .......... 38% 831K 1m47s 2020-11-20T12:16:52.215 INFO:tasks.workunit.client.0.smithi093.stderr: 64250K .......... .......... .......... .......... .......... 38% 971K 1m47s 2020-11-20T12:16:52.266 INFO:tasks.workunit.client.0.smithi093.stderr: 64300K .......... .......... .......... .......... .......... 38% 981K 1m47s 2020-11-20T12:16:52.337 INFO:tasks.workunit.client.0.smithi093.stderr: 64350K .......... .......... .......... .......... .......... 38% 886K 1m47s 2020-11-20T12:16:52.386 INFO:tasks.workunit.client.0.smithi093.stderr: 64400K .......... .......... .......... .......... .......... 38% 782K 1m47s 2020-11-20T12:16:52.435 INFO:tasks.workunit.client.0.smithi093.stderr: 64450K .......... .......... .......... .......... .......... 38% 1.01M 1m47s 2020-11-20T12:16:52.493 INFO:tasks.workunit.client.0.smithi093.stderr: 64500K .......... .......... .......... .......... .......... 38% 861K 1m47s 2020-11-20T12:16:52.553 INFO:tasks.workunit.client.0.smithi093.stderr: 64550K .......... .......... .......... .......... .......... 38% 833K 1m47s 2020-11-20T12:16:52.612 INFO:tasks.workunit.client.0.smithi093.stderr: 64600K .......... .......... .......... .......... .......... 38% 905K 1m47s 2020-11-20T12:16:52.668 INFO:tasks.workunit.client.0.smithi093.stderr: 64650K .......... .......... .......... .......... .......... 38% 835K 1m47s 2020-11-20T12:16:52.722 INFO:tasks.workunit.client.0.smithi093.stderr: 64700K .......... .......... .......... .......... .......... 38% 1.06M 1m47s 2020-11-20T12:16:52.784 INFO:tasks.workunit.client.0.smithi093.stderr: 64750K .......... .......... .......... .......... .......... 38% 720K 1m47s 2020-11-20T12:16:52.849 INFO:tasks.workunit.client.0.smithi093.stderr: 64800K .......... .......... .......... .......... .......... 38% 1.12M 1m46s 2020-11-20T12:16:52.949 INFO:tasks.workunit.client.0.smithi093.stderr: 64850K .......... .......... .......... .......... .......... 38% 412K 1m47s 2020-11-20T12:16:52.951 INFO:tasks.workunit.client.0.smithi093.stderr: 64900K .......... .......... .......... .......... .......... 38% 21.8M 1m46s 2020-11-20T12:16:53.026 INFO:tasks.workunit.client.0.smithi093.stderr: 64950K .......... .......... .......... .......... .......... 38% 663K 1m46s 2020-11-20T12:16:53.107 INFO:tasks.workunit.client.0.smithi093.stderr: 65000K .......... .......... .......... .......... .......... 38% 618K 1m46s 2020-11-20T12:16:53.185 INFO:tasks.workunit.client.0.smithi093.stderr: 65050K .......... .......... .......... .......... .......... 38% 672K 1m46s 2020-11-20T12:16:53.261 INFO:tasks.workunit.client.0.smithi093.stderr: 65100K .......... .......... .......... .......... .......... 38% 633K 1m46s 2020-11-20T12:16:53.318 INFO:tasks.workunit.client.0.smithi093.stderr: 65150K .......... .......... .......... .......... .......... 38% 865K 1m46s 2020-11-20T12:16:53.390 INFO:tasks.workunit.client.0.smithi093.stderr: 65200K .......... .......... .......... .......... .......... 38% 730K 1m46s 2020-11-20T12:16:53.453 INFO:tasks.workunit.client.0.smithi093.stderr: 65250K .......... .......... .......... .......... .......... 38% 762K 1m46s 2020-11-20T12:16:53.501 INFO:tasks.workunit.client.0.smithi093.stderr: 65300K .......... .......... .......... .......... .......... 38% 1018K 1m46s 2020-11-20T12:16:53.546 INFO:tasks.workunit.client.0.smithi093.stderr: 65350K .......... .......... .......... .......... .......... 38% 1.11M 1m46s 2020-11-20T12:16:53.607 INFO:tasks.workunit.client.0.smithi093.stderr: 65400K .......... .......... .......... .......... .......... 38% 807K 1m46s 2020-11-20T12:16:53.667 INFO:tasks.workunit.client.0.smithi093.stderr: 65450K .......... .......... .......... .......... .......... 38% 843K 1m46s 2020-11-20T12:16:53.736 INFO:tasks.workunit.client.0.smithi093.stderr: 65500K .......... .......... .......... .......... .......... 38% 755K 1m46s 2020-11-20T12:16:53.803 INFO:tasks.workunit.client.0.smithi093.stderr: 65550K .......... .......... .......... .......... .......... 38% 719K 1m46s 2020-11-20T12:16:53.852 INFO:tasks.workunit.client.0.smithi093.stderr: 65600K .......... .......... .......... .......... .......... 38% 1.13M 1m46s 2020-11-20T12:16:53.902 INFO:tasks.workunit.client.0.smithi093.stderr: 65650K .......... .......... .......... .......... .......... 38% 892K 1m46s 2020-11-20T12:16:53.969 INFO:tasks.workunit.client.0.smithi093.stderr: 65700K .......... .......... .......... .......... .......... 39% 745K 1m46s 2020-11-20T12:16:54.035 INFO:tasks.workunit.client.0.smithi093.stderr: 65750K .......... .......... .......... .......... .......... 39% 762K 1m46s 2020-11-20T12:16:54.091 INFO:tasks.workunit.client.0.smithi093.stderr: 65800K .......... .......... .......... .......... .......... 39% 884K 1m46s 2020-11-20T12:16:54.148 INFO:tasks.workunit.client.0.smithi093.stderr: 65850K .......... .......... .......... .......... .......... 39% 886K 1m46s 2020-11-20T12:16:54.210 INFO:tasks.workunit.client.0.smithi093.stderr: 65900K .......... .......... .......... .......... .......... 39% 796K 1m46s 2020-11-20T12:16:54.271 INFO:tasks.workunit.client.0.smithi093.stderr: 65950K .......... .......... .......... .......... .......... 39% 828K 1m46s 2020-11-20T12:16:54.327 INFO:tasks.workunit.client.0.smithi093.stderr: 66000K .......... .......... .......... .......... .......... 39% 888K 1m46s 2020-11-20T12:16:54.388 INFO:tasks.workunit.client.0.smithi093.stderr: 66050K .......... .......... .......... .......... .......... 39% 819K 1m46s 2020-11-20T12:16:54.434 INFO:tasks.workunit.client.0.smithi093.stderr: 66100K .......... .......... .......... .......... .......... 39% 1.06M 1m46s 2020-11-20T12:16:54.495 INFO:tasks.workunit.client.0.smithi093.stderr: 66150K .......... .......... .......... .......... .......... 39% 825K 1m46s 2020-11-20T12:16:54.550 INFO:tasks.workunit.client.0.smithi093.stderr: 66200K .......... .......... .......... .......... .......... 39% 906K 1m45s 2020-11-20T12:16:54.598 INFO:tasks.workunit.client.0.smithi093.stderr: 66250K .......... .......... .......... .......... .......... 39% 1.00M 1m45s 2020-11-20T12:16:54.647 INFO:tasks.workunit.client.0.smithi093.stderr: 66300K .......... .......... .......... .......... .......... 39% 1.01M 1m45s 2020-11-20T12:16:54.712 INFO:tasks.workunit.client.0.smithi093.stderr: 66350K .......... .......... .......... .......... .......... 39% 773K 1m45s 2020-11-20T12:16:54.752 INFO:tasks.workunit.client.0.smithi093.stderr: 66400K .......... .......... .......... .......... .......... 39% 1.25M 1m45s 2020-11-20T12:16:54.798 INFO:tasks.workunit.client.0.smithi093.stderr: 66450K .......... .......... .......... .......... .......... 39% 1.02M 1m45s 2020-11-20T12:16:54.864 INFO:tasks.workunit.client.0.smithi093.stderr: 66500K .......... .......... .......... .......... .......... 39% 811K 1m45s 2020-11-20T12:16:54.929 INFO:tasks.workunit.client.0.smithi093.stderr: 66550K .......... .......... .......... .......... .......... 39% 732K 1m45s 2020-11-20T12:16:54.968 INFO:tasks.workunit.client.0.smithi093.stderr: 66600K .......... .......... .......... .......... .......... 39% 1.23M 1m45s 2020-11-20T12:16:55.018 INFO:tasks.workunit.client.0.smithi093.stderr: 66650K .......... .......... .......... .......... .......... 39% 1004K 1m45s 2020-11-20T12:16:55.082 INFO:tasks.workunit.client.0.smithi093.stderr: 66700K .......... .......... .......... .......... .......... 39% 777K 1m45s 2020-11-20T12:16:55.121 INFO:tasks.workunit.client.0.smithi093.stderr: 66750K .......... .......... .......... .......... .......... 39% 1.26M 1m45s 2020-11-20T12:16:55.185 INFO:tasks.workunit.client.0.smithi093.stderr: 66800K .......... .......... .......... .......... .......... 39% 898K 1m45s 2020-11-20T12:16:55.266 INFO:tasks.workunit.client.0.smithi093.stderr: 66850K .......... .......... .......... .......... .......... 39% 790K 1m45s 2020-11-20T12:16:55.317 INFO:tasks.workunit.client.0.smithi093.stderr: 66900K .......... .......... .......... .......... .......... 39% 653K 1m45s 2020-11-20T12:16:55.343 INFO:tasks.workunit.client.0.smithi093.stderr: 66950K .......... .......... .......... .......... .......... 39% 2.09M 1m45s 2020-11-20T12:16:55.412 INFO:tasks.workunit.client.0.smithi093.stderr: 67000K .......... .......... .......... .......... .......... 39% 700K 1m45s 2020-11-20T12:16:55.531 INFO:tasks.workunit.client.0.smithi093.stderr: 67050K .......... .......... .......... .......... .......... 39% 418K 1m45s 2020-11-20T12:16:55.555 INFO:tasks.workunit.client.0.smithi093.stderr: 67100K .......... .......... .......... .......... .......... 39% 2.05M 1m45s 2020-11-20T12:16:55.628 INFO:tasks.workunit.client.0.smithi093.stderr: 67150K .......... .......... .......... .......... .......... 39% 698K 1m45s 2020-11-20T12:16:55.693 INFO:tasks.workunit.client.0.smithi093.stderr: 67200K .......... .......... .......... .......... .......... 39% 754K 1m45s 2020-11-20T12:16:55.729 INFO:tasks.workunit.client.0.smithi093.stderr: 67250K .......... .......... .......... .......... .......... 39% 1.35M 1m45s 2020-11-20T12:16:55.790 INFO:tasks.workunit.client.0.smithi093.stderr: 67300K .......... .......... .......... .......... .......... 39% 975K 1m44s 2020-11-20T12:16:55.836 INFO:tasks.workunit.client.0.smithi093.stderr: 67350K .......... .......... .......... .......... .......... 39% 889K 1m44s 2020-11-20T12:16:55.901 INFO:tasks.workunit.client.0.smithi093.stderr: 67400K .......... .......... .......... .......... .......... 40% 767K 1m44s 2020-11-20T12:16:55.963 INFO:tasks.workunit.client.0.smithi093.stderr: 67450K .......... .......... .......... .......... .......... 40% 808K 1m44s 2020-11-20T12:16:56.028 INFO:tasks.workunit.client.0.smithi093.stderr: 67500K .......... .......... .......... .......... .......... 40% 771K 1m44s 2020-11-20T12:16:56.084 INFO:tasks.workunit.client.0.smithi093.stderr: 67550K .......... .......... .......... .......... .......... 40% 908K 1m44s 2020-11-20T12:16:56.145 INFO:tasks.workunit.client.0.smithi093.stderr: 67600K .......... .......... .......... .......... .......... 40% 809K 1m44s 2020-11-20T12:16:56.186 INFO:tasks.workunit.client.0.smithi093.stderr: 67650K .......... .......... .......... .......... .......... 40% 1.18M 1m44s 2020-11-20T12:16:56.241 INFO:tasks.workunit.client.0.smithi093.stderr: 67700K .......... .......... .......... .......... .......... 40% 913K 1m44s 2020-11-20T12:16:56.306 INFO:tasks.workunit.client.0.smithi093.stderr: 67750K .......... .......... .......... .......... .......... 40% 776K 1m44s 2020-11-20T12:16:56.364 INFO:tasks.workunit.client.0.smithi093.stderr: 67800K .......... .......... .......... .......... .......... 40% 858K 1m44s 2020-11-20T12:16:56.433 INFO:tasks.workunit.client.0.smithi093.stderr: 67850K .......... .......... .......... .......... .......... 40% 725K 1m44s 2020-11-20T12:16:56.468 INFO:tasks.workunit.client.0.smithi093.stderr: 67900K .......... .......... .......... .......... .......... 40% 1.39M 1m44s 2020-11-20T12:16:56.528 INFO:tasks.workunit.client.0.smithi093.stderr: 67950K .......... .......... .......... .......... .......... 40% 827K 1m44s 2020-11-20T12:16:56.596 INFO:tasks.workunit.client.0.smithi093.stderr: 68000K .......... .......... .......... .......... .......... 40% 738K 1m44s 2020-11-20T12:16:56.661 INFO:tasks.workunit.client.0.smithi093.stderr: 68050K .......... .......... .......... .......... .......... 40% 775K 1m44s 2020-11-20T12:16:56.708 INFO:tasks.workunit.client.0.smithi093.stderr: 68100K .......... .......... .......... .......... .......... 40% 1.04M 1m44s 2020-11-20T12:16:56.759 INFO:tasks.workunit.client.0.smithi093.stderr: 68150K .......... .......... .......... .......... .......... 40% 981K 1m44s 2020-11-20T12:16:56.830 INFO:tasks.workunit.client.0.smithi093.stderr: 68200K .......... .......... .......... .......... .......... 40% 711K 1m44s 2020-11-20T12:16:56.893 INFO:tasks.workunit.client.0.smithi093.stderr: 68250K .......... .......... .......... .......... .......... 40% 781K 1m44s 2020-11-20T12:16:56.944 INFO:tasks.workunit.client.0.smithi093.stderr: 68300K .......... .......... .......... .......... .......... 40% 1012K 1m44s 2020-11-20T12:16:56.996 INFO:tasks.workunit.client.0.smithi093.stderr: 68350K .......... .......... .......... .......... .......... 40% 931K 1m44s 2020-11-20T12:16:57.066 INFO:tasks.workunit.client.0.smithi093.stderr: 68400K .......... .......... .......... .......... .......... 40% 744K 1m44s 2020-11-20T12:16:57.128 INFO:tasks.workunit.client.0.smithi093.stderr: 68450K .......... .......... .......... .......... .......... 40% 780K 1m44s 2020-11-20T12:16:57.159 INFO:tasks.workunit.client.0.smithi093.stderr: 68500K .......... .......... .......... .......... .......... 40% 1.59M 1m43s 2020-11-20T12:16:57.224 INFO:tasks.workunit.client.0.smithi093.stderr: 68550K .......... .......... .......... .......... .......... 40% 808K 1m43s 2020-11-20T12:16:57.279 INFO:tasks.workunit.client.0.smithi093.stderr: 68600K .......... .......... .......... .......... .......... 40% 846K 1m43s 2020-11-20T12:16:57.325 INFO:tasks.workunit.client.0.smithi093.stderr: 68650K .......... .......... .......... .......... .......... 40% 1.07M 1m43s 2020-11-20T12:16:57.372 INFO:tasks.workunit.client.0.smithi093.stderr: 68700K .......... .......... .......... .......... .......... 40% 1.06M 1m43s 2020-11-20T12:16:57.435 INFO:tasks.workunit.client.0.smithi093.stderr: 68750K .......... .......... .......... .......... .......... 40% 849K 1m43s 2020-11-20T12:16:57.487 INFO:tasks.workunit.client.0.smithi093.stderr: 68800K .......... .......... .......... .......... .......... 40% 877K 1m43s 2020-11-20T12:16:57.513 INFO:tasks.workunit.client.0.smithi093.stderr: 68850K .......... .......... .......... .......... .......... 40% 1.98M 1m43s 2020-11-20T12:16:57.580 INFO:tasks.workunit.client.0.smithi093.stderr: 68900K .......... .......... .......... .......... .......... 40% 725K 1m43s 2020-11-20T12:16:57.636 INFO:tasks.workunit.client.0.smithi093.stderr: 68950K .......... .......... .......... .......... .......... 40% 900K 1m43s 2020-11-20T12:16:57.687 INFO:tasks.workunit.client.0.smithi093.stderr: 69000K .......... .......... .......... .......... .......... 40% 983K 1m43s 2020-11-20T12:16:57.729 INFO:tasks.workunit.client.0.smithi093.stderr: 69050K .......... .......... .......... .......... .......... 40% 1.15M 1m43s 2020-11-20T12:16:57.796 INFO:tasks.workunit.client.0.smithi093.stderr: 69100K .......... .......... .......... .......... .......... 41% 754K 1m43s 2020-11-20T12:16:57.837 INFO:tasks.workunit.client.0.smithi093.stderr: 69150K .......... .......... .......... .......... .......... 41% 1.17M 1m43s 2020-11-20T12:16:57.888 INFO:tasks.workunit.client.0.smithi093.stderr: 69200K .......... .......... .......... .......... .......... 41% 1.04M 1m43s 2020-11-20T12:16:57.952 INFO:tasks.workunit.client.0.smithi093.stderr: 69250K .......... .......... .......... .......... .......... 41% 737K 1m43s 2020-11-20T12:16:58.015 INFO:tasks.workunit.client.0.smithi093.stderr: 69300K .......... .......... .......... .......... .......... 41% 1.13M 1m43s 2020-11-20T12:16:58.046 INFO:tasks.workunit.client.0.smithi093.stderr: 69350K .......... .......... .......... .......... .......... 41% 993K 1m43s 2020-11-20T12:16:58.110 INFO:tasks.workunit.client.0.smithi093.stderr: 69400K .......... .......... .......... .......... .......... 41% 781K 1m43s 2020-11-20T12:16:58.259 INFO:tasks.workunit.client.0.smithi093.stderr: 69450K .......... .......... .......... .......... .......... 41% 773K 1m43s 2020-11-20T12:16:58.262 INFO:tasks.workunit.client.0.smithi093.stderr: 69500K .......... .......... .......... .......... .......... 41% 577K 1m43s 2020-11-20T12:16:58.283 INFO:tasks.workunit.client.0.smithi093.stderr: 69550K .......... .......... .......... .......... .......... 41% 2.75M 1m42s 2020-11-20T12:16:58.353 INFO:tasks.workunit.client.0.smithi093.stderr: 69600K .......... .......... .......... .......... .......... 41% 676K 1m42s 2020-11-20T12:16:58.421 INFO:tasks.workunit.client.0.smithi093.stderr: 69650K .......... .......... .......... .......... .......... 41% 737K 1m42s 2020-11-20T12:16:58.486 INFO:tasks.workunit.client.0.smithi093.stderr: 69700K .......... .......... .......... .......... .......... 41% 779K 1m42s 2020-11-20T12:16:58.547 INFO:tasks.workunit.client.0.smithi093.stderr: 69750K .......... .......... .......... .......... .......... 41% 828K 1m42s 2020-11-20T12:16:58.597 INFO:tasks.workunit.client.0.smithi093.stderr: 69800K .......... .......... .......... .......... .......... 41% 957K 1m42s 2020-11-20T12:16:58.643 INFO:tasks.workunit.client.0.smithi093.stderr: 69850K .......... .......... .......... .......... .......... 41% 1.07M 1m42s 2020-11-20T12:16:58.711 INFO:tasks.workunit.client.0.smithi093.stderr: 69900K .......... .......... .......... .......... .......... 41% 774K 1m42s 2020-11-20T12:16:58.762 INFO:tasks.workunit.client.0.smithi093.stderr: 69950K .......... .......... .......... .......... .......... 41% 925K 1m42s 2020-11-20T12:16:58.823 INFO:tasks.workunit.client.0.smithi093.stderr: 70000K .......... .......... .......... .......... .......... 41% 903K 1m42s 2020-11-20T12:16:58.881 INFO:tasks.workunit.client.0.smithi093.stderr: 70050K .......... .......... .......... .......... .......... 41% 776K 1m42s 2020-11-20T12:16:58.926 INFO:tasks.workunit.client.0.smithi093.stderr: 70100K .......... .......... .......... .......... .......... 41% 1.10M 1m42s 2020-11-20T12:16:58.987 INFO:tasks.workunit.client.0.smithi093.stderr: 70150K .......... .......... .......... .......... .......... 41% 817K 1m42s 2020-11-20T12:16:59.037 INFO:tasks.workunit.client.0.smithi093.stderr: 70200K .......... .......... .......... .......... .......... 41% 1.01M 1m42s 2020-11-20T12:16:59.096 INFO:tasks.workunit.client.0.smithi093.stderr: 70250K .......... .......... .......... .......... .......... 41% 825K 1m42s 2020-11-20T12:16:59.160 INFO:tasks.workunit.client.0.smithi093.stderr: 70300K .......... .......... .......... .......... .......... 41% 777K 1m42s 2020-11-20T12:16:59.216 INFO:tasks.workunit.client.0.smithi093.stderr: 70350K .......... .......... .......... .......... .......... 41% 1.00M 1m42s 2020-11-20T12:16:59.265 INFO:tasks.workunit.client.0.smithi093.stderr: 70400K .......... .......... .......... .......... .......... 41% 887K 1m42s 2020-11-20T12:16:59.324 INFO:tasks.workunit.client.0.smithi093.stderr: 70450K .......... .......... .......... .......... .......... 41% 936K 1m42s 2020-11-20T12:16:59.370 INFO:tasks.workunit.client.0.smithi093.stderr: 70500K .......... .......... .......... .......... .......... 41% 978K 1m42s 2020-11-20T12:16:59.440 INFO:tasks.workunit.client.0.smithi093.stderr: 70550K .......... .......... .......... .......... .......... 41% 917K 1m42s 2020-11-20T12:16:59.491 INFO:tasks.workunit.client.0.smithi093.stderr: 70600K .......... .......... .......... .......... .......... 41% 747K 1m41s 2020-11-20T12:16:59.554 INFO:tasks.workunit.client.0.smithi093.stderr: 70650K .......... .......... .......... .......... .......... 41% 798K 1m41s 2020-11-20T12:16:59.603 INFO:tasks.workunit.client.0.smithi093.stderr: 70700K .......... .......... .......... .......... .......... 41% 1021K 1m41s 2020-11-20T12:16:59.664 INFO:tasks.workunit.client.0.smithi093.stderr: 70750K .......... .......... .......... .......... .......... 42% 831K 1m41s 2020-11-20T12:16:59.718 INFO:tasks.workunit.client.0.smithi093.stderr: 70800K .......... .......... .......... .......... .......... 42% 1.00M 1m41s 2020-11-20T12:16:59.761 INFO:tasks.workunit.client.0.smithi093.stderr: 70850K .......... .......... .......... .......... .......... 42% 1018K 1m41s 2020-11-20T12:16:59.822 INFO:tasks.workunit.client.0.smithi093.stderr: 70900K .......... .......... .......... .......... .......... 42% 826K 1m41s 2020-11-20T12:16:59.874 INFO:tasks.workunit.client.0.smithi093.stderr: 70950K .......... .......... .......... .......... .......... 42% 949K 1m41s 2020-11-20T12:16:59.942 INFO:tasks.workunit.client.0.smithi093.stderr: 71000K .......... .......... .......... .......... .......... 42% 775K 1m41s 2020-11-20T12:16:59.984 INFO:tasks.workunit.client.0.smithi093.stderr: 71050K .......... .......... .......... .......... .......... 42% 1.07M 1m41s 2020-11-20T12:17:00.040 INFO:tasks.workunit.client.0.smithi093.stderr: 71100K .......... .......... .......... .......... .......... 42% 888K 1m41s 2020-11-20T12:17:00.101 INFO:tasks.workunit.client.0.smithi093.stderr: 71150K .......... .......... .......... .......... .......... 42% 822K 1m41s 2020-11-20T12:17:00.144 INFO:tasks.workunit.client.0.smithi093.stderr: 71200K .......... .......... .......... .......... .......... 42% 1.16M 1m41s 2020-11-20T12:17:00.198 INFO:tasks.workunit.client.0.smithi093.stderr: 71250K .......... .......... .......... .......... .......... 42% 923K 1m41s 2020-11-20T12:17:00.262 INFO:tasks.workunit.client.0.smithi093.stderr: 71300K .......... .......... .......... .......... .......... 42% 781K 1m41s 2020-11-20T12:17:00.304 INFO:tasks.workunit.client.0.smithi093.stderr: 71350K .......... .......... .......... .......... .......... 42% 1.17M 1m41s 2020-11-20T12:17:00.360 INFO:tasks.workunit.client.0.smithi093.stderr: 71400K .......... .......... .......... .......... .......... 42% 884K 1m41s 2020-11-20T12:17:00.418 INFO:tasks.workunit.client.0.smithi093.stderr: 71450K .......... .......... .......... .......... .......... 42% 863K 1m41s 2020-11-20T12:17:00.465 INFO:tasks.workunit.client.0.smithi093.stderr: 71500K .......... .......... .......... .......... .......... 42% 1.04M 1m41s 2020-11-20T12:17:00.516 INFO:tasks.workunit.client.0.smithi093.stderr: 71550K .......... .......... .......... .......... .......... 42% 967K 1m41s 2020-11-20T12:17:00.574 INFO:tasks.workunit.client.0.smithi093.stderr: 71600K .......... .......... .......... .......... .......... 42% 870K 1m41s 2020-11-20T12:17:00.620 INFO:tasks.workunit.client.0.smithi093.stderr: 71650K .......... .......... .......... .......... .......... 42% 1.06M 1m40s 2020-11-20T12:17:00.667 INFO:tasks.workunit.client.0.smithi093.stderr: 71700K .......... .......... .......... .......... .......... 42% 1.12M 1m40s 2020-11-20T12:17:00.719 INFO:tasks.workunit.client.0.smithi093.stderr: 71750K .......... .......... .......... .......... .......... 42% 892K 1m40s 2020-11-20T12:17:00.769 INFO:tasks.workunit.client.0.smithi093.stderr: 71800K .......... .......... .......... .......... .......... 42% 1018K 1m40s 2020-11-20T12:17:00.806 INFO:tasks.workunit.client.0.smithi093.stderr: 71850K .......... .......... .......... .......... .......... 42% 1.31M 1m40s 2020-11-20T12:17:00.865 INFO:tasks.workunit.client.0.smithi093.stderr: 71900K .......... .......... .......... .......... .......... 42% 897K 1m40s 2020-11-20T12:17:00.912 INFO:tasks.workunit.client.0.smithi093.stderr: 71950K .......... .......... .......... .......... .......... 42% 991K 1m40s 2020-11-20T12:17:00.952 INFO:tasks.workunit.client.0.smithi093.stderr: 72000K .......... .......... .......... .......... .......... 42% 1.22M 1m40s 2020-11-20T12:17:01.008 INFO:tasks.workunit.client.0.smithi093.stderr: 72050K .......... .......... .......... .......... .......... 42% 885K 1m40s 2020-11-20T12:17:01.041 INFO:tasks.workunit.client.0.smithi093.stderr: 72100K .......... .......... .......... .......... .......... 42% 1.50M 1m40s 2020-11-20T12:17:01.099 INFO:tasks.workunit.client.0.smithi093.stderr: 72150K .......... .......... .......... .......... .......... 42% 919K 1m40s 2020-11-20T12:17:01.140 INFO:tasks.workunit.client.0.smithi093.stderr: 72200K .......... .......... .......... .......... .......... 42% 1.09M 1m40s 2020-11-20T12:17:01.190 INFO:tasks.workunit.client.0.smithi093.stderr: 72250K .......... .......... .......... .......... .......... 42% 1.02M 1m40s 2020-11-20T12:17:01.255 INFO:tasks.workunit.client.0.smithi093.stderr: 72300K .......... .......... .......... .......... .......... 42% 747K 1m40s 2020-11-20T12:17:01.297 INFO:tasks.workunit.client.0.smithi093.stderr: 72350K .......... .......... .......... .......... .......... 42% 1.20M 1m40s 2020-11-20T12:17:01.344 INFO:tasks.workunit.client.0.smithi093.stderr: 72400K .......... .......... .......... .......... .......... 42% 1.02M 1m40s 2020-11-20T12:17:01.401 INFO:tasks.workunit.client.0.smithi093.stderr: 72450K .......... .......... .......... .......... .......... 43% 865K 1m40s 2020-11-20T12:17:01.433 INFO:tasks.workunit.client.0.smithi093.stderr: 72500K .......... .......... .......... .......... .......... 43% 1.54M 99s 2020-11-20T12:17:01.490 INFO:tasks.workunit.client.0.smithi093.stderr: 72550K .......... .......... .......... .......... .......... 43% 871K 99s 2020-11-20T12:17:01.533 INFO:tasks.workunit.client.0.smithi093.stderr: 72600K .......... .......... .......... .......... .......... 43% 1.16M 99s 2020-11-20T12:17:01.578 INFO:tasks.workunit.client.0.smithi093.stderr: 72650K .......... .......... .......... .......... .......... 43% 1.06M 99s 2020-11-20T12:17:01.633 INFO:tasks.workunit.client.0.smithi093.stderr: 72700K .......... .......... .......... .......... .......... 43% 910K 99s 2020-11-20T12:17:01.664 INFO:tasks.workunit.client.0.smithi093.stderr: 72750K .......... .......... .......... .......... .......... 43% 1.56M 99s 2020-11-20T12:17:01.723 INFO:tasks.workunit.client.0.smithi093.stderr: 72800K .......... .......... .......... .......... .......... 43% 849K 99s 2020-11-20T12:17:01.765 INFO:tasks.workunit.client.0.smithi093.stderr: 72850K .......... .......... .......... .......... .......... 43% 1.18M 99s 2020-11-20T12:17:01.811 INFO:tasks.workunit.client.0.smithi093.stderr: 72900K .......... .......... .......... .......... .......... 43% 1.05M 99s 2020-11-20T12:17:01.868 INFO:tasks.workunit.client.0.smithi093.stderr: 72950K .......... .......... .......... .......... .......... 43% 887K 99s 2020-11-20T12:17:01.894 INFO:tasks.workunit.client.0.smithi093.stderr: 73000K .......... .......... .......... .......... .......... 43% 1.84M 99s 2020-11-20T12:17:01.950 INFO:tasks.workunit.client.0.smithi093.stderr: 73050K .......... .......... .......... .......... .......... 43% 899K 99s 2020-11-20T12:17:01.992 INFO:tasks.workunit.client.0.smithi093.stderr: 73100K .......... .......... .......... .......... .......... 43% 1.15M 99s 2020-11-20T12:17:02.045 INFO:tasks.workunit.client.0.smithi093.stderr: 73150K .......... .......... .......... .......... .......... 43% 1.04M 99s 2020-11-20T12:17:02.144 INFO:tasks.workunit.client.0.smithi093.stderr: 73200K .......... .......... .......... .......... .......... 43% 480K 99s 2020-11-20T12:17:02.144 INFO:tasks.workunit.client.0.smithi093.stderr: 73250K .......... .......... .......... .......... .......... 43% 348M 99s 2020-11-20T12:17:02.191 INFO:tasks.workunit.client.0.smithi093.stderr: 73300K .......... .......... .......... .......... .......... 43% 1.06M 99s 2020-11-20T12:17:02.254 INFO:tasks.workunit.client.0.smithi093.stderr: 73350K .......... .......... .......... .......... .......... 43% 791K 99s 2020-11-20T12:17:02.313 INFO:tasks.workunit.client.0.smithi093.stderr: 73400K .......... .......... .......... .......... .......... 43% 835K 98s 2020-11-20T12:17:02.355 INFO:tasks.workunit.client.0.smithi093.stderr: 73450K .......... .......... .......... .......... .......... 43% 1.18M 98s 2020-11-20T12:17:02.406 INFO:tasks.workunit.client.0.smithi093.stderr: 73500K .......... .......... .......... .......... .......... 43% 1.07M 98s 2020-11-20T12:17:02.455 INFO:tasks.workunit.client.0.smithi093.stderr: 73550K .......... .......... .......... .......... .......... 43% 898K 98s 2020-11-20T12:17:02.616 INFO:tasks.workunit.client.0.smithi093.stderr: 73600K .......... .......... .......... .......... .......... 43% 318K 98s 2020-11-20T12:17:02.617 INFO:tasks.workunit.client.0.smithi093.stderr: 73650K .......... .......... .......... .......... .......... 43% 16.1M 98s 2020-11-20T12:17:02.737 INFO:tasks.workunit.client.0.smithi093.stderr: 73700K .......... .......... .......... .......... .......... 43% 413K 98s 2020-11-20T12:17:02.771 INFO:tasks.workunit.client.0.smithi093.stderr: 73750K .......... .......... .......... .......... .......... 43% 1.58M 98s 2020-11-20T12:17:02.864 INFO:tasks.workunit.client.0.smithi093.stderr: 73800K .......... .......... .......... .......... .......... 43% 518K 98s 2020-11-20T12:17:02.978 INFO:tasks.workunit.client.0.smithi093.stderr: 73850K .......... .......... .......... .......... .......... 43% 438K 98s 2020-11-20T12:17:03.083 INFO:tasks.workunit.client.0.smithi093.stderr: 73900K .......... .......... .......... .......... .......... 43% 476K 98s 2020-11-20T12:17:03.283 INFO:tasks.workunit.client.0.smithi093.stderr: 73950K .......... .......... .......... .......... .......... 43% 251K 98s 2020-11-20T12:17:03.350 INFO:tasks.workunit.client.0.smithi093.stderr: 74000K .......... .......... .......... .......... .......... 43% 747K 98s 2020-11-20T12:17:03.479 INFO:tasks.workunit.client.0.smithi093.stderr: 74050K .......... .......... .......... .......... .......... 43% 461K 98s 2020-11-20T12:17:03.569 INFO:tasks.workunit.client.0.smithi093.stderr: 74100K .......... .......... .......... .......... .......... 43% 449K 98s 2020-11-20T12:17:03.685 INFO:tasks.workunit.client.0.smithi093.stderr: 74150K .......... .......... .......... .......... .......... 44% 438K 98s 2020-11-20T12:17:03.780 INFO:tasks.workunit.client.0.smithi093.stderr: 74200K .......... .......... .......... .......... .......... 44% 521K 98s 2020-11-20T12:17:03.860 INFO:tasks.workunit.client.0.smithi093.stderr: 74250K .......... .......... .......... .......... .......... 44% 620K 98s 2020-11-20T12:17:03.938 INFO:tasks.workunit.client.0.smithi093.stderr: 74300K .......... .......... .......... .......... .......... 44% 641K 98s 2020-11-20T12:17:04.029 INFO:tasks.workunit.client.0.smithi093.stderr: 74350K .......... .......... .......... .......... .......... 44% 551K 98s 2020-11-20T12:17:04.095 INFO:tasks.workunit.client.0.smithi093.stderr: 74400K .......... .......... .......... .......... .......... 44% 758K 98s 2020-11-20T12:17:04.173 INFO:tasks.workunit.client.0.smithi093.stderr: 74450K .......... .......... .......... .......... .......... 44% 648K 98s 2020-11-20T12:17:04.263 INFO:tasks.workunit.client.0.smithi093.stderr: 74500K .......... .......... .......... .......... .......... 44% 556K 98s 2020-11-20T12:17:04.329 INFO:tasks.workunit.client.0.smithi093.stderr: 74550K .......... .......... .......... .......... .......... 44% 742K 98s 2020-11-20T12:17:04.433 INFO:tasks.workunit.client.0.smithi093.stderr: 74600K .......... .......... .......... .......... .......... 44% 712K 98s 2020-11-20T12:17:04.506 INFO:tasks.workunit.client.0.smithi093.stderr: 74650K .......... .......... .......... .......... .......... 44% 469K 98s 2020-11-20T12:17:04.576 INFO:tasks.workunit.client.0.smithi093.stderr: 74700K .......... .......... .......... .......... .......... 44% 717K 98s 2020-11-20T12:17:04.648 INFO:tasks.workunit.client.0.smithi093.stderr: 74750K .......... .......... .......... .......... .......... 44% 694K 98s 2020-11-20T12:17:04.756 INFO:tasks.workunit.client.0.smithi093.stderr: 74800K .......... .......... .......... .......... .......... 44% 692K 98s 2020-11-20T12:17:04.822 INFO:tasks.workunit.client.0.smithi093.stderr: 74850K .......... .......... .......... .......... .......... 44% 491K 98s 2020-11-20T12:17:04.905 INFO:tasks.workunit.client.0.smithi093.stderr: 74900K .......... .......... .......... .......... .......... 44% 608K 98s 2020-11-20T12:17:04.984 INFO:tasks.workunit.client.0.smithi093.stderr: 74950K .......... .......... .......... .......... .......... 44% 631K 98s 2020-11-20T12:17:05.059 INFO:tasks.workunit.client.0.smithi093.stderr: 75000K .......... .......... .......... .......... .......... 44% 667K 98s 2020-11-20T12:17:05.133 INFO:tasks.workunit.client.0.smithi093.stderr: 75050K .......... .......... .......... .......... .......... 44% 677K 98s 2020-11-20T12:17:05.202 INFO:tasks.workunit.client.0.smithi093.stderr: 75100K .......... .......... .......... .......... .......... 44% 725K 98s 2020-11-20T12:17:05.274 INFO:tasks.workunit.client.0.smithi093.stderr: 75150K .......... .......... .......... .......... .......... 44% 721K 98s 2020-11-20T12:17:05.346 INFO:tasks.workunit.client.0.smithi093.stderr: 75200K .......... .......... .......... .......... .......... 44% 660K 98s 2020-11-20T12:17:05.423 INFO:tasks.workunit.client.0.smithi093.stderr: 75250K .......... .......... .......... .......... .......... 44% 655K 98s 2020-11-20T12:17:05.499 INFO:tasks.workunit.client.0.smithi093.stderr: 75300K .......... .......... .......... .......... .......... 44% 656K 98s 2020-11-20T12:17:05.576 INFO:tasks.workunit.client.0.smithi093.stderr: 75350K .......... .......... .......... .......... .......... 44% 654K 98s 2020-11-20T12:17:05.652 INFO:tasks.workunit.client.0.smithi093.stderr: 75400K .......... .......... .......... .......... .......... 44% 658K 98s 2020-11-20T12:17:05.729 INFO:tasks.workunit.client.0.smithi093.stderr: 75450K .......... .......... .......... .......... .......... 44% 649K 98s 2020-11-20T12:17:05.802 INFO:tasks.workunit.client.0.smithi093.stderr: 75500K .......... .......... .......... .......... .......... 44% 722K 98s 2020-11-20T12:17:05.874 INFO:tasks.workunit.client.0.smithi093.stderr: 75550K .......... .......... .......... .......... .......... 44% 656K 98s 2020-11-20T12:17:05.952 INFO:tasks.workunit.client.0.smithi093.stderr: 75600K .......... .......... .......... .......... .......... 44% 639K 98s 2020-11-20T12:17:06.095 INFO:tasks.workunit.client.0.smithi093.stderr: 75650K .......... .......... .......... .......... .......... 44% 352K 98s 2020-11-20T12:17:06.120 INFO:tasks.workunit.client.0.smithi093.stderr: 75700K .......... .......... .......... .......... .......... 44% 1.89M 98s 2020-11-20T12:17:06.235 INFO:tasks.workunit.client.0.smithi093.stderr: 75750K .......... .......... .......... .......... .......... 44% 439K 98s 2020-11-20T12:17:06.323 INFO:tasks.workunit.client.0.smithi093.stderr: 75800K .......... .......... .......... .......... .......... 44% 560K 98s 2020-11-20T12:17:06.418 INFO:tasks.workunit.client.0.smithi093.stderr: 75850K .......... .......... .......... .......... .......... 45% 531K 98s 2020-11-20T12:17:06.492 INFO:tasks.workunit.client.0.smithi093.stderr: 75900K .......... .......... .......... .......... .......... 45% 670K 98s 2020-11-20T12:17:06.600 INFO:tasks.workunit.client.0.smithi093.stderr: 75950K .......... .......... .......... .......... .......... 45% 466K 98s 2020-11-20T12:17:06.676 INFO:tasks.workunit.client.0.smithi093.stderr: 76000K .......... .......... .......... .......... .......... 45% 650K 98s 2020-11-20T12:17:06.755 INFO:tasks.workunit.client.0.smithi093.stderr: 76050K .......... .......... .......... .......... .......... 45% 638K 98s 2020-11-20T12:17:06.847 INFO:tasks.workunit.client.0.smithi093.stderr: 76100K .......... .......... .......... .......... .......... 45% 541K 98s 2020-11-20T12:17:06.927 INFO:tasks.workunit.client.0.smithi093.stderr: 76150K .......... .......... .......... .......... .......... 45% 624K 98s 2020-11-20T12:17:07.094 INFO:tasks.workunit.client.0.smithi093.stderr: 76200K .......... .......... .......... .......... .......... 45% 300K 98s 2020-11-20T12:17:07.101 INFO:tasks.workunit.client.0.smithi093.stderr: 76250K .......... .......... .......... .......... .......... 45% 6.97M 98s 2020-11-20T12:17:07.211 INFO:tasks.workunit.client.0.smithi093.stderr: 76300K .......... .......... .......... .......... .......... 45% 457K 98s 2020-11-20T12:17:07.304 INFO:tasks.workunit.client.0.smithi093.stderr: 76350K .......... .......... .......... .......... .......... 45% 540K 98s 2020-11-20T12:17:07.398 INFO:tasks.workunit.client.0.smithi093.stderr: 76400K .......... .......... .......... .......... .......... 45% 535K 98s 2020-11-20T12:17:07.493 INFO:tasks.workunit.client.0.smithi093.stderr: 76450K .......... .......... .......... .......... .......... 45% 520K 98s 2020-11-20T12:17:07.591 INFO:tasks.workunit.client.0.smithi093.stderr: 76500K .......... .......... .......... .......... .......... 45% 509K 98s 2020-11-20T12:17:07.683 INFO:tasks.workunit.client.0.smithi093.stderr: 76550K .......... .......... .......... .......... .......... 45% 542K 98s 2020-11-20T12:17:07.791 INFO:tasks.workunit.client.0.smithi093.stderr: 76600K .......... .......... .......... .......... .......... 45% 466K 98s 2020-11-20T12:17:07.889 INFO:tasks.workunit.client.0.smithi093.stderr: 76650K .......... .......... .......... .......... .......... 45% 507K 98s 2020-11-20T12:17:07.972 INFO:tasks.workunit.client.0.smithi093.stderr: 76700K .......... .......... .......... .......... .......... 45% 599K 98s 2020-11-20T12:17:08.072 INFO:tasks.workunit.client.0.smithi093.stderr: 76750K .......... .......... .......... .......... .......... 45% 605K 98s 2020-11-20T12:17:08.219 INFO:tasks.workunit.client.0.smithi093.stderr: 76800K .......... .......... .......... .......... .......... 45% 310K 98s 2020-11-20T12:17:08.306 INFO:tasks.workunit.client.0.smithi093.stderr: 76850K .......... .......... .......... .......... .......... 45% 558K 98s 2020-11-20T12:17:08.415 INFO:tasks.workunit.client.0.smithi093.stderr: 76900K .......... .......... .......... .......... .......... 45% 458K 98s 2020-11-20T12:17:08.515 INFO:tasks.workunit.client.0.smithi093.stderr: 76950K .......... .......... .......... .......... .......... 45% 505K 98s 2020-11-20T12:17:08.606 INFO:tasks.workunit.client.0.smithi093.stderr: 77000K .......... .......... .......... .......... .......... 45% 544K 98s 2020-11-20T12:17:08.707 INFO:tasks.workunit.client.0.smithi093.stderr: 77050K .......... .......... .......... .......... .......... 45% 512K 98s 2020-11-20T12:17:08.810 INFO:tasks.workunit.client.0.smithi093.stderr: 77100K .......... .......... .......... .......... .......... 45% 477K 98s 2020-11-20T12:17:08.894 INFO:tasks.workunit.client.0.smithi093.stderr: 77150K .......... .......... .......... .......... .......... 45% 611K 98s 2020-11-20T12:17:08.982 INFO:tasks.workunit.client.0.smithi093.stderr: 77200K .......... .......... .......... .......... .......... 45% 552K 98s 2020-11-20T12:17:09.086 INFO:tasks.workunit.client.0.smithi093.stderr: 77250K .......... .......... .......... .......... .......... 45% 478K 98s 2020-11-20T12:17:09.181 INFO:tasks.workunit.client.0.smithi093.stderr: 77300K .......... .......... .......... .......... .......... 45% 536K 98s 2020-11-20T12:17:09.278 INFO:tasks.workunit.client.0.smithi093.stderr: 77350K .......... .......... .......... .......... .......... 45% 504K 98s 2020-11-20T12:17:09.360 INFO:tasks.workunit.client.0.smithi093.stderr: 77400K .......... .......... .......... .......... .......... 45% 608K 98s 2020-11-20T12:17:09.470 INFO:tasks.workunit.client.0.smithi093.stderr: 77450K .......... .......... .......... .......... .......... 45% 458K 98s 2020-11-20T12:17:09.554 INFO:tasks.workunit.client.0.smithi093.stderr: 77500K .......... .......... .......... .......... .......... 46% 593K 98s 2020-11-20T12:17:09.653 INFO:tasks.workunit.client.0.smithi093.stderr: 77550K .......... .......... .......... .......... .......... 46% 529K 98s 2020-11-20T12:17:09.811 INFO:tasks.workunit.client.0.smithi093.stderr: 77600K .......... .......... .......... .......... .......... 46% 309K 98s 2020-11-20T12:17:09.867 INFO:tasks.workunit.client.0.smithi093.stderr: 77650K .......... .......... .......... .......... .......... 46% 886K 98s 2020-11-20T12:17:09.970 INFO:tasks.workunit.client.0.smithi093.stderr: 77700K .......... .......... .......... .......... .......... 46% 484K 98s 2020-11-20T12:17:10.068 INFO:tasks.workunit.client.0.smithi093.stderr: 77750K .......... .......... .......... .......... .......... 46% 511K 98s 2020-11-20T12:17:10.160 INFO:tasks.workunit.client.0.smithi093.stderr: 77800K .......... .......... .......... .......... .......... 46% 543K 98s 2020-11-20T12:17:10.263 INFO:tasks.workunit.client.0.smithi093.stderr: 77850K .......... .......... .......... .......... .......... 46% 485K 98s 2020-11-20T12:17:10.359 INFO:tasks.workunit.client.0.smithi093.stderr: 77900K .......... .......... .......... .......... .......... 46% 564K 98s 2020-11-20T12:17:10.449 INFO:tasks.workunit.client.0.smithi093.stderr: 77950K .......... .......... .......... .......... .......... 46% 515K 98s 2020-11-20T12:17:10.569 INFO:tasks.workunit.client.0.smithi093.stderr: 78000K .......... .......... .......... .......... .......... 46% 417K 98s 2020-11-20T12:17:10.662 INFO:tasks.workunit.client.0.smithi093.stderr: 78050K .......... .......... .......... .......... .......... 46% 536K 98s 2020-11-20T12:17:10.763 INFO:tasks.workunit.client.0.smithi093.stderr: 78100K .......... .......... .......... .......... .......... 46% 494K 98s 2020-11-20T12:17:10.840 INFO:tasks.workunit.client.0.smithi093.stderr: 78150K .......... .......... .......... .......... .......... 46% 653K 98s 2020-11-20T12:17:10.963 INFO:tasks.workunit.client.0.smithi093.stderr: 78200K .......... .......... .......... .......... .......... 46% 407K 98s 2020-11-20T12:17:11.048 INFO:tasks.workunit.client.0.smithi093.stderr: 78250K .......... .......... .......... .......... .......... 46% 587K 98s 2020-11-20T12:17:11.129 INFO:tasks.workunit.client.0.smithi093.stderr: 78300K .......... .......... .......... .......... .......... 46% 616K 98s 2020-11-20T12:17:11.231 INFO:tasks.workunit.client.0.smithi093.stderr: 78350K .......... .......... .......... .......... .......... 46% 492K 98s 2020-11-20T12:17:11.311 INFO:tasks.workunit.client.0.smithi093.stderr: 78400K .......... .......... .......... .......... .......... 46% 635K 98s 2020-11-20T12:17:11.471 INFO:tasks.workunit.client.0.smithi093.stderr: 78450K .......... .......... .......... .......... .......... 46% 311K 98s 2020-11-20T12:17:11.521 INFO:tasks.workunit.client.0.smithi093.stderr: 78500K .......... .......... .......... .......... .......... 46% 990K 98s 2020-11-20T12:17:11.608 INFO:tasks.workunit.client.0.smithi093.stderr: 78550K .......... .......... .......... .......... .......... 46% 589K 98s 2020-11-20T12:17:11.707 INFO:tasks.workunit.client.0.smithi093.stderr: 78600K .......... .......... .......... .......... .......... 46% 494K 98s 2020-11-20T12:17:11.790 INFO:tasks.workunit.client.0.smithi093.stderr: 78650K .......... .......... .......... .......... .......... 46% 639K 98s 2020-11-20T12:17:11.878 INFO:tasks.workunit.client.0.smithi093.stderr: 78700K .......... .......... .......... .......... .......... 46% 535K 98s 2020-11-20T12:17:11.950 INFO:tasks.workunit.client.0.smithi093.stderr: 78750K .......... .......... .......... .......... .......... 46% 694K 98s 2020-11-20T12:17:12.037 INFO:tasks.workunit.client.0.smithi093.stderr: 78800K .......... .......... .......... .......... .......... 46% 577K 98s 2020-11-20T12:17:12.126 INFO:tasks.workunit.client.0.smithi093.stderr: 78850K .......... .......... .......... .......... .......... 46% 561K 98s 2020-11-20T12:17:12.200 INFO:tasks.workunit.client.0.smithi093.stderr: 78900K .......... .......... .......... .......... .......... 46% 677K 98s 2020-11-20T12:17:12.288 INFO:tasks.workunit.client.0.smithi093.stderr: 78950K .......... .......... .......... .......... .......... 46% 571K 98s 2020-11-20T12:17:12.366 INFO:tasks.workunit.client.0.smithi093.stderr: 79000K .......... .......... .......... .......... .......... 46% 640K 98s 2020-11-20T12:17:12.471 INFO:tasks.workunit.client.0.smithi093.stderr: 79050K .......... .......... .......... .......... .......... 46% 477K 98s 2020-11-20T12:17:12.559 INFO:tasks.workunit.client.0.smithi093.stderr: 79100K .......... .......... .......... .......... .......... 46% 620K 97s 2020-11-20T12:17:12.638 INFO:tasks.workunit.client.0.smithi093.stderr: 79150K .......... .......... .......... .......... .......... 46% 573K 97s 2020-11-20T12:17:12.731 INFO:tasks.workunit.client.0.smithi093.stderr: 79200K .......... .......... .......... .......... .......... 47% 541K 97s 2020-11-20T12:17:12.897 INFO:tasks.workunit.client.0.smithi093.stderr: 79250K .......... .......... .......... .......... .......... 47% 302K 98s 2020-11-20T12:17:12.939 INFO:tasks.workunit.client.0.smithi093.stderr: 79300K .......... .......... .......... .......... .......... 47% 1.15M 97s 2020-11-20T12:17:13.050 INFO:tasks.workunit.client.0.smithi093.stderr: 79350K .......... .......... .......... .......... .......... 47% 548K 97s 2020-11-20T12:17:13.122 INFO:tasks.workunit.client.0.smithi093.stderr: 79400K .......... .......... .......... .......... .......... 47% 544K 97s 2020-11-20T12:17:13.224 INFO:tasks.workunit.client.0.smithi093.stderr: 79450K .......... .......... .......... .......... .......... 47% 496K 97s 2020-11-20T12:17:13.290 INFO:tasks.workunit.client.0.smithi093.stderr: 79500K .......... .......... .......... .......... .......... 47% 745K 97s 2020-11-20T12:17:13.381 INFO:tasks.workunit.client.0.smithi093.stderr: 79550K .......... .......... .......... .......... .......... 47% 606K 97s 2020-11-20T12:17:13.464 INFO:tasks.workunit.client.0.smithi093.stderr: 79600K .......... .......... .......... .......... .......... 47% 545K 97s 2020-11-20T12:17:13.532 INFO:tasks.workunit.client.0.smithi093.stderr: 79650K .......... .......... .......... .......... .......... 47% 742K 97s 2020-11-20T12:17:13.630 INFO:tasks.workunit.client.0.smithi093.stderr: 79700K .......... .......... .......... .......... .......... 47% 514K 97s 2020-11-20T12:17:13.722 INFO:tasks.workunit.client.0.smithi093.stderr: 79750K .......... .......... .......... .......... .......... 47% 537K 97s 2020-11-20T12:17:13.796 INFO:tasks.workunit.client.0.smithi093.stderr: 79800K .......... .......... .......... .......... .......... 47% 706K 97s 2020-11-20T12:17:13.884 INFO:tasks.workunit.client.0.smithi093.stderr: 79850K .......... .......... .......... .......... .......... 47% 552K 97s 2020-11-20T12:17:13.972 INFO:tasks.workunit.client.0.smithi093.stderr: 79900K .......... .......... .......... .......... .......... 47% 568K 97s 2020-11-20T12:17:14.065 INFO:tasks.workunit.client.0.smithi093.stderr: 79950K .......... .......... .......... .......... .......... 47% 534K 97s 2020-11-20T12:17:14.136 INFO:tasks.workunit.client.0.smithi093.stderr: 80000K .......... .......... .......... .......... .......... 47% 702K 97s 2020-11-20T12:17:14.214 INFO:tasks.workunit.client.0.smithi093.stderr: 80050K .......... .......... .......... .......... .......... 47% 645K 97s 2020-11-20T12:17:14.287 INFO:tasks.workunit.client.0.smithi093.stderr: 80100K .......... .......... .......... .......... .......... 47% 683K 97s 2020-11-20T12:17:14.364 INFO:tasks.workunit.client.0.smithi093.stderr: 80150K .......... .......... .......... .......... .......... 47% 668K 97s 2020-11-20T12:17:14.440 INFO:tasks.workunit.client.0.smithi093.stderr: 80200K .......... .......... .......... .......... .......... 47% 641K 97s 2020-11-20T12:17:14.546 INFO:tasks.workunit.client.0.smithi093.stderr: 80250K .......... .......... .......... .......... .......... 47% 475K 97s 2020-11-20T12:17:14.624 INFO:tasks.workunit.client.0.smithi093.stderr: 80300K .......... .......... .......... .......... .......... 47% 639K 97s 2020-11-20T12:17:14.702 INFO:tasks.workunit.client.0.smithi093.stderr: 80350K .......... .......... .......... .......... .......... 47% 636K 97s 2020-11-20T12:17:14.779 INFO:tasks.workunit.client.0.smithi093.stderr: 80400K .......... .......... .......... .......... .......... 47% 649K 97s 2020-11-20T12:17:14.858 INFO:tasks.workunit.client.0.smithi093.stderr: 80450K .......... .......... .......... .......... .......... 47% 640K 97s 2020-11-20T12:17:14.940 INFO:tasks.workunit.client.0.smithi093.stderr: 80500K .......... .......... .......... .......... .......... 47% 606K 97s 2020-11-20T12:17:15.022 INFO:tasks.workunit.client.0.smithi093.stderr: 80550K .......... .......... .......... .......... .......... 47% 621K 97s 2020-11-20T12:17:15.100 INFO:tasks.workunit.client.0.smithi093.stderr: 80600K .......... .......... .......... .......... .......... 47% 643K 97s 2020-11-20T12:17:15.179 INFO:tasks.workunit.client.0.smithi093.stderr: 80650K .......... .......... .......... .......... .......... 47% 642K 97s 2020-11-20T12:17:15.253 INFO:tasks.workunit.client.0.smithi093.stderr: 80700K .......... .......... .......... .......... .......... 47% 1.46M 97s 2020-11-20T12:17:15.283 INFO:tasks.workunit.client.0.smithi093.stderr: 80750K .......... .......... .......... .......... .......... 47% 685K 97s 2020-11-20T12:17:15.353 INFO:tasks.workunit.client.0.smithi093.stderr: 80800K .......... .......... .......... .......... .......... 47% 734K 97s 2020-11-20T12:17:15.419 INFO:tasks.workunit.client.0.smithi093.stderr: 80850K .......... .......... .......... .......... .......... 47% 732K 97s 2020-11-20T12:17:15.491 INFO:tasks.workunit.client.0.smithi093.stderr: 80900K .......... .......... .......... .......... .......... 48% 696K 97s 2020-11-20T12:17:15.558 INFO:tasks.workunit.client.0.smithi093.stderr: 80950K .......... .......... .......... .......... .......... 48% 746K 97s 2020-11-20T12:17:15.607 INFO:tasks.workunit.client.0.smithi093.stderr: 81000K .......... .......... .......... .......... .......... 48% 1014K 96s 2020-11-20T12:17:15.678 INFO:tasks.workunit.client.0.smithi093.stderr: 81050K .......... .......... .......... .......... .......... 48% 709K 96s 2020-11-20T12:17:15.753 INFO:tasks.workunit.client.0.smithi093.stderr: 81100K .......... .......... .......... .......... .......... 48% 663K 96s 2020-11-20T12:17:15.789 INFO:tasks.workunit.client.0.smithi093.stderr: 81150K .......... .......... .......... .......... .......... 48% 1.43M 96s 2020-11-20T12:17:15.857 INFO:tasks.workunit.client.0.smithi093.stderr: 81200K .......... .......... .......... .......... .......... 48% 717K 96s 2020-11-20T12:17:15.930 INFO:tasks.workunit.client.0.smithi093.stderr: 81250K .......... .......... .......... .......... .......... 48% 719K 96s 2020-11-20T12:17:15.985 INFO:tasks.workunit.client.0.smithi093.stderr: 81300K .......... .......... .......... .......... .......... 48% 853K 96s 2020-11-20T12:17:16.058 INFO:tasks.workunit.client.0.smithi093.stderr: 81350K .......... .......... .......... .......... .......... 48% 689K 96s 2020-11-20T12:17:16.095 INFO:tasks.workunit.client.0.smithi093.stderr: 81400K .......... .......... .......... .......... .......... 48% 1.30M 96s 2020-11-20T12:17:16.172 INFO:tasks.workunit.client.0.smithi093.stderr: 81450K .......... .......... .......... .......... .......... 48% 669K 96s 2020-11-20T12:17:16.243 INFO:tasks.workunit.client.0.smithi093.stderr: 81500K .......... .......... .......... .......... .......... 48% 708K 96s 2020-11-20T12:17:16.304 INFO:tasks.workunit.client.0.smithi093.stderr: 81550K .......... .......... .......... .......... .......... 48% 780K 96s 2020-11-20T12:17:16.375 INFO:tasks.workunit.client.0.smithi093.stderr: 81600K .......... .......... .......... .......... .......... 48% 717K 96s 2020-11-20T12:17:16.403 INFO:tasks.workunit.client.0.smithi093.stderr: 81650K .......... .......... .......... .......... .......... 48% 1.66M 96s 2020-11-20T12:17:16.469 INFO:tasks.workunit.client.0.smithi093.stderr: 81700K .......... .......... .......... .......... .......... 48% 759K 96s 2020-11-20T12:17:16.521 INFO:tasks.workunit.client.0.smithi093.stderr: 81750K .......... .......... .......... .......... .......... 48% 973K 96s 2020-11-20T12:17:16.588 INFO:tasks.workunit.client.0.smithi093.stderr: 81800K .......... .......... .......... .......... .......... 48% 812K 96s 2020-11-20T12:17:16.618 INFO:tasks.workunit.client.0.smithi093.stderr: 81850K .......... .......... .......... .......... .......... 48% 1.36M 96s 2020-11-20T12:17:16.683 INFO:tasks.workunit.client.0.smithi093.stderr: 81900K .......... .......... .......... .......... .......... 48% 772K 96s 2020-11-20T12:17:16.735 INFO:tasks.workunit.client.0.smithi093.stderr: 81950K .......... .......... .......... .......... .......... 48% 967K 96s 2020-11-20T12:17:16.808 INFO:tasks.workunit.client.0.smithi093.stderr: 82000K .......... .......... .......... .......... .......... 48% 687K 95s 2020-11-20T12:17:16.845 INFO:tasks.workunit.client.0.smithi093.stderr: 82050K .......... .......... .......... .......... .......... 48% 1.30M 95s 2020-11-20T12:17:16.893 INFO:tasks.workunit.client.0.smithi093.stderr: 82100K .......... .......... .......... .......... .......... 48% 1.01M 95s 2020-11-20T12:17:16.962 INFO:tasks.workunit.client.0.smithi093.stderr: 82150K .......... .......... .......... .......... .......... 48% 736K 95s 2020-11-20T12:17:17.012 INFO:tasks.workunit.client.0.smithi093.stderr: 82200K .......... .......... .......... .......... .......... 48% 995K 95s 2020-11-20T12:17:17.077 INFO:tasks.workunit.client.0.smithi093.stderr: 82250K .......... .......... .......... .......... .......... 48% 762K 95s 2020-11-20T12:17:17.130 INFO:tasks.workunit.client.0.smithi093.stderr: 82300K .......... .......... .......... .......... .......... 48% 952K 95s 2020-11-20T12:17:17.174 INFO:tasks.workunit.client.0.smithi093.stderr: 82350K .......... .......... .......... .......... .......... 48% 1.11M 95s 2020-11-20T12:17:17.247 INFO:tasks.workunit.client.0.smithi093.stderr: 82400K .......... .......... .......... .......... .......... 48% 801K 95s 2020-11-20T12:17:17.293 INFO:tasks.workunit.client.0.smithi093.stderr: 82450K .......... .......... .......... .......... .......... 48% 872K 95s 2020-11-20T12:17:17.358 INFO:tasks.workunit.client.0.smithi093.stderr: 82500K .......... .......... .......... .......... .......... 48% 1.27M 95s 2020-11-20T12:17:17.404 INFO:tasks.workunit.client.0.smithi093.stderr: 82550K .......... .......... .......... .......... .......... 49% 696K 95s 2020-11-20T12:17:17.448 INFO:tasks.workunit.client.0.smithi093.stderr: 82600K .......... .......... .......... .......... .......... 49% 1.12M 95s 2020-11-20T12:17:17.511 INFO:tasks.workunit.client.0.smithi093.stderr: 82650K .......... .......... .......... .......... .......... 49% 779K 95s 2020-11-20T12:17:17.551 INFO:tasks.workunit.client.0.smithi093.stderr: 82700K .......... .......... .......... .......... .......... 49% 1.24M 95s 2020-11-20T12:17:17.598 INFO:tasks.workunit.client.0.smithi093.stderr: 82750K .......... .......... .......... .......... .......... 49% 1.03M 95s 2020-11-20T12:17:17.630 INFO:tasks.workunit.client.0.smithi093.stderr: 82800K .......... .......... .......... .......... .......... 49% 1.55M 95s 2020-11-20T12:17:17.702 INFO:tasks.workunit.client.0.smithi093.stderr: 82850K .......... .......... .......... .......... .......... 49% 806K 94s 2020-11-20T12:17:17.740 INFO:tasks.workunit.client.0.smithi093.stderr: 82900K .......... .......... .......... .......... .......... 49% 1.01M 94s 2020-11-20T12:17:17.778 INFO:tasks.workunit.client.0.smithi093.stderr: 82950K .......... .......... .......... .......... .......... 49% 1.29M 94s 2020-11-20T12:17:17.840 INFO:tasks.workunit.client.0.smithi093.stderr: 83000K .......... .......... .......... .......... .......... 49% 801K 94s 2020-11-20T12:17:17.882 INFO:tasks.workunit.client.0.smithi093.stderr: 83050K .......... .......... .......... .......... .......... 49% 1.29M 94s 2020-11-20T12:17:17.920 INFO:tasks.workunit.client.0.smithi093.stderr: 83100K .......... .......... .......... .......... .......... 49% 1.17M 94s 2020-11-20T12:17:17.966 INFO:tasks.workunit.client.0.smithi093.stderr: 83150K .......... .......... .......... .......... .......... 49% 1.07M 94s 2020-11-20T12:17:18.024 INFO:tasks.workunit.client.0.smithi093.stderr: 83200K .......... .......... .......... .......... .......... 49% 861K 94s 2020-11-20T12:17:18.124 INFO:tasks.workunit.client.0.smithi093.stderr: 83250K .......... .......... .......... .......... .......... 49% 502K 94s 2020-11-20T12:17:18.127 INFO:tasks.workunit.client.0.smithi093.stderr: 83300K .......... .......... .......... .......... .......... 49% 27.0M 94s 2020-11-20T12:17:18.198 INFO:tasks.workunit.client.0.smithi093.stderr: 83350K .......... .......... .......... .......... .......... 49% 689K 94s 2020-11-20T12:17:18.259 INFO:tasks.workunit.client.0.smithi093.stderr: 83400K .......... .......... .......... .......... .......... 49% 818K 94s 2020-11-20T12:17:18.329 INFO:tasks.workunit.client.0.smithi093.stderr: 83450K .......... .......... .......... .......... .......... 49% 719K 94s 2020-11-20T12:17:18.385 INFO:tasks.workunit.client.0.smithi093.stderr: 83500K .......... .......... .......... .......... .......... 49% 1.05M 94s 2020-11-20T12:17:18.434 INFO:tasks.workunit.client.0.smithi093.stderr: 83550K .......... .......... .......... .......... .......... 49% 849K 94s 2020-11-20T12:17:18.490 INFO:tasks.workunit.client.0.smithi093.stderr: 83600K .......... .......... .......... .......... .......... 49% 900K 94s 2020-11-20T12:17:18.544 INFO:tasks.workunit.client.0.smithi093.stderr: 83650K .......... .......... .......... .......... .......... 49% 911K 94s 2020-11-20T12:17:18.614 INFO:tasks.workunit.client.0.smithi093.stderr: 83700K .......... .......... .......... .......... .......... 49% 724K 94s 2020-11-20T12:17:18.666 INFO:tasks.workunit.client.0.smithi093.stderr: 83750K .......... .......... .......... .......... .......... 49% 950K 93s 2020-11-20T12:17:18.706 INFO:tasks.workunit.client.0.smithi093.stderr: 83800K .......... .......... .......... .......... .......... 49% 1.22M 93s 2020-11-20T12:17:18.771 INFO:tasks.workunit.client.0.smithi093.stderr: 83850K .......... .......... .......... .......... .......... 49% 851K 93s 2020-11-20T12:17:18.838 INFO:tasks.workunit.client.0.smithi093.stderr: 83900K .......... .......... .......... .......... .......... 49% 686K 93s 2020-11-20T12:17:18.896 INFO:tasks.workunit.client.0.smithi093.stderr: 83950K .......... .......... .......... .......... .......... 49% 860K 93s 2020-11-20T12:17:18.935 INFO:tasks.workunit.client.0.smithi093.stderr: 84000K .......... .......... .......... .......... .......... 49% 1.26M 93s 2020-11-20T12:17:18.996 INFO:tasks.workunit.client.0.smithi093.stderr: 84050K .......... .......... .......... .......... .......... 49% 810K 93s 2020-11-20T12:17:19.134 INFO:tasks.workunit.client.0.smithi093.stderr: 84100K .......... .......... .......... .......... .......... 49% 364K 93s 2020-11-20T12:17:19.135 INFO:tasks.workunit.client.0.smithi093.stderr: 84150K .......... .......... .......... .......... .......... 49% 234M 93s 2020-11-20T12:17:19.196 INFO:tasks.workunit.client.0.smithi093.stderr: 84200K .......... .......... .......... .......... .......... 49% 807K 93s 2020-11-20T12:17:19.274 INFO:tasks.workunit.client.0.smithi093.stderr: 84250K .......... .......... .......... .......... .......... 50% 638K 93s 2020-11-20T12:17:19.347 INFO:tasks.workunit.client.0.smithi093.stderr: 84300K .......... .......... .......... .......... .......... 50% 697K 93s 2020-11-20T12:17:19.417 INFO:tasks.workunit.client.0.smithi093.stderr: 84350K .......... .......... .......... .......... .......... 50% 703K 93s 2020-11-20T12:17:19.483 INFO:tasks.workunit.client.0.smithi093.stderr: 84400K .......... .......... .......... .......... .......... 50% 1.01M 93s 2020-11-20T12:17:19.529 INFO:tasks.workunit.client.0.smithi093.stderr: 84450K .......... .......... .......... .......... .......... 50% 786K 93s 2020-11-20T12:17:19.603 INFO:tasks.workunit.client.0.smithi093.stderr: 84500K .......... .......... .......... .......... .......... 50% 673K 93s 2020-11-20T12:17:19.678 INFO:tasks.workunit.client.0.smithi093.stderr: 84550K .......... .......... .......... .......... .......... 50% 669K 93s 2020-11-20T12:17:19.751 INFO:tasks.workunit.client.0.smithi093.stderr: 84600K .......... .......... .......... .......... .......... 50% 680K 93s 2020-11-20T12:17:19.822 INFO:tasks.workunit.client.0.smithi093.stderr: 84650K .......... .......... .......... .......... .......... 50% 764K 93s 2020-11-20T12:17:19.870 INFO:tasks.workunit.client.0.smithi093.stderr: 84700K .......... .......... .......... .......... .......... 50% 933K 93s 2020-11-20T12:17:19.951 INFO:tasks.workunit.client.0.smithi093.stderr: 84750K .......... .......... .......... .......... .......... 50% 627K 93s 2020-11-20T12:17:20.019 INFO:tasks.workunit.client.0.smithi093.stderr: 84800K .......... .......... .......... .......... .......... 50% 728K 93s 2020-11-20T12:17:20.100 INFO:tasks.workunit.client.0.smithi093.stderr: 84850K .......... .......... .......... .......... .......... 50% 619K 92s 2020-11-20T12:17:20.146 INFO:tasks.workunit.client.0.smithi093.stderr: 84900K .......... .......... .......... .......... .......... 50% 1.05M 92s 2020-11-20T12:17:20.216 INFO:tasks.workunit.client.0.smithi093.stderr: 84950K .......... .......... .......... .......... .......... 50% 720K 92s 2020-11-20T12:17:20.285 INFO:tasks.workunit.client.0.smithi093.stderr: 85000K .......... .......... .......... .......... .......... 50% 723K 92s 2020-11-20T12:17:20.328 INFO:tasks.workunit.client.0.smithi093.stderr: 85050K .......... .......... .......... .......... .......... 50% 1.13M 92s 2020-11-20T12:17:20.394 INFO:tasks.workunit.client.0.smithi093.stderr: 85100K .......... .......... .......... .......... .......... 50% 823K 92s 2020-11-20T12:17:20.452 INFO:tasks.workunit.client.0.smithi093.stderr: 85150K .......... .......... .......... .......... .......... 50% 791K 92s 2020-11-20T12:17:20.493 INFO:tasks.workunit.client.0.smithi093.stderr: 85200K .......... .......... .......... .......... .......... 50% 1.18M 92s 2020-11-20T12:17:20.548 INFO:tasks.workunit.client.0.smithi093.stderr: 85250K .......... .......... .......... .......... .......... 50% 907K 92s 2020-11-20T12:17:20.594 INFO:tasks.workunit.client.0.smithi093.stderr: 85300K .......... .......... .......... .......... .......... 50% 1.18M 92s 2020-11-20T12:17:20.607 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:20.610 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:20.613 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:20.648 INFO:tasks.workunit.client.0.smithi093.stderr: 85350K .......... .......... .......... .......... .......... 50% 861K 92s 2020-11-20T12:17:20.698 INFO:tasks.workunit.client.0.smithi093.stderr: 85400K .......... .......... .......... .......... .......... 50% 990K 92s 2020-11-20T12:17:20.767 INFO:tasks.workunit.client.0.smithi093.stderr: 85450K .......... .......... .......... .......... .......... 50% 731K 92s 2020-11-20T12:17:20.832 INFO:tasks.workunit.client.0.smithi093.stderr: 85500K .......... .......... .......... .......... .......... 50% 766K 92s 2020-11-20T12:17:20.876 INFO:tasks.workunit.client.0.smithi093.stderr: 85550K .......... .......... .......... .......... .......... 50% 1.16M 92s 2020-11-20T12:17:20.940 INFO:tasks.workunit.client.0.smithi093.stderr: 85600K .......... .......... .......... .......... .......... 50% 761K 92s 2020-11-20T12:17:20.986 INFO:tasks.workunit.client.0.smithi093.stderr: 85650K .......... .......... .......... .......... .......... 50% 1.10M 92s 2020-11-20T12:17:21.049 INFO:tasks.workunit.client.0.smithi093.stderr: 85700K .......... .......... .......... .......... .......... 50% 781K 92s 2020-11-20T12:17:21.102 INFO:tasks.workunit.client.0.smithi093.stderr: 85750K .......... .......... .......... .......... .......... 50% 1009K 91s 2020-11-20T12:17:21.173 INFO:tasks.workunit.client.0.smithi093.stderr: 85800K .......... .......... .......... .......... .......... 50% 662K 91s 2020-11-20T12:17:21.215 INFO:tasks.workunit.client.0.smithi093.stderr: 85850K .......... .......... .......... .......... .......... 50% 1.17M 91s 2020-11-20T12:17:21.267 INFO:tasks.workunit.client.0.smithi093.stderr: 85900K .......... .......... .......... .......... .......... 50% 1.02M 91s 2020-11-20T12:17:21.334 INFO:tasks.workunit.client.0.smithi093.stderr: 85950K .......... .......... .......... .......... .......... 51% 697K 91s 2020-11-20T12:17:21.379 INFO:tasks.workunit.client.0.smithi093.stderr: 86000K .......... .......... .......... .......... .......... 51% 1.09M 91s 2020-11-20T12:17:21.539 INFO:tasks.workunit.client.0.smithi093.stderr: 86050K .......... .......... .......... .......... .......... 51% 314K 91s 2020-11-20T12:17:21.574 INFO:tasks.workunit.client.0.smithi093.stderr: 86100K .......... .......... .......... .......... .......... 51% 1.39M 91s 2020-11-20T12:17:21.591 INFO:tasks.workunit.client.0.smithi093.stderr: 86150K .......... .......... .......... .......... .......... 51% 3.66M 91s 2020-11-20T12:17:21.660 INFO:tasks.workunit.client.0.smithi093.stderr: 86200K .......... .......... .......... .......... .......... 51% 712K 91s 2020-11-20T12:17:21.719 INFO:tasks.workunit.client.0.smithi093.stderr: 86250K .......... .......... .......... .......... .......... 51% 810K 91s 2020-11-20T12:17:21.778 INFO:tasks.workunit.client.0.smithi093.stderr: 86300K .......... .......... .......... .......... .......... 51% 853K 91s 2020-11-20T12:17:21.836 INFO:tasks.workunit.client.0.smithi093.stderr: 86350K .......... .......... .......... .......... .......... 51% 926K 91s 2020-11-20T12:17:21.886 INFO:tasks.workunit.client.0.smithi093.stderr: 86400K .......... .......... .......... .......... .......... 51% 910K 91s 2020-11-20T12:17:21.942 INFO:tasks.workunit.client.0.smithi093.stderr: 86450K .......... .......... .......... .......... .......... 51% 912K 91s 2020-11-20T12:17:21.983 INFO:tasks.workunit.client.0.smithi093.stderr: 86500K .......... .......... .......... .......... .......... 51% 1.18M 91s 2020-11-20T12:17:22.041 INFO:tasks.workunit.client.0.smithi093.stderr: 86550K .......... .......... .......... .......... .......... 51% 885K 91s 2020-11-20T12:17:22.096 INFO:tasks.workunit.client.0.smithi093.stderr: 86600K .......... .......... .......... .......... .......... 51% 878K 91s 2020-11-20T12:17:22.156 INFO:tasks.workunit.client.0.smithi093.stderr: 86650K .......... .......... .......... .......... .......... 51% 1.29M 91s 2020-11-20T12:17:22.197 INFO:tasks.workunit.client.0.smithi093.stderr: 86700K .......... .......... .......... .......... .......... 51% 795K 90s 2020-11-20T12:17:22.254 INFO:tasks.workunit.client.0.smithi093.stderr: 86750K .......... .......... .......... .......... .......... 51% 879K 90s 2020-11-20T12:17:22.310 INFO:tasks.workunit.client.0.smithi093.stderr: 86800K .......... .......... .......... .......... .......... 51% 1.24M 90s 2020-11-20T12:17:22.356 INFO:tasks.workunit.client.0.smithi093.stderr: 86850K .......... .......... .......... .......... .......... 51% 795K 90s 2020-11-20T12:17:22.415 INFO:tasks.workunit.client.0.smithi093.stderr: 86900K .......... .......... .......... .......... .......... 51% 852K 90s 2020-11-20T12:17:22.458 INFO:tasks.workunit.client.0.smithi093.stderr: 86950K .......... .......... .......... .......... .......... 51% 1.13M 90s 2020-11-20T12:17:22.513 INFO:tasks.workunit.client.0.smithi093.stderr: 87000K .......... .......... .......... .......... .......... 51% 913K 90s 2020-11-20T12:17:22.557 INFO:tasks.workunit.client.0.smithi093.stderr: 87050K .......... .......... .......... .......... .......... 51% 1.10M 90s 2020-11-20T12:17:22.620 INFO:tasks.workunit.client.0.smithi093.stderr: 87100K .......... .......... .......... .......... .......... 51% 814K 90s 2020-11-20T12:17:22.686 INFO:tasks.workunit.client.0.smithi093.stderr: 87150K .......... .......... .......... .......... .......... 51% 743K 90s 2020-11-20T12:17:22.731 INFO:tasks.workunit.client.0.smithi093.stderr: 87200K .......... .......... .......... .......... .......... 51% 1.08M 90s 2020-11-20T12:17:22.787 INFO:tasks.workunit.client.0.smithi093.stderr: 87250K .......... .......... .......... .......... .......... 51% 908K 90s 2020-11-20T12:17:22.832 INFO:tasks.workunit.client.0.smithi093.stderr: 87300K .......... .......... .......... .......... .......... 51% 1.07M 90s 2020-11-20T12:17:22.898 INFO:tasks.workunit.client.0.smithi093.stderr: 87350K .......... .......... .......... .......... .......... 51% 787K 90s 2020-11-20T12:17:22.944 INFO:tasks.workunit.client.0.smithi093.stderr: 87400K .......... .......... .......... .......... .......... 51% 1.01M 90s 2020-11-20T12:17:22.999 INFO:tasks.workunit.client.0.smithi093.stderr: 87450K .......... .......... .......... .......... .......... 51% 916K 90s 2020-11-20T12:17:23.048 INFO:tasks.workunit.client.0.smithi093.stderr: 87500K .......... .......... .......... .......... .......... 51% 999K 90s 2020-11-20T12:17:23.120 INFO:tasks.workunit.client.0.smithi093.stderr: 87550K .......... .......... .......... .......... .......... 51% 701K 90s 2020-11-20T12:17:23.164 INFO:tasks.workunit.client.0.smithi093.stderr: 87600K .......... .......... .......... .......... .......... 51% 1.11M 89s 2020-11-20T12:17:23.202 INFO:tasks.workunit.client.0.smithi093.stderr: 87650K .......... .......... .......... .......... .......... 52% 1.27M 89s 2020-11-20T12:17:23.275 INFO:tasks.workunit.client.0.smithi093.stderr: 87700K .......... .......... .......... .......... .......... 52% 697K 89s 2020-11-20T12:17:23.328 INFO:tasks.workunit.client.0.smithi093.stderr: 87750K .......... .......... .......... .......... .......... 52% 924K 89s 2020-11-20T12:17:23.388 INFO:tasks.workunit.client.0.smithi093.stderr: 87800K .......... .......... .......... .......... .......... 52% 880K 89s 2020-11-20T12:17:23.427 INFO:tasks.workunit.client.0.smithi093.stderr: 87850K .......... .......... .......... .......... .......... 52% 1.16M 89s 2020-11-20T12:17:23.503 INFO:tasks.workunit.client.0.smithi093.stderr: 87900K .......... .......... .......... .......... .......... 52% 688K 89s 2020-11-20T12:17:23.551 INFO:tasks.workunit.client.0.smithi093.stderr: 87950K .......... .......... .......... .......... .......... 52% 975K 89s 2020-11-20T12:17:23.612 INFO:tasks.workunit.client.0.smithi093.stderr: 88000K .......... .......... .......... .......... .......... 52% 1.17M 89s 2020-11-20T12:17:23.666 INFO:tasks.workunit.client.0.smithi093.stderr: 88050K .......... .......... .......... .......... .......... 52% 679K 89s 2020-11-20T12:17:23.778 INFO:tasks.workunit.client.0.smithi093.stderr: 88100K .......... .......... .......... .......... .......... 52% 451K 89s 2020-11-20T12:17:23.798 INFO:tasks.workunit.client.0.smithi093.stderr: 88150K .......... .......... .......... .......... .......... 52% 2.74M 89s 2020-11-20T12:17:23.872 INFO:tasks.workunit.client.0.smithi093.stderr: 88200K .......... .......... .......... .......... .......... 52% 645K 89s 2020-11-20T12:17:23.950 INFO:tasks.workunit.client.0.smithi093.stderr: 88250K .......... .......... .......... .......... .......... 52% 642K 89s 2020-11-20T12:17:24.027 INFO:tasks.workunit.client.0.smithi093.stderr: 88300K .......... .......... .......... .......... .......... 52% 656K 89s 2020-11-20T12:17:24.095 INFO:tasks.workunit.client.0.smithi093.stderr: 88350K .......... .......... .......... .......... .......... 52% 738K 89s 2020-11-20T12:17:24.169 INFO:tasks.workunit.client.0.smithi093.stderr: 88400K .......... .......... .......... .......... .......... 52% 672K 89s 2020-11-20T12:17:24.224 INFO:tasks.workunit.client.0.smithi093.stderr: 88450K .......... .......... .......... .......... .......... 52% 901K 89s 2020-11-20T12:17:24.298 INFO:tasks.workunit.client.0.smithi093.stderr: 88500K .......... .......... .......... .......... .......... 52% 682K 89s 2020-11-20T12:17:24.371 INFO:tasks.workunit.client.0.smithi093.stderr: 88550K .......... .......... .......... .......... .......... 52% 681K 89s 2020-11-20T12:17:24.444 INFO:tasks.workunit.client.0.smithi093.stderr: 88600K .......... .......... .......... .......... .......... 52% 965K 88s 2020-11-20T12:17:24.488 INFO:tasks.workunit.client.0.smithi093.stderr: 88650K .......... .......... .......... .......... .......... 52% 772K 88s 2020-11-20T12:17:24.546 INFO:tasks.workunit.client.0.smithi093.stderr: 88700K .......... .......... .......... .......... .......... 52% 873K 88s 2020-11-20T12:17:24.605 INFO:tasks.workunit.client.0.smithi093.stderr: 88750K .......... .......... .......... .......... .......... 52% 832K 88s 2020-11-20T12:17:24.681 INFO:tasks.workunit.client.0.smithi093.stderr: 88800K .......... .......... .......... .......... .......... 52% 684K 88s 2020-11-20T12:17:24.757 INFO:tasks.workunit.client.0.smithi093.stderr: 88850K .......... .......... .......... .......... .......... 52% 632K 88s 2020-11-20T12:17:24.794 INFO:tasks.workunit.client.0.smithi093.stderr: 88900K .......... .......... .......... .......... .......... 52% 1.32M 88s 2020-11-20T12:17:24.849 INFO:tasks.workunit.client.0.smithi093.stderr: 88950K .......... .......... .......... .......... .......... 52% 919K 88s 2020-11-20T12:17:24.919 INFO:tasks.workunit.client.0.smithi093.stderr: 89000K .......... .......... .......... .......... .......... 52% 704K 88s 2020-11-20T12:17:24.992 INFO:tasks.workunit.client.0.smithi093.stderr: 89050K .......... .......... .......... .......... .......... 52% 688K 88s 2020-11-20T12:17:25.027 INFO:tasks.workunit.client.0.smithi093.stderr: 89100K .......... .......... .......... .......... .......... 52% 1.46M 88s 2020-11-20T12:17:25.084 INFO:tasks.workunit.client.0.smithi093.stderr: 89150K .......... .......... .......... .......... .......... 52% 966K 88s 2020-11-20T12:17:25.143 INFO:tasks.workunit.client.0.smithi093.stderr: 89200K .......... .......... .......... .......... .......... 52% 764K 88s 2020-11-20T12:17:25.213 INFO:tasks.workunit.client.0.smithi093.stderr: 89250K .......... .......... .......... .......... .......... 52% 719K 88s 2020-11-20T12:17:25.247 INFO:tasks.workunit.client.0.smithi093.stderr: 89300K .......... .......... .......... .......... .......... 53% 1.40M 88s 2020-11-20T12:17:25.297 INFO:tasks.workunit.client.0.smithi093.stderr: 89350K .......... .......... .......... .......... .......... 53% 999K 88s 2020-11-20T12:17:25.372 INFO:tasks.workunit.client.0.smithi093.stderr: 89400K .......... .......... .......... .......... .......... 53% 668K 88s 2020-11-20T12:17:25.442 INFO:tasks.workunit.client.0.smithi093.stderr: 89450K .......... .......... .......... .......... .......... 53% 717K 88s 2020-11-20T12:17:25.482 INFO:tasks.workunit.client.0.smithi093.stderr: 89500K .......... .......... .......... .......... .......... 53% 1.50M 88s 2020-11-20T12:17:25.526 INFO:tasks.workunit.client.0.smithi093.stderr: 89550K .......... .......... .......... .......... .......... 53% 967K 87s 2020-11-20T12:17:25.679 INFO:tasks.workunit.client.0.smithi093.stderr: 89600K .......... .......... .......... .......... .......... 53% 651K 87s 2020-11-20T12:17:25.697 INFO:tasks.workunit.client.0.smithi093.stderr: 89650K .......... .......... .......... .......... .......... 53% 534K 87s 2020-11-20T12:17:25.754 INFO:tasks.workunit.client.0.smithi093.stderr: 89700K .......... .......... .......... .......... .......... 53% 875K 87s 2020-11-20T12:17:25.823 INFO:tasks.workunit.client.0.smithi093.stderr: 89750K .......... .......... .......... .......... .......... 53% 728K 87s 2020-11-20T12:17:25.887 INFO:tasks.workunit.client.0.smithi093.stderr: 89800K .......... .......... .......... .......... .......... 53% 783K 87s 2020-11-20T12:17:25.953 INFO:tasks.workunit.client.0.smithi093.stderr: 89850K .......... .......... .......... .......... .......... 53% 744K 87s 2020-11-20T12:17:26.023 INFO:tasks.workunit.client.0.smithi093.stderr: 89900K .......... .......... .......... .......... .......... 53% 723K 87s 2020-11-20T12:17:26.094 INFO:tasks.workunit.client.0.smithi093.stderr: 89950K .......... .......... .......... .......... .......... 53% 874K 87s 2020-11-20T12:17:26.148 INFO:tasks.workunit.client.0.smithi093.stderr: 90000K .......... .......... .......... .......... .......... 53% 731K 87s 2020-11-20T12:17:26.218 INFO:tasks.workunit.client.0.smithi093.stderr: 90050K .......... .......... .......... .......... .......... 53% 711K 87s 2020-11-20T12:17:26.287 INFO:tasks.workunit.client.0.smithi093.stderr: 90100K .......... .......... .......... .......... .......... 53% 732K 87s 2020-11-20T12:17:26.360 INFO:tasks.workunit.client.0.smithi093.stderr: 90150K .......... .......... .......... .......... .......... 53% 756K 87s 2020-11-20T12:17:26.431 INFO:tasks.workunit.client.0.smithi093.stderr: 90200K .......... .......... .......... .......... .......... 53% 644K 87s 2020-11-20T12:17:26.488 INFO:tasks.workunit.client.0.smithi093.stderr: 90250K .......... .......... .......... .......... .......... 53% 872K 87s 2020-11-20T12:17:26.551 INFO:tasks.workunit.client.0.smithi093.stderr: 90300K .......... .......... .......... .......... .......... 53% 786K 87s 2020-11-20T12:17:26.626 INFO:tasks.workunit.client.0.smithi093.stderr: 90350K .......... .......... .......... .......... .......... 53% 675K 87s 2020-11-20T12:17:26.706 INFO:tasks.workunit.client.0.smithi093.stderr: 90400K .......... .......... .......... .......... .......... 53% 626K 87s 2020-11-20T12:17:26.781 INFO:tasks.workunit.client.0.smithi093.stderr: 90450K .......... .......... .......... .......... .......... 53% 661K 87s 2020-11-20T12:17:26.845 INFO:tasks.workunit.client.0.smithi093.stderr: 90500K .......... .......... .......... .......... .......... 53% 887K 87s 2020-11-20T12:17:26.914 INFO:tasks.workunit.client.0.smithi093.stderr: 90550K .......... .......... .......... .......... .......... 53% 651K 87s 2020-11-20T12:17:26.986 INFO:tasks.workunit.client.0.smithi093.stderr: 90600K .......... .......... .......... .......... .......... 53% 1004K 87s 2020-11-20T12:17:27.027 INFO:tasks.workunit.client.0.smithi093.stderr: 90650K .......... .......... .......... .......... .......... 53% 793K 87s 2020-11-20T12:17:27.099 INFO:tasks.workunit.client.0.smithi093.stderr: 90700K .......... .......... .......... .......... .......... 53% 692K 86s 2020-11-20T12:17:27.172 INFO:tasks.workunit.client.0.smithi093.stderr: 90750K .......... .......... .......... .......... .......... 53% 691K 86s 2020-11-20T12:17:27.228 INFO:tasks.workunit.client.0.smithi093.stderr: 90800K .......... .......... .......... .......... .......... 53% 892K 86s 2020-11-20T12:17:27.297 INFO:tasks.workunit.client.0.smithi093.stderr: 90850K .......... .......... .......... .......... .......... 53% 729K 86s 2020-11-20T12:17:27.340 INFO:tasks.workunit.client.0.smithi093.stderr: 90900K .......... .......... .......... .......... .......... 53% 1.18M 86s 2020-11-20T12:17:27.414 INFO:tasks.workunit.client.0.smithi093.stderr: 90950K .......... .......... .......... .......... .......... 53% 658K 86s 2020-11-20T12:17:27.485 INFO:tasks.workunit.client.0.smithi093.stderr: 91000K .......... .......... .......... .......... .......... 54% 703K 86s 2020-11-20T12:17:27.544 INFO:tasks.workunit.client.0.smithi093.stderr: 91050K .......... .......... .......... .......... .......... 54% 844K 86s 2020-11-20T12:17:27.597 INFO:tasks.workunit.client.0.smithi093.stderr: 91100K .......... .......... .......... .......... .......... 54% 938K 86s 2020-11-20T12:17:27.651 INFO:tasks.workunit.client.0.smithi093.stderr: 91150K .......... .......... .......... .......... .......... 54% 933K 86s 2020-11-20T12:17:27.726 INFO:tasks.workunit.client.0.smithi093.stderr: 91200K .......... .......... .......... .......... .......... 54% 665K 86s 2020-11-20T12:17:27.773 INFO:tasks.workunit.client.0.smithi093.stderr: 91250K .......... .......... .......... .......... .......... 54% 1.05M 86s 2020-11-20T12:17:27.814 INFO:tasks.workunit.client.0.smithi093.stderr: 91300K .......... .......... .......... .......... .......... 54% 1.18M 86s 2020-11-20T12:17:27.860 INFO:tasks.workunit.client.0.smithi093.stderr: 91350K .......... .......... .......... .......... .......... 54% 1.07M 86s 2020-11-20T12:17:27.917 INFO:tasks.workunit.client.0.smithi093.stderr: 91400K .......... .......... .......... .......... .......... 54% 931K 86s 2020-11-20T12:17:27.960 INFO:tasks.workunit.client.0.smithi093.stderr: 91450K .......... .......... .......... .......... .......... 54% 1.06M 86s 2020-11-20T12:17:27.998 INFO:tasks.workunit.client.0.smithi093.stderr: 91500K .......... .......... .......... .......... .......... 54% 1.53M 86s 2020-11-20T12:17:28.050 INFO:tasks.workunit.client.0.smithi093.stderr: 91550K .......... .......... .......... .......... .......... 54% 849K 86s 2020-11-20T12:17:28.093 INFO:tasks.workunit.client.0.smithi093.stderr: 91600K .......... .......... .......... .......... .......... 54% 1.15M 85s 2020-11-20T12:17:28.148 INFO:tasks.workunit.client.0.smithi093.stderr: 91650K .......... .......... .......... .......... .......... 54% 916K 85s 2020-11-20T12:17:28.190 INFO:tasks.workunit.client.0.smithi093.stderr: 91700K .......... .......... .......... .......... .......... 54% 1.14M 85s 2020-11-20T12:17:28.252 INFO:tasks.workunit.client.0.smithi093.stderr: 91750K .......... .......... .......... .......... .......... 54% 1.01M 85s 2020-11-20T12:17:28.288 INFO:tasks.workunit.client.0.smithi093.stderr: 91800K .......... .......... .......... .......... .......... 54% 1015K 85s 2020-11-20T12:17:28.336 INFO:tasks.workunit.client.0.smithi093.stderr: 91850K .......... .......... .......... .......... .......... 54% 1.02M 85s 2020-11-20T12:17:28.395 INFO:tasks.workunit.client.0.smithi093.stderr: 91900K .......... .......... .......... .......... .......... 54% 852K 85s 2020-11-20T12:17:28.450 INFO:tasks.workunit.client.0.smithi093.stderr: 91950K .......... .......... .......... .......... .......... 54% 1.21M 85s 2020-11-20T12:17:28.482 INFO:tasks.workunit.client.0.smithi093.stderr: 92000K .......... .......... .......... .......... .......... 54% 1.03M 85s 2020-11-20T12:17:28.544 INFO:tasks.workunit.client.0.smithi093.stderr: 92050K .......... .......... .......... .......... .......... 54% 809K 85s 2020-11-20T12:17:28.600 INFO:tasks.workunit.client.0.smithi093.stderr: 92100K .......... .......... .......... .......... .......... 54% 893K 85s 2020-11-20T12:17:28.635 INFO:tasks.workunit.client.0.smithi093.stderr: 92150K .......... .......... .......... .......... .......... 54% 1.46M 85s 2020-11-20T12:17:28.700 INFO:tasks.workunit.client.0.smithi093.stderr: 92200K .......... .......... .......... .......... .......... 54% 767K 85s 2020-11-20T12:17:28.791 INFO:tasks.workunit.client.0.smithi093.stderr: 92250K .......... .......... .......... .......... .......... 54% 548K 85s 2020-11-20T12:17:28.796 INFO:tasks.workunit.client.0.smithi093.stderr: 92300K .......... .......... .......... .......... .......... 54% 7.77M 85s 2020-11-20T12:17:28.873 INFO:tasks.workunit.client.0.smithi093.stderr: 92350K .......... .......... .......... .......... .......... 54% 652K 85s 2020-11-20T12:17:28.941 INFO:tasks.workunit.client.0.smithi093.stderr: 92400K .......... .......... .......... .......... .......... 54% 739K 85s 2020-11-20T12:17:29.010 INFO:tasks.workunit.client.0.smithi093.stderr: 92450K .......... .......... .......... .......... .......... 54% 721K 84s 2020-11-20T12:17:29.081 INFO:tasks.workunit.client.0.smithi093.stderr: 92500K .......... .......... .......... .......... .......... 54% 704K 84s 2020-11-20T12:17:29.149 INFO:tasks.workunit.client.0.smithi093.stderr: 92550K .......... .......... .......... .......... .......... 54% 740K 84s 2020-11-20T12:17:29.207 INFO:tasks.workunit.client.0.smithi093.stderr: 92600K .......... .......... .......... .......... .......... 54% 859K 84s 2020-11-20T12:17:29.264 INFO:tasks.workunit.client.0.smithi093.stderr: 92650K .......... .......... .......... .......... .......... 54% 878K 84s 2020-11-20T12:17:29.315 INFO:tasks.workunit.client.0.smithi093.stderr: 92700K .......... .......... .......... .......... .......... 55% 974K 84s 2020-11-20T12:17:29.380 INFO:tasks.workunit.client.0.smithi093.stderr: 92750K .......... .......... .......... .......... .......... 55% 776K 84s 2020-11-20T12:17:29.452 INFO:tasks.workunit.client.0.smithi093.stderr: 92800K .......... .......... .......... .......... .......... 55% 696K 84s 2020-11-20T12:17:29.515 INFO:tasks.workunit.client.0.smithi093.stderr: 92850K .......... .......... .......... .......... .......... 55% 786K 84s 2020-11-20T12:17:29.561 INFO:tasks.workunit.client.0.smithi093.stderr: 92900K .......... .......... .......... .......... .......... 55% 1.06M 84s 2020-11-20T12:17:29.614 INFO:tasks.workunit.client.0.smithi093.stderr: 92950K .......... .......... .......... .......... .......... 55% 941K 84s 2020-11-20T12:17:29.689 INFO:tasks.workunit.client.0.smithi093.stderr: 93000K .......... .......... .......... .......... .......... 55% 667K 84s 2020-11-20T12:17:29.757 INFO:tasks.workunit.client.0.smithi093.stderr: 93050K .......... .......... .......... .......... .......... 55% 733K 84s 2020-11-20T12:17:29.858 INFO:tasks.workunit.client.0.smithi093.stderr: 93100K .......... .......... .......... .......... .......... 55% 499K 84s 2020-11-20T12:17:29.898 INFO:tasks.workunit.client.0.smithi093.stderr: 93150K .......... .......... .......... .......... .......... 55% 3.13M 84s 2020-11-20T12:17:29.968 INFO:tasks.workunit.client.0.smithi093.stderr: 93200K .......... .......... .......... .......... .......... 55% 529K 84s 2020-11-20T12:17:30.036 INFO:tasks.workunit.client.0.smithi093.stderr: 93250K .......... .......... .......... .......... .......... 55% 739K 84s 2020-11-20T12:17:30.115 INFO:tasks.workunit.client.0.smithi093.stderr: 93300K .......... .......... .......... .......... .......... 55% 816K 84s 2020-11-20T12:17:30.162 INFO:tasks.workunit.client.0.smithi093.stderr: 93350K .......... .......... .......... .......... .......... 55% 772K 84s 2020-11-20T12:17:30.230 INFO:tasks.workunit.client.0.smithi093.stderr: 93400K .......... .......... .......... .......... .......... 55% 738K 84s 2020-11-20T12:17:30.294 INFO:tasks.workunit.client.0.smithi093.stderr: 93450K .......... .......... .......... .......... .......... 55% 772K 84s 2020-11-20T12:17:30.344 INFO:tasks.workunit.client.0.smithi093.stderr: 93500K .......... .......... .......... .......... .......... 55% 1001K 83s 2020-11-20T12:17:30.405 INFO:tasks.workunit.client.0.smithi093.stderr: 93550K .......... .......... .......... .......... .......... 55% 828K 83s 2020-11-20T12:17:30.471 INFO:tasks.workunit.client.0.smithi093.stderr: 93600K .......... .......... .......... .......... .......... 55% 752K 83s 2020-11-20T12:17:30.541 INFO:tasks.workunit.client.0.smithi093.stderr: 93650K .......... .......... .......... .......... .......... 55% 751K 83s 2020-11-20T12:17:30.610 INFO:tasks.workunit.client.0.smithi093.stderr: 93700K .......... .......... .......... .......... .......... 55% 690K 83s 2020-11-20T12:17:30.681 INFO:tasks.workunit.client.0.smithi093.stderr: 93750K .......... .......... .......... .......... .......... 55% 720K 83s 2020-11-20T12:17:30.749 INFO:tasks.workunit.client.0.smithi093.stderr: 93800K .......... .......... .......... .......... .......... 55% 717K 83s 2020-11-20T12:17:30.819 INFO:tasks.workunit.client.0.smithi093.stderr: 93850K .......... .......... .......... .......... .......... 55% 721K 83s 2020-11-20T12:17:30.893 INFO:tasks.workunit.client.0.smithi093.stderr: 93900K .......... .......... .......... .......... .......... 55% 670K 83s 2020-11-20T12:17:30.955 INFO:tasks.workunit.client.0.smithi093.stderr: 93950K .......... .......... .......... .......... .......... 55% 804K 83s 2020-11-20T12:17:31.012 INFO:tasks.workunit.client.0.smithi093.stderr: 94000K .......... .......... .......... .......... .......... 55% 886K 83s 2020-11-20T12:17:31.067 INFO:tasks.workunit.client.0.smithi093.stderr: 94050K .......... .......... .......... .......... .......... 55% 902K 83s 2020-11-20T12:17:31.136 INFO:tasks.workunit.client.0.smithi093.stderr: 94100K .......... .......... .......... .......... .......... 55% 758K 83s 2020-11-20T12:17:31.209 INFO:tasks.workunit.client.0.smithi093.stderr: 94150K .......... .......... .......... .......... .......... 55% 657K 83s 2020-11-20T12:17:31.289 INFO:tasks.workunit.client.0.smithi093.stderr: 94200K .......... .......... .......... .......... .......... 55% 651K 83s 2020-11-20T12:17:31.353 INFO:tasks.workunit.client.0.smithi093.stderr: 94250K .......... .......... .......... .......... .......... 55% 752K 83s 2020-11-20T12:17:31.412 INFO:tasks.workunit.client.0.smithi093.stderr: 94300K .......... .......... .......... .......... .......... 55% 851K 83s 2020-11-20T12:17:31.467 INFO:tasks.workunit.client.0.smithi093.stderr: 94350K .......... .......... .......... .......... .......... 56% 1.02M 83s 2020-11-20T12:17:31.592 INFO:tasks.workunit.client.0.smithi093.stderr: 94400K .......... .......... .......... .......... .......... 56% 377K 83s 2020-11-20T12:17:31.615 INFO:tasks.workunit.client.0.smithi093.stderr: 94450K .......... .......... .......... .......... .......... 56% 2.08M 83s 2020-11-20T12:17:31.695 INFO:tasks.workunit.client.0.smithi093.stderr: 94500K .......... .......... .......... .......... .......... 56% 631K 83s 2020-11-20T12:17:31.774 INFO:tasks.workunit.client.0.smithi093.stderr: 94550K .......... .......... .......... .......... .......... 56% 631K 83s 2020-11-20T12:17:31.833 INFO:tasks.workunit.client.0.smithi093.stderr: 94600K .......... .......... .......... .......... .......... 56% 847K 82s 2020-11-20T12:17:31.893 INFO:tasks.workunit.client.0.smithi093.stderr: 94650K .......... .......... .......... .......... .......... 56% 838K 82s 2020-11-20T12:17:31.945 INFO:tasks.workunit.client.0.smithi093.stderr: 94700K .......... .......... .......... .......... .......... 56% 950K 82s 2020-11-20T12:17:32.003 INFO:tasks.workunit.client.0.smithi093.stderr: 94750K .......... .......... .......... .......... .......... 56% 860K 82s 2020-11-20T12:17:32.062 INFO:tasks.workunit.client.0.smithi093.stderr: 94800K .......... .......... .......... .......... .......... 56% 856K 82s 2020-11-20T12:17:32.123 INFO:tasks.workunit.client.0.smithi093.stderr: 94850K .......... .......... .......... .......... .......... 56% 823K 82s 2020-11-20T12:17:32.183 INFO:tasks.workunit.client.0.smithi093.stderr: 94900K .......... .......... .......... .......... .......... 56% 858K 82s 2020-11-20T12:17:32.244 INFO:tasks.workunit.client.0.smithi093.stderr: 94950K .......... .......... .......... .......... .......... 56% 793K 82s 2020-11-20T12:17:32.310 INFO:tasks.workunit.client.0.smithi093.stderr: 95000K .......... .......... .......... .......... .......... 56% 1.08M 82s 2020-11-20T12:17:32.351 INFO:tasks.workunit.client.0.smithi093.stderr: 95050K .......... .......... .......... .......... .......... 56% 804K 82s 2020-11-20T12:17:32.399 INFO:tasks.workunit.client.0.smithi093.stderr: 95100K .......... .......... .......... .......... .......... 56% 1.02M 82s 2020-11-20T12:17:32.465 INFO:tasks.workunit.client.0.smithi093.stderr: 95150K .......... .......... .......... .......... .......... 56% 761K 82s 2020-11-20T12:17:32.525 INFO:tasks.workunit.client.0.smithi093.stderr: 95200K .......... .......... .......... .......... .......... 56% 832K 82s 2020-11-20T12:17:32.592 INFO:tasks.workunit.client.0.smithi093.stderr: 95250K .......... .......... .......... .......... .......... 56% 748K 82s 2020-11-20T12:17:32.657 INFO:tasks.workunit.client.0.smithi093.stderr: 95300K .......... .......... .......... .......... .......... 56% 772K 82s 2020-11-20T12:17:32.716 INFO:tasks.workunit.client.0.smithi093.stderr: 95350K .......... .......... .......... .......... .......... 56% 845K 82s 2020-11-20T12:17:32.785 INFO:tasks.workunit.client.0.smithi093.stderr: 95400K .......... .......... .......... .......... .......... 56% 717K 82s 2020-11-20T12:17:32.853 INFO:tasks.workunit.client.0.smithi093.stderr: 95450K .......... .......... .......... .......... .......... 56% 1.12M 82s 2020-11-20T12:17:32.882 INFO:tasks.workunit.client.0.smithi093.stderr: 95500K .......... .......... .......... .......... .......... 56% 936K 81s 2020-11-20T12:17:32.949 INFO:tasks.workunit.client.0.smithi093.stderr: 95550K .......... .......... .......... .......... .......... 56% 754K 81s 2020-11-20T12:17:33.024 INFO:tasks.workunit.client.0.smithi093.stderr: 95600K .......... .......... .......... .......... .......... 56% 667K 81s 2020-11-20T12:17:33.096 INFO:tasks.workunit.client.0.smithi093.stderr: 95650K .......... .......... .......... .......... .......... 56% 695K 81s 2020-11-20T12:17:33.160 INFO:tasks.workunit.client.0.smithi093.stderr: 95700K .......... .......... .......... .......... .......... 56% 803K 81s 2020-11-20T12:17:33.230 INFO:tasks.workunit.client.0.smithi093.stderr: 95750K .......... .......... .......... .......... .......... 56% 696K 81s 2020-11-20T12:17:33.266 INFO:tasks.workunit.client.0.smithi093.stderr: 95800K .......... .......... .......... .......... .......... 56% 1.36M 81s 2020-11-20T12:17:33.332 INFO:tasks.workunit.client.0.smithi093.stderr: 95850K .......... .......... .......... .......... .......... 56% 754K 81s 2020-11-20T12:17:33.412 INFO:tasks.workunit.client.0.smithi093.stderr: 95900K .......... .......... .......... .......... .......... 56% 672K 81s 2020-11-20T12:17:33.545 INFO:tasks.workunit.client.0.smithi093.stderr: 95950K .......... .......... .......... .......... .......... 56% 362K 81s 2020-11-20T12:17:33.552 INFO:tasks.workunit.client.0.smithi093.stderr: 96000K .......... .......... .......... .......... .......... 56% 6.06M 81s 2020-11-20T12:17:33.636 INFO:tasks.workunit.client.0.smithi093.stderr: 96050K .......... .......... .......... .......... .......... 57% 602K 81s 2020-11-20T12:17:33.705 INFO:tasks.workunit.client.0.smithi093.stderr: 96100K .......... .......... .......... .......... .......... 57% 720K 81s 2020-11-20T12:17:33.777 INFO:tasks.workunit.client.0.smithi093.stderr: 96150K .......... .......... .......... .......... .......... 57% 726K 81s 2020-11-20T12:17:33.841 INFO:tasks.workunit.client.0.smithi093.stderr: 96200K .......... .......... .......... .......... .......... 57% 749K 81s 2020-11-20T12:17:33.902 INFO:tasks.workunit.client.0.smithi093.stderr: 96250K .......... .......... .......... .......... .......... 57% 813K 81s 2020-11-20T12:17:33.967 INFO:tasks.workunit.client.0.smithi093.stderr: 96300K .......... .......... .......... .......... .......... 57% 765K 81s 2020-11-20T12:17:34.035 INFO:tasks.workunit.client.0.smithi093.stderr: 96350K .......... .......... .......... .......... .......... 57% 740K 81s 2020-11-20T12:17:34.103 INFO:tasks.workunit.client.0.smithi093.stderr: 96400K .......... .......... .......... .......... .......... 57% 740K 81s 2020-11-20T12:17:34.171 INFO:tasks.workunit.client.0.smithi093.stderr: 96450K .......... .......... .......... .......... .......... 57% 772K 81s 2020-11-20T12:17:34.236 INFO:tasks.workunit.client.0.smithi093.stderr: 96500K .......... .......... .......... .......... .......... 57% 729K 81s 2020-11-20T12:17:34.307 INFO:tasks.workunit.client.0.smithi093.stderr: 96550K .......... .......... .......... .......... .......... 57% 710K 80s 2020-11-20T12:17:34.358 INFO:tasks.workunit.client.0.smithi093.stderr: 96600K .......... .......... .......... .......... .......... 57% 964K 80s 2020-11-20T12:17:34.428 INFO:tasks.workunit.client.0.smithi093.stderr: 96650K .......... .......... .......... .......... .......... 57% 714K 80s 2020-11-20T12:17:34.499 INFO:tasks.workunit.client.0.smithi093.stderr: 96700K .......... .......... .......... .......... .......... 57% 927K 80s 2020-11-20T12:17:34.558 INFO:tasks.workunit.client.0.smithi093.stderr: 96750K .......... .......... .......... .......... .......... 57% 662K 80s 2020-11-20T12:17:34.630 INFO:tasks.workunit.client.0.smithi093.stderr: 96800K .......... .......... .......... .......... .......... 57% 690K 80s 2020-11-20T12:17:34.691 INFO:tasks.workunit.client.0.smithi093.stderr: 96850K .......... .......... .......... .......... .......... 57% 821K 80s 2020-11-20T12:17:34.762 INFO:tasks.workunit.client.0.smithi093.stderr: 96900K .......... .......... .......... .......... .......... 57% 761K 80s 2020-11-20T12:17:34.823 INFO:tasks.workunit.client.0.smithi093.stderr: 96950K .......... .......... .......... .......... .......... 57% 772K 80s 2020-11-20T12:17:34.888 INFO:tasks.workunit.client.0.smithi093.stderr: 97000K .......... .......... .......... .......... .......... 57% 760K 80s 2020-11-20T12:17:35.040 INFO:tasks.workunit.client.0.smithi093.stderr: 97050K .......... .......... .......... .......... .......... 57% 329K 80s 2020-11-20T12:17:35.040 INFO:tasks.workunit.client.0.smithi093.stderr: 97100K .......... .......... .......... .......... .......... 57% 219M 80s 2020-11-20T12:17:35.124 INFO:tasks.workunit.client.0.smithi093.stderr: 97150K .......... .......... .......... .......... .......... 57% 591K 80s 2020-11-20T12:17:35.211 INFO:tasks.workunit.client.0.smithi093.stderr: 97200K .......... .......... .......... .......... .......... 57% 580K 80s 2020-11-20T12:17:35.287 INFO:tasks.workunit.client.0.smithi093.stderr: 97250K .......... .......... .......... .......... .......... 57% 691K 80s 2020-11-20T12:17:35.349 INFO:tasks.workunit.client.0.smithi093.stderr: 97300K .......... .......... .......... .......... .......... 57% 762K 80s 2020-11-20T12:17:35.409 INFO:tasks.workunit.client.0.smithi093.stderr: 97350K .......... .......... .......... .......... .......... 57% 825K 80s 2020-11-20T12:17:35.483 INFO:tasks.workunit.client.0.smithi093.stderr: 97400K .......... .......... .......... .......... .......... 57% 674K 80s 2020-11-20T12:17:35.548 INFO:tasks.workunit.client.0.smithi093.stderr: 97450K .......... .......... .......... .......... .......... 57% 772K 80s 2020-11-20T12:17:35.625 INFO:tasks.workunit.client.0.smithi093.stderr: 97500K .......... .......... .......... .......... .......... 57% 653K 80s 2020-11-20T12:17:35.693 INFO:tasks.workunit.client.0.smithi093.stderr: 97550K .......... .......... .......... .......... .......... 57% 728K 80s 2020-11-20T12:17:35.762 INFO:tasks.workunit.client.0.smithi093.stderr: 97600K .......... .......... .......... .......... .......... 57% 738K 80s 2020-11-20T12:17:35.833 INFO:tasks.workunit.client.0.smithi093.stderr: 97650K .......... .......... .......... .......... .......... 57% 696K 79s 2020-11-20T12:17:35.901 INFO:tasks.workunit.client.0.smithi093.stderr: 97700K .......... .......... .......... .......... .......... 57% 738K 79s 2020-11-20T12:17:35.968 INFO:tasks.workunit.client.0.smithi093.stderr: 97750K .......... .......... .......... .......... .......... 58% 736K 79s 2020-11-20T12:17:36.040 INFO:tasks.workunit.client.0.smithi093.stderr: 97800K .......... .......... .......... .......... .......... 58% 698K 79s 2020-11-20T12:17:36.115 INFO:tasks.workunit.client.0.smithi093.stderr: 97850K .......... .......... .......... .......... .......... 58% 669K 79s 2020-11-20T12:17:36.188 INFO:tasks.workunit.client.0.smithi093.stderr: 97900K .......... .......... .......... .......... .......... 58% 687K 79s 2020-11-20T12:17:36.247 INFO:tasks.workunit.client.0.smithi093.stderr: 97950K .......... .......... .......... .......... .......... 58% 912K 79s 2020-11-20T12:17:36.317 INFO:tasks.workunit.client.0.smithi093.stderr: 98000K .......... .......... .......... .......... .......... 58% 671K 79s 2020-11-20T12:17:36.373 INFO:tasks.workunit.client.0.smithi093.stderr: 98050K .......... .......... .......... .......... .......... 58% 917K 79s 2020-11-20T12:17:36.448 INFO:tasks.workunit.client.0.smithi093.stderr: 98100K .......... .......... .......... .......... .......... 58% 657K 79s 2020-11-20T12:17:36.526 INFO:tasks.workunit.client.0.smithi093.stderr: 98150K .......... .......... .......... .......... .......... 58% 650K 79s 2020-11-20T12:17:36.592 INFO:tasks.workunit.client.0.smithi093.stderr: 98200K .......... .......... .......... .......... .......... 58% 737K 79s 2020-11-20T12:17:36.654 INFO:tasks.workunit.client.0.smithi093.stderr: 98250K .......... .......... .......... .......... .......... 58% 814K 79s 2020-11-20T12:17:36.730 INFO:tasks.workunit.client.0.smithi093.stderr: 98300K .......... .......... .......... .......... .......... 58% 658K 79s 2020-11-20T12:17:36.808 INFO:tasks.workunit.client.0.smithi093.stderr: 98350K .......... .......... .......... .......... .......... 58% 641K 79s 2020-11-20T12:17:36.864 INFO:tasks.workunit.client.0.smithi093.stderr: 98400K .......... .......... .......... .......... .......... 58% 896K 79s 2020-11-20T12:17:36.920 INFO:tasks.workunit.client.0.smithi093.stderr: 98450K .......... .......... .......... .......... .......... 58% 880K 79s 2020-11-20T12:17:36.988 INFO:tasks.workunit.client.0.smithi093.stderr: 98500K .......... .......... .......... .......... .......... 58% 761K 79s 2020-11-20T12:17:37.049 INFO:tasks.workunit.client.0.smithi093.stderr: 98550K .......... .......... .......... .......... .......... 58% 795K 79s 2020-11-20T12:17:37.111 INFO:tasks.workunit.client.0.smithi093.stderr: 98600K .......... .......... .......... .......... .......... 58% 844K 79s 2020-11-20T12:17:37.170 INFO:tasks.workunit.client.0.smithi093.stderr: 98650K .......... .......... .......... .......... .......... 58% 819K 79s 2020-11-20T12:17:37.220 INFO:tasks.workunit.client.0.smithi093.stderr: 98700K .......... .......... .......... .......... .......... 58% 988K 78s 2020-11-20T12:17:37.258 INFO:tasks.workunit.client.0.smithi093.stderr: 98750K .......... .......... .......... .......... .......... 58% 1.27M 78s 2020-11-20T12:17:37.317 INFO:tasks.workunit.client.0.smithi093.stderr: 98800K .......... .......... .......... .......... .......... 58% 855K 78s 2020-11-20T12:17:37.371 INFO:tasks.workunit.client.0.smithi093.stderr: 98850K .......... .......... .......... .......... .......... 58% 925K 78s 2020-11-20T12:17:37.424 INFO:tasks.workunit.client.0.smithi093.stderr: 98900K .......... .......... .......... .......... .......... 58% 943K 78s 2020-11-20T12:17:37.474 INFO:tasks.workunit.client.0.smithi093.stderr: 98950K .......... .......... .......... .......... .......... 58% 1.01M 78s 2020-11-20T12:17:37.677 INFO:tasks.workunit.client.0.smithi093.stderr: 99000K .......... .......... .......... .......... .......... 58% 245K 78s 2020-11-20T12:17:37.678 INFO:tasks.workunit.client.0.smithi093.stderr: 99050K .......... .......... .......... .......... .......... 58% 524M 78s 2020-11-20T12:17:37.737 INFO:tasks.workunit.client.0.smithi093.stderr: 99100K .......... .......... .......... .......... .......... 58% 824K 78s 2020-11-20T12:17:37.819 INFO:tasks.workunit.client.0.smithi093.stderr: 99150K .......... .......... .......... .......... .......... 58% 614K 78s 2020-11-20T12:17:37.885 INFO:tasks.workunit.client.0.smithi093.stderr: 99200K .......... .......... .......... .......... .......... 58% 750K 78s 2020-11-20T12:17:37.944 INFO:tasks.workunit.client.0.smithi093.stderr: 99250K .......... .......... .......... .......... .......... 58% 852K 78s 2020-11-20T12:17:38.006 INFO:tasks.workunit.client.0.smithi093.stderr: 99300K .......... .......... .......... .......... .......... 58% 808K 78s 2020-11-20T12:17:38.069 INFO:tasks.workunit.client.0.smithi093.stderr: 99350K .......... .......... .......... .......... .......... 58% 787K 78s 2020-11-20T12:17:38.133 INFO:tasks.workunit.client.0.smithi093.stderr: 99400K .......... .......... .......... .......... .......... 58% 794K 78s 2020-11-20T12:17:38.200 INFO:tasks.workunit.client.0.smithi093.stderr: 99450K .......... .......... .......... .......... .......... 59% 739K 78s 2020-11-20T12:17:38.268 INFO:tasks.workunit.client.0.smithi093.stderr: 99500K .......... .......... .......... .......... .......... 59% 751K 78s 2020-11-20T12:17:38.339 INFO:tasks.workunit.client.0.smithi093.stderr: 99550K .......... .......... .......... .......... .......... 59% 688K 78s 2020-11-20T12:17:38.398 INFO:tasks.workunit.client.0.smithi093.stderr: 99600K .......... .......... .......... .......... .......... 59% 847K 78s 2020-11-20T12:17:38.458 INFO:tasks.workunit.client.0.smithi093.stderr: 99650K .......... .......... .......... .......... .......... 59% 837K 78s 2020-11-20T12:17:38.520 INFO:tasks.workunit.client.0.smithi093.stderr: 99700K .......... .......... .......... .......... .......... 59% 806K 77s 2020-11-20T12:17:38.584 INFO:tasks.workunit.client.0.smithi093.stderr: 99750K .......... .......... .......... .......... .......... 59% 781K 77s 2020-11-20T12:17:38.641 INFO:tasks.workunit.client.0.smithi093.stderr: 99800K .......... .......... .......... .......... .......... 59% 882K 77s 2020-11-20T12:17:38.696 INFO:tasks.workunit.client.0.smithi093.stderr: 99850K .......... .......... .......... .......... .......... 59% 912K 77s 2020-11-20T12:17:38.743 INFO:tasks.workunit.client.0.smithi093.stderr: 99900K .......... .......... .......... .......... .......... 59% 1.08M 77s 2020-11-20T12:17:38.798 INFO:tasks.workunit.client.0.smithi093.stderr: 99950K .......... .......... .......... .......... .......... 59% 981K 77s 2020-11-20T12:17:38.855 INFO:tasks.workunit.client.0.smithi093.stderr:100000K .......... .......... .......... .......... .......... 59% 795K 77s 2020-11-20T12:17:38.901 INFO:tasks.workunit.client.0.smithi093.stderr:100050K .......... .......... .......... .......... .......... 59% 1.05M 77s 2020-11-20T12:17:38.965 INFO:tasks.workunit.client.0.smithi093.stderr:100100K .......... .......... .......... .......... .......... 59% 778K 77s 2020-11-20T12:17:39.019 INFO:tasks.workunit.client.0.smithi093.stderr:100150K .......... .......... .......... .......... .......... 59% 930K 77s 2020-11-20T12:17:39.068 INFO:tasks.workunit.client.0.smithi093.stderr:100200K .......... .......... .......... .......... .......... 59% 1015K 77s 2020-11-20T12:17:39.125 INFO:tasks.workunit.client.0.smithi093.stderr:100250K .......... .......... .......... .......... .......... 59% 880K 77s 2020-11-20T12:17:39.173 INFO:tasks.workunit.client.0.smithi093.stderr:100300K .......... .......... .......... .......... .......... 59% 1.05M 77s 2020-11-20T12:17:39.238 INFO:tasks.workunit.client.0.smithi093.stderr:100350K .......... .......... .......... .......... .......... 59% 756K 77s 2020-11-20T12:17:39.296 INFO:tasks.workunit.client.0.smithi093.stderr:100400K .......... .......... .......... .......... .......... 59% 859K 77s 2020-11-20T12:17:39.346 INFO:tasks.workunit.client.0.smithi093.stderr:100450K .......... .......... .......... .......... .......... 59% 1006K 77s 2020-11-20T12:17:39.408 INFO:tasks.workunit.client.0.smithi093.stderr:100500K .......... .......... .......... .......... .......... 59% 810K 77s 2020-11-20T12:17:39.459 INFO:tasks.workunit.client.0.smithi093.stderr:100550K .......... .......... .......... .......... .......... 59% 987K 76s 2020-11-20T12:17:39.525 INFO:tasks.workunit.client.0.smithi093.stderr:100600K .......... .......... .......... .......... .......... 59% 744K 76s 2020-11-20T12:17:39.584 INFO:tasks.workunit.client.0.smithi093.stderr:100650K .......... .......... .......... .......... .......... 59% 859K 76s 2020-11-20T12:17:39.640 INFO:tasks.workunit.client.0.smithi093.stderr:100700K .......... .......... .......... .......... .......... 59% 882K 76s 2020-11-20T12:17:39.707 INFO:tasks.workunit.client.0.smithi093.stderr:100750K .......... .......... .......... .......... .......... 59% 1.02M 76s 2020-11-20T12:17:39.760 INFO:tasks.workunit.client.0.smithi093.stderr:100800K .......... .......... .......... .......... .......... 59% 703K 76s 2020-11-20T12:17:39.817 INFO:tasks.workunit.client.0.smithi093.stderr:100850K .......... .......... .......... .......... .......... 59% 873K 76s 2020-11-20T12:17:39.877 INFO:tasks.workunit.client.0.smithi093.stderr:100900K .......... .......... .......... .......... .......... 59% 822K 76s 2020-11-20T12:17:39.942 INFO:tasks.workunit.client.0.smithi093.stderr:100950K .......... .......... .......... .......... .......... 59% 777K 76s 2020-11-20T12:17:40.038 INFO:tasks.workunit.client.0.smithi093.stderr:101000K .......... .......... .......... .......... .......... 59% 527K 76s 2020-11-20T12:17:40.070 INFO:tasks.workunit.client.0.smithi093.stderr:101050K .......... .......... .......... .......... .......... 59% 1.49M 76s 2020-11-20T12:17:40.146 INFO:tasks.workunit.client.0.smithi093.stderr:101100K .......... .......... .......... .......... .......... 60% 656K 76s 2020-11-20T12:17:40.220 INFO:tasks.workunit.client.0.smithi093.stderr:101150K .......... .......... .......... .......... .......... 60% 674K 76s 2020-11-20T12:17:40.293 INFO:tasks.workunit.client.0.smithi093.stderr:101200K .......... .......... .......... .......... .......... 60% 704K 76s 2020-11-20T12:17:40.359 INFO:tasks.workunit.client.0.smithi093.stderr:101250K .......... .......... .......... .......... .......... 60% 733K 76s 2020-11-20T12:17:40.432 INFO:tasks.workunit.client.0.smithi093.stderr:101300K .......... .......... .......... .......... .......... 60% 747K 76s 2020-11-20T12:17:40.505 INFO:tasks.workunit.client.0.smithi093.stderr:101350K .......... .......... .......... .......... .......... 60% 637K 76s 2020-11-20T12:17:40.574 INFO:tasks.workunit.client.0.smithi093.stderr:101400K .......... .......... .......... .......... .......... 60% 721K 76s 2020-11-20T12:17:40.646 INFO:tasks.workunit.client.0.smithi093.stderr:101450K .......... .......... .......... .......... .......... 60% 692K 76s 2020-11-20T12:17:40.707 INFO:tasks.workunit.client.0.smithi093.stderr:101500K .......... .......... .......... .......... .......... 60% 830K 76s 2020-11-20T12:17:40.775 INFO:tasks.workunit.client.0.smithi093.stderr:101550K .......... .......... .......... .......... .......... 60% 730K 75s 2020-11-20T12:17:40.853 INFO:tasks.workunit.client.0.smithi093.stderr:101600K .......... .......... .......... .......... .......... 60% 643K 75s 2020-11-20T12:17:40.947 INFO:tasks.workunit.client.0.smithi093.stderr:101650K .......... .......... .......... .......... .......... 60% 533K 75s 2020-11-20T12:17:41.013 INFO:tasks.workunit.client.0.smithi093.stderr:101700K .......... .......... .......... .......... .......... 60% 750K 75s 2020-11-20T12:17:41.165 INFO:tasks.workunit.client.0.smithi093.stderr:101750K .......... .......... .......... .......... .......... 60% 330K 75s 2020-11-20T12:17:41.204 INFO:tasks.workunit.client.0.smithi093.stderr:101800K .......... .......... .......... .......... .......... 60% 1.23M 75s 2020-11-20T12:17:41.344 INFO:tasks.workunit.client.0.smithi093.stderr:101850K .......... .......... .......... .......... .......... 60% 359K 75s 2020-11-20T12:17:41.448 INFO:tasks.workunit.client.0.smithi093.stderr:101900K .......... .......... .......... .......... .......... 60% 487K 75s 2020-11-20T12:17:41.545 INFO:tasks.workunit.client.0.smithi093.stderr:101950K .......... .......... .......... .......... .......... 60% 509K 75s 2020-11-20T12:17:41.654 INFO:tasks.workunit.client.0.smithi093.stderr:102000K .......... .......... .......... .......... .......... 60% 461K 75s 2020-11-20T12:17:41.769 INFO:tasks.workunit.client.0.smithi093.stderr:102050K .......... .......... .......... .......... .......... 60% 431K 75s 2020-11-20T12:17:41.884 INFO:tasks.workunit.client.0.smithi093.stderr:102100K .......... .......... .......... .......... .......... 60% 561K 75s 2020-11-20T12:17:41.981 INFO:tasks.workunit.client.0.smithi093.stderr:102150K .......... .......... .......... .......... .......... 60% 409K 75s 2020-11-20T12:17:42.097 INFO:tasks.workunit.client.0.smithi093.stderr:102200K .......... .......... .......... .......... .......... 60% 429K 75s 2020-11-20T12:17:42.198 INFO:tasks.workunit.client.0.smithi093.stderr:102250K .......... .......... .......... .......... .......... 60% 498K 75s 2020-11-20T12:17:42.273 INFO:tasks.workunit.client.0.smithi093.stderr:102300K .......... .......... .......... .......... .......... 60% 666K 75s 2020-11-20T12:17:42.377 INFO:tasks.workunit.client.0.smithi093.stderr:102350K .......... .......... .......... .......... .......... 60% 479K 75s 2020-11-20T12:17:42.454 INFO:tasks.workunit.client.0.smithi093.stderr:102400K .......... .......... .......... .......... .......... 60% 651K 75s 2020-11-20T12:17:42.554 INFO:tasks.workunit.client.0.smithi093.stderr:102450K .......... .......... .......... .......... .......... 60% 682K 75s 2020-11-20T12:17:42.629 INFO:tasks.workunit.client.0.smithi093.stderr:102500K .......... .......... .......... .......... .......... 60% 495K 75s 2020-11-20T12:17:42.715 INFO:tasks.workunit.client.0.smithi093.stderr:102550K .......... .......... .......... .......... .......... 60% 578K 75s 2020-11-20T12:17:42.796 INFO:tasks.workunit.client.0.smithi093.stderr:102600K .......... .......... .......... .......... .......... 60% 614K 75s 2020-11-20T12:17:42.895 INFO:tasks.workunit.client.0.smithi093.stderr:102650K .......... .......... .......... .......... .......... 60% 510K 75s 2020-11-20T12:17:42.975 INFO:tasks.workunit.client.0.smithi093.stderr:102700K .......... .......... .......... .......... .......... 60% 619K 75s 2020-11-20T12:17:43.064 INFO:tasks.workunit.client.0.smithi093.stderr:102750K .......... .......... .......... .......... .......... 60% 563K 75s 2020-11-20T12:17:43.145 INFO:tasks.workunit.client.0.smithi093.stderr:102800K .......... .......... .......... .......... .......... 61% 617K 75s 2020-11-20T12:17:43.219 INFO:tasks.workunit.client.0.smithi093.stderr:102850K .......... .......... .......... .......... .......... 61% 675K 75s 2020-11-20T12:17:43.295 INFO:tasks.workunit.client.0.smithi093.stderr:102900K .......... .......... .......... .......... .......... 61% 663K 75s 2020-11-20T12:17:43.370 INFO:tasks.workunit.client.0.smithi093.stderr:102950K .......... .......... .......... .......... .......... 61% 663K 75s 2020-11-20T12:17:43.448 INFO:tasks.workunit.client.0.smithi093.stderr:103000K .......... .......... .......... .......... .......... 61% 642K 75s 2020-11-20T12:17:43.526 INFO:tasks.workunit.client.0.smithi093.stderr:103050K .......... .......... .......... .......... .......... 61% 639K 74s 2020-11-20T12:17:43.690 INFO:tasks.workunit.client.0.smithi093.stderr:103100K .......... .......... .......... .......... .......... 61% 621K 74s 2020-11-20T12:17:43.691 INFO:tasks.workunit.client.0.smithi093.stderr:103150K .......... .......... .......... .......... .......... 61% 599K 74s 2020-11-20T12:17:43.798 INFO:tasks.workunit.client.0.smithi093.stderr:103200K .......... .......... .......... .......... .......... 61% 462K 74s 2020-11-20T12:17:43.888 INFO:tasks.workunit.client.0.smithi093.stderr:103250K .......... .......... .......... .......... .......... 61% 605K 74s 2020-11-20T12:17:43.952 INFO:tasks.workunit.client.0.smithi093.stderr:103300K .......... .......... .......... .......... .......... 61% 698K 74s 2020-11-20T12:17:44.023 INFO:tasks.workunit.client.0.smithi093.stderr:103350K .......... .......... .......... .......... .......... 61% 707K 74s 2020-11-20T12:17:44.116 INFO:tasks.workunit.client.0.smithi093.stderr:103400K .......... .......... .......... .......... .......... 61% 539K 74s 2020-11-20T12:17:44.186 INFO:tasks.workunit.client.0.smithi093.stderr:103450K .......... .......... .......... .......... .......... 61% 717K 74s 2020-11-20T12:17:44.260 INFO:tasks.workunit.client.0.smithi093.stderr:103500K .......... .......... .......... .......... .......... 61% 673K 74s 2020-11-20T12:17:44.332 INFO:tasks.workunit.client.0.smithi093.stderr:103550K .......... .......... .......... .......... .......... 61% 721K 74s 2020-11-20T12:17:44.401 INFO:tasks.workunit.client.0.smithi093.stderr:103600K .......... .......... .......... .......... .......... 61% 691K 74s 2020-11-20T12:17:44.483 INFO:tasks.workunit.client.0.smithi093.stderr:103650K .......... .......... .......... .......... .......... 61% 618K 74s 2020-11-20T12:17:44.559 INFO:tasks.workunit.client.0.smithi093.stderr:103700K .......... .......... .......... .......... .......... 61% 669K 74s 2020-11-20T12:17:44.627 INFO:tasks.workunit.client.0.smithi093.stderr:103750K .......... .......... .......... .......... .......... 61% 713K 74s 2020-11-20T12:17:44.698 INFO:tasks.workunit.client.0.smithi093.stderr:103800K .......... .......... .......... .......... .......... 61% 710K 74s 2020-11-20T12:17:44.799 INFO:tasks.workunit.client.0.smithi093.stderr:103850K .......... .......... .......... .......... .......... 61% 493K 74s 2020-11-20T12:17:44.877 INFO:tasks.workunit.client.0.smithi093.stderr:103900K .......... .......... .......... .......... .......... 61% 643K 74s 2020-11-20T12:17:44.951 INFO:tasks.workunit.client.0.smithi093.stderr:103950K .......... .......... .......... .......... .......... 61% 673K 74s 2020-11-20T12:17:45.026 INFO:tasks.workunit.client.0.smithi093.stderr:104000K .......... .......... .......... .......... .......... 61% 672K 74s 2020-11-20T12:17:45.103 INFO:tasks.workunit.client.0.smithi093.stderr:104050K .......... .......... .......... .......... .......... 61% 642K 74s 2020-11-20T12:17:45.181 INFO:tasks.workunit.client.0.smithi093.stderr:104100K .......... .......... .......... .......... .......... 61% 639K 74s 2020-11-20T12:17:45.260 INFO:tasks.workunit.client.0.smithi093.stderr:104150K .......... .......... .......... .......... .......... 61% 642K 74s 2020-11-20T12:17:45.342 INFO:tasks.workunit.client.0.smithi093.stderr:104200K .......... .......... .......... .......... .......... 61% 606K 73s 2020-11-20T12:17:45.890 INFO:tasks.workunit.client.0.smithi093.stderr:104250K .......... .......... .......... .......... .......... 61% 1016K 73s 2020-11-20T12:17:45.890 INFO:tasks.workunit.client.0.smithi093.stderr:104300K .......... .......... .......... .......... .......... 61% 649K 73s 2020-11-20T12:17:45.891 INFO:tasks.workunit.client.0.smithi093.stderr:104350K .......... .......... .......... .......... .......... 61% 683K 73s 2020-11-20T12:17:45.891 INFO:tasks.workunit.client.0.smithi093.stderr:104400K .......... .......... .......... .......... .......... 61% 679K 73s 2020-11-20T12:17:45.891 INFO:tasks.workunit.client.0.smithi093.stderr:104450K .......... .......... .......... .......... .......... 61% 708K 73s 2020-11-20T12:17:45.891 INFO:tasks.workunit.client.0.smithi093.stderr:104500K .......... .......... .......... .......... .......... 62% 819K 73s 2020-11-20T12:17:45.891 INFO:tasks.workunit.client.0.smithi093.stderr:104550K .......... .......... .......... .......... .......... 62% 757K 73s 2020-11-20T12:17:45.892 INFO:tasks.workunit.client.0.smithi093.stderr:104600K .......... .......... .......... .......... .......... 62% 773K 73s 2020-11-20T12:17:45.943 INFO:tasks.workunit.client.0.smithi093.stderr:104650K .......... .......... .......... .......... .......... 62% 765K 73s 2020-11-20T12:17:46.015 INFO:tasks.workunit.client.0.smithi093.stderr:104700K .......... .......... .......... .......... .......... 62% 708K 73s 2020-11-20T12:17:46.060 INFO:tasks.workunit.client.0.smithi093.stderr:104750K .......... .......... .......... .......... .......... 62% 1.04M 73s 2020-11-20T12:17:46.130 INFO:tasks.workunit.client.0.smithi093.stderr:104800K .......... .......... .......... .......... .......... 62% 721K 73s 2020-11-20T12:17:46.207 INFO:tasks.workunit.client.0.smithi093.stderr:104850K .......... .......... .......... .......... .......... 62% 649K 73s 2020-11-20T12:17:46.267 INFO:tasks.workunit.client.0.smithi093.stderr:104900K .......... .......... .......... .......... .......... 62% 905K 73s 2020-11-20T12:17:46.330 INFO:tasks.workunit.client.0.smithi093.stderr:104950K .......... .......... .......... .......... .......... 62% 734K 73s 2020-11-20T12:17:46.397 INFO:tasks.workunit.client.0.smithi093.stderr:105000K .......... .......... .......... .......... .......... 62% 754K 73s 2020-11-20T12:17:46.448 INFO:tasks.workunit.client.0.smithi093.stderr:105050K .......... .......... .......... .......... .......... 62% 1.01M 73s 2020-11-20T12:17:46.523 INFO:tasks.workunit.client.0.smithi093.stderr:105100K .......... .......... .......... .......... .......... 62% 639K 73s 2020-11-20T12:17:46.575 INFO:tasks.workunit.client.0.smithi093.stderr:105150K .......... .......... .......... .......... .......... 62% 950K 72s 2020-11-20T12:17:46.642 INFO:tasks.workunit.client.0.smithi093.stderr:105200K .......... .......... .......... .......... .......... 62% 799K 72s 2020-11-20T12:17:46.704 INFO:tasks.workunit.client.0.smithi093.stderr:105250K .......... .......... .......... .......... .......... 62% 756K 72s 2020-11-20T12:17:46.747 INFO:tasks.workunit.client.0.smithi093.stderr:105300K .......... .......... .......... .......... .......... 62% 1.16M 72s 2020-11-20T12:17:46.812 INFO:tasks.workunit.client.0.smithi093.stderr:105350K .......... .......... .......... .......... .......... 62% 934K 72s 2020-11-20T12:17:46.866 INFO:tasks.workunit.client.0.smithi093.stderr:105400K .......... .......... .......... .......... .......... 62% 763K 72s 2020-11-20T12:17:46.919 INFO:tasks.workunit.client.0.smithi093.stderr:105450K .......... .......... .......... .......... .......... 62% 945K 72s 2020-11-20T12:17:46.961 INFO:tasks.workunit.client.0.smithi093.stderr:105500K .......... .......... .......... .......... .......... 62% 1.21M 72s 2020-11-20T12:17:47.018 INFO:tasks.workunit.client.0.smithi093.stderr:105550K .......... .......... .......... .......... .......... 62% 844K 72s 2020-11-20T12:17:47.084 INFO:tasks.workunit.client.0.smithi093.stderr:105600K .......... .......... .......... .......... .......... 62% 854K 72s 2020-11-20T12:17:47.141 INFO:tasks.workunit.client.0.smithi093.stderr:105650K .......... .......... .......... .......... .......... 62% 771K 72s 2020-11-20T12:17:47.181 INFO:tasks.workunit.client.0.smithi093.stderr:105700K .......... .......... .......... .......... .......... 62% 1.22M 72s 2020-11-20T12:17:47.246 INFO:tasks.workunit.client.0.smithi093.stderr:105750K .......... .......... .......... .......... .......... 62% 844K 72s 2020-11-20T12:17:47.302 INFO:tasks.workunit.client.0.smithi093.stderr:105800K .......... .......... .......... .......... .......... 62% 812K 72s 2020-11-20T12:17:47.347 INFO:tasks.workunit.client.0.smithi093.stderr:105850K .......... .......... .......... .......... .......... 62% 1.10M 72s 2020-11-20T12:17:47.416 INFO:tasks.workunit.client.0.smithi093.stderr:105900K .......... .......... .......... .......... .......... 62% 717K 72s 2020-11-20T12:17:47.467 INFO:tasks.workunit.client.0.smithi093.stderr:105950K .......... .......... .......... .......... .......... 62% 1002K 72s 2020-11-20T12:17:47.510 INFO:tasks.workunit.client.0.smithi093.stderr:106000K .......... .......... .......... .......... .......... 62% 1.11M 71s 2020-11-20T12:17:47.578 INFO:tasks.workunit.client.0.smithi093.stderr:106050K .......... .......... .......... .......... .......... 62% 741K 71s 2020-11-20T12:17:47.631 INFO:tasks.workunit.client.0.smithi093.stderr:106100K .......... .......... .......... .......... .......... 62% 946K 71s 2020-11-20T12:17:47.692 INFO:tasks.workunit.client.0.smithi093.stderr:106150K .......... .......... .......... .......... .......... 63% 822K 71s 2020-11-20T12:17:47.739 INFO:tasks.workunit.client.0.smithi093.stderr:106200K .......... .......... .......... .......... .......... 63% 1.03M 71s 2020-11-20T12:17:47.789 INFO:tasks.workunit.client.0.smithi093.stderr:106250K .......... .......... .......... .......... .......... 63% 997K 71s 2020-11-20T12:17:47.842 INFO:tasks.workunit.client.0.smithi093.stderr:106300K .......... .......... .......... .......... .......... 63% 956K 71s 2020-11-20T12:17:47.882 INFO:tasks.workunit.client.0.smithi093.stderr:106350K .......... .......... .......... .......... .......... 63% 1.21M 71s 2020-11-20T12:17:47.927 INFO:tasks.workunit.client.0.smithi093.stderr:106400K .......... .......... .......... .......... .......... 63% 1.09M 71s 2020-11-20T12:17:47.977 INFO:tasks.workunit.client.0.smithi093.stderr:106450K .......... .......... .......... .......... .......... 63% 1015K 71s 2020-11-20T12:17:48.019 INFO:tasks.workunit.client.0.smithi093.stderr:106500K .......... .......... .......... .......... .......... 63% 1.13M 71s 2020-11-20T12:17:48.062 INFO:tasks.workunit.client.0.smithi093.stderr:106550K .......... .......... .......... .......... .......... 63% 1.13M 71s 2020-11-20T12:17:48.103 INFO:tasks.workunit.client.0.smithi093.stderr:106600K .......... .......... .......... .......... .......... 63% 1.23M 71s 2020-11-20T12:17:48.160 INFO:tasks.workunit.client.0.smithi093.stderr:106650K .......... .......... .......... .......... .......... 63% 864K 71s 2020-11-20T12:17:48.193 INFO:tasks.workunit.client.0.smithi093.stderr:106700K .......... .......... .......... .......... .......... 63% 1.45M 71s 2020-11-20T12:17:48.236 INFO:tasks.workunit.client.0.smithi093.stderr:106750K .......... .......... .......... .......... .......... 63% 1.14M 71s 2020-11-20T12:17:48.284 INFO:tasks.workunit.client.0.smithi093.stderr:106800K .......... .......... .......... .......... .......... 63% 1.02M 70s 2020-11-20T12:17:48.333 INFO:tasks.workunit.client.0.smithi093.stderr:106850K .......... .......... .......... .......... .......... 63% 1.02M 70s 2020-11-20T12:17:48.380 INFO:tasks.workunit.client.0.smithi093.stderr:106900K .......... .......... .......... .......... .......... 63% 1.01M 70s 2020-11-20T12:17:48.419 INFO:tasks.workunit.client.0.smithi093.stderr:106950K .......... .......... .......... .......... .......... 63% 1.26M 70s 2020-11-20T12:17:48.465 INFO:tasks.workunit.client.0.smithi093.stderr:107000K .......... .......... .......... .......... .......... 63% 1.06M 70s 2020-11-20T12:17:48.527 INFO:tasks.workunit.client.0.smithi093.stderr:107050K .......... .......... .......... .......... .......... 63% 1.11M 70s 2020-11-20T12:17:48.561 INFO:tasks.workunit.client.0.smithi093.stderr:107100K .......... .......... .......... .......... .......... 63% 977K 70s 2020-11-20T12:17:48.615 INFO:tasks.workunit.client.0.smithi093.stderr:107150K .......... .......... .......... .......... .......... 63% 934K 70s 2020-11-20T12:17:48.648 INFO:tasks.workunit.client.0.smithi093.stderr:107200K .......... .......... .......... .......... .......... 63% 1.45M 70s 2020-11-20T12:17:48.701 INFO:tasks.workunit.client.0.smithi093.stderr:107250K .......... .......... .......... .......... .......... 63% 940K 70s 2020-11-20T12:17:48.813 INFO:tasks.workunit.client.0.smithi093.stderr:107300K .......... .......... .......... .......... .......... 63% 448K 70s 2020-11-20T12:17:48.814 INFO:tasks.workunit.client.0.smithi093.stderr:107350K .......... .......... .......... .......... .......... 63% 466M 70s 2020-11-20T12:17:48.866 INFO:tasks.workunit.client.0.smithi093.stderr:107400K .......... .......... .......... .......... .......... 63% 968K 70s 2020-11-20T12:17:48.940 INFO:tasks.workunit.client.0.smithi093.stderr:107450K .......... .......... .......... .......... .......... 63% 669K 70s 2020-11-20T12:17:49.008 INFO:tasks.workunit.client.0.smithi093.stderr:107500K .......... .......... .......... .......... .......... 63% 747K 70s 2020-11-20T12:17:49.047 INFO:tasks.workunit.client.0.smithi093.stderr:107550K .......... .......... .......... .......... .......... 63% 1.18M 70s 2020-11-20T12:17:49.110 INFO:tasks.workunit.client.0.smithi093.stderr:107600K .......... .......... .......... .......... .......... 63% 803K 70s 2020-11-20T12:17:49.173 INFO:tasks.workunit.client.0.smithi093.stderr:107650K .......... .......... .......... .......... .......... 63% 789K 69s 2020-11-20T12:17:49.217 INFO:tasks.workunit.client.0.smithi093.stderr:107700K .......... .......... .......... .......... .......... 63% 1.11M 69s 2020-11-20T12:17:49.252 INFO:tasks.workunit.client.0.smithi093.stderr:107750K .......... .......... .......... .......... .......... 63% 1.42M 69s 2020-11-20T12:17:49.303 INFO:tasks.workunit.client.0.smithi093.stderr:107800K .......... .......... .......... .......... .......... 63% 966K 69s 2020-11-20T12:17:49.356 INFO:tasks.workunit.client.0.smithi093.stderr:107850K .......... .......... .......... .......... .......... 64% 1.03M 69s 2020-11-20T12:17:49.408 INFO:tasks.workunit.client.0.smithi093.stderr:107900K .......... .......... .......... .......... .......... 64% 877K 69s 2020-11-20T12:17:49.442 INFO:tasks.workunit.client.0.smithi093.stderr:107950K .......... .......... .......... .......... .......... 64% 1.41M 69s 2020-11-20T12:17:49.498 INFO:tasks.workunit.client.0.smithi093.stderr:108000K .......... .......... .......... .......... .......... 64% 904K 69s 2020-11-20T12:17:49.545 INFO:tasks.workunit.client.0.smithi093.stderr:108050K .......... .......... .......... .......... .......... 64% 1.02M 69s 2020-11-20T12:17:49.592 INFO:tasks.workunit.client.0.smithi093.stderr:108100K .......... .......... .......... .......... .......... 64% 1.04M 69s 2020-11-20T12:17:49.639 INFO:tasks.workunit.client.0.smithi093.stderr:108150K .......... .......... .......... .......... .......... 64% 1.04M 69s 2020-11-20T12:17:49.690 INFO:tasks.workunit.client.0.smithi093.stderr:108200K .......... .......... .......... .......... .......... 64% 982K 69s 2020-11-20T12:17:49.737 INFO:tasks.workunit.client.0.smithi093.stderr:108250K .......... .......... .......... .......... .......... 64% 1.07M 69s 2020-11-20T12:17:49.782 INFO:tasks.workunit.client.0.smithi093.stderr:108300K .......... .......... .......... .......... .......... 64% 1.07M 69s 2020-11-20T12:17:49.836 INFO:tasks.workunit.client.0.smithi093.stderr:108350K .......... .......... .......... .......... .......... 64% 915K 69s 2020-11-20T12:17:49.888 INFO:tasks.workunit.client.0.smithi093.stderr:108400K .......... .......... .......... .......... .......... 64% 974K 69s 2020-11-20T12:17:49.937 INFO:tasks.workunit.client.0.smithi093.stderr:108450K .......... .......... .......... .......... .......... 64% 1016K 68s 2020-11-20T12:17:49.984 INFO:tasks.workunit.client.0.smithi093.stderr:108500K .......... .......... .......... .......... .......... 64% 1.03M 68s 2020-11-20T12:17:50.041 INFO:tasks.workunit.client.0.smithi093.stderr:108550K .......... .......... .......... .......... .......... 64% 875K 68s 2020-11-20T12:17:50.087 INFO:tasks.workunit.client.0.smithi093.stderr:108600K .......... .......... .......... .......... .......... 64% 1.07M 68s 2020-11-20T12:17:50.139 INFO:tasks.workunit.client.0.smithi093.stderr:108650K .......... .......... .......... .......... .......... 64% 969K 68s 2020-11-20T12:17:50.177 INFO:tasks.workunit.client.0.smithi093.stderr:108700K .......... .......... .......... .......... .......... 64% 1.30M 68s 2020-11-20T12:17:50.245 INFO:tasks.workunit.client.0.smithi093.stderr:108750K .......... .......... .......... .......... .......... 64% 734K 68s 2020-11-20T12:17:50.295 INFO:tasks.workunit.client.0.smithi093.stderr:108800K .......... .......... .......... .......... .......... 64% 990K 68s 2020-11-20T12:17:50.332 INFO:tasks.workunit.client.0.smithi093.stderr:108850K .......... .......... .......... .......... .......... 64% 1.38M 68s 2020-11-20T12:17:50.383 INFO:tasks.workunit.client.0.smithi093.stderr:108900K .......... .......... .......... .......... .......... 64% 958K 68s 2020-11-20T12:17:50.436 INFO:tasks.workunit.client.0.smithi093.stderr:108950K .......... .......... .......... .......... .......... 64% 933K 68s 2020-11-20T12:17:50.489 INFO:tasks.workunit.client.0.smithi093.stderr:109000K .......... .......... .......... .......... .......... 64% 944K 68s 2020-11-20T12:17:50.538 INFO:tasks.workunit.client.0.smithi093.stderr:109050K .......... .......... .......... .......... .......... 64% 1.01M 68s 2020-11-20T12:17:50.579 INFO:tasks.workunit.client.0.smithi093.stderr:109100K .......... .......... .......... .......... .......... 64% 1.34M 68s 2020-11-20T12:17:50.626 INFO:tasks.workunit.client.0.smithi093.stderr:109150K .......... .......... .......... .......... .......... 64% 968K 68s 2020-11-20T12:17:50.673 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:50.674 INFO:tasks.workunit.client.0.smithi093.stderr:109200K .......... .......... .......... .......... .......... 64% 1.09M 68s 2020-11-20T12:17:50.680 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:50.687 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:17:50.711 INFO:tasks.workunit.client.0.smithi093.stderr:109250K .......... .......... .......... .......... .......... 64% 1.21M 67s 2020-11-20T12:17:50.754 INFO:tasks.workunit.client.0.smithi093.stderr:109300K .......... .......... .......... .......... .......... 64% 1.14M 67s 2020-11-20T12:17:50.786 INFO:tasks.workunit.client.0.smithi093.stderr:109350K .......... .......... .......... .......... .......... 64% 1.53M 67s 2020-11-20T12:17:50.831 INFO:tasks.workunit.client.0.smithi093.stderr:109400K .......... .......... .......... .......... .......... 64% 1.08M 67s 2020-11-20T12:17:50.871 INFO:tasks.workunit.client.0.smithi093.stderr:109450K .......... .......... .......... .......... .......... 64% 1.22M 67s 2020-11-20T12:17:50.909 INFO:tasks.workunit.client.0.smithi093.stderr:109500K .......... .......... .......... .......... .......... 64% 1.27M 67s 2020-11-20T12:17:50.952 INFO:tasks.workunit.client.0.smithi093.stderr:109550K .......... .......... .......... .......... .......... 65% 1.16M 67s 2020-11-20T12:17:50.978 INFO:tasks.workunit.client.0.smithi093.stderr:109600K .......... .......... .......... .......... .......... 65% 1.89M 67s 2020-11-20T12:17:51.024 INFO:tasks.workunit.client.0.smithi093.stderr:109650K .......... .......... .......... .......... .......... 65% 1.04M 67s 2020-11-20T12:17:51.064 INFO:tasks.workunit.client.0.smithi093.stderr:109700K .......... .......... .......... .......... .......... 65% 1.23M 67s 2020-11-20T12:17:51.105 INFO:tasks.workunit.client.0.smithi093.stderr:109750K .......... .......... .......... .......... .......... 65% 1.20M 67s 2020-11-20T12:17:51.146 INFO:tasks.workunit.client.0.smithi093.stderr:109800K .......... .......... .......... .......... .......... 65% 1.17M 67s 2020-11-20T12:17:51.175 INFO:tasks.workunit.client.0.smithi093.stderr:109850K .......... .......... .......... .......... .......... 65% 1.67M 67s 2020-11-20T12:17:51.227 INFO:tasks.workunit.client.0.smithi093.stderr:109900K .......... .......... .......... .......... .......... 65% 975K 67s 2020-11-20T12:17:51.268 INFO:tasks.workunit.client.0.smithi093.stderr:109950K .......... .......... .......... .......... .......... 65% 1.18M 67s 2020-11-20T12:17:51.310 INFO:tasks.workunit.client.0.smithi093.stderr:110000K .......... .......... .......... .......... .......... 65% 1.18M 66s 2020-11-20T12:17:51.357 INFO:tasks.workunit.client.0.smithi093.stderr:110050K .......... .......... .......... .......... .......... 65% 1.27M 66s 2020-11-20T12:17:51.381 INFO:tasks.workunit.client.0.smithi093.stderr:110100K .......... .......... .......... .......... .......... 65% 1.49M 66s 2020-11-20T12:17:51.430 INFO:tasks.workunit.client.0.smithi093.stderr:110150K .......... .......... .......... .......... .......... 65% 1018K 66s 2020-11-20T12:17:51.481 INFO:tasks.workunit.client.0.smithi093.stderr:110200K .......... .......... .......... .......... .......... 65% 986K 66s 2020-11-20T12:17:51.529 INFO:tasks.workunit.client.0.smithi093.stderr:110250K .......... .......... .......... .......... .......... 65% 1.08M 66s 2020-11-20T12:17:51.570 INFO:tasks.workunit.client.0.smithi093.stderr:110300K .......... .......... .......... .......... .......... 65% 1.12M 66s 2020-11-20T12:17:51.602 INFO:tasks.workunit.client.0.smithi093.stderr:110350K .......... .......... .......... .......... .......... 65% 1.50M 66s 2020-11-20T12:17:51.651 INFO:tasks.workunit.client.0.smithi093.stderr:110400K .......... .......... .......... .......... .......... 65% 1.01M 66s 2020-11-20T12:17:51.687 INFO:tasks.workunit.client.0.smithi093.stderr:110450K .......... .......... .......... .......... .......... 65% 1.59M 66s 2020-11-20T12:17:51.740 INFO:tasks.workunit.client.0.smithi093.stderr:110500K .......... .......... .......... .......... .......... 65% 871K 66s 2020-11-20T12:17:51.785 INFO:tasks.workunit.client.0.smithi093.stderr:110550K .......... .......... .......... .......... .......... 65% 1.14M 66s 2020-11-20T12:17:51.827 INFO:tasks.workunit.client.0.smithi093.stderr:110600K .......... .......... .......... .......... .......... 65% 1.10M 66s 2020-11-20T12:17:51.874 INFO:tasks.workunit.client.0.smithi093.stderr:110650K .......... .......... .......... .......... .......... 65% 1.03M 66s 2020-11-20T12:17:51.907 INFO:tasks.workunit.client.0.smithi093.stderr:110700K .......... .......... .......... .......... .......... 65% 1.47M 66s 2020-11-20T12:17:51.960 INFO:tasks.workunit.client.0.smithi093.stderr:110750K .......... .......... .......... .......... .......... 65% 949K 66s 2020-11-20T12:17:51.992 INFO:tasks.workunit.client.0.smithi093.stderr:110800K .......... .......... .......... .......... .......... 65% 1.52M 65s 2020-11-20T12:17:52.051 INFO:tasks.workunit.client.0.smithi093.stderr:110850K .......... .......... .......... .......... .......... 65% 842K 65s 2020-11-20T12:17:52.153 INFO:tasks.workunit.client.0.smithi093.stderr:110900K .......... .......... .......... .......... .......... 65% 496K 65s 2020-11-20T12:17:52.153 INFO:tasks.workunit.client.0.smithi093.stderr:110950K .......... .......... .......... .......... .......... 65% 220M 65s 2020-11-20T12:17:52.215 INFO:tasks.workunit.client.0.smithi093.stderr:111000K .......... .......... .......... .......... .......... 65% 806K 65s 2020-11-20T12:17:52.276 INFO:tasks.workunit.client.0.smithi093.stderr:111050K .......... .......... .......... .......... .......... 65% 804K 65s 2020-11-20T12:17:52.327 INFO:tasks.workunit.client.0.smithi093.stderr:111100K .......... .......... .......... .......... .......... 65% 1.01M 65s 2020-11-20T12:17:52.381 INFO:tasks.workunit.client.0.smithi093.stderr:111150K .......... .......... .......... .......... .......... 65% 887K 65s 2020-11-20T12:17:52.430 INFO:tasks.workunit.client.0.smithi093.stderr:111200K .......... .......... .......... .......... .......... 65% 1.01M 65s 2020-11-20T12:17:52.485 INFO:tasks.workunit.client.0.smithi093.stderr:111250K .......... .......... .......... .......... .......... 66% 906K 65s 2020-11-20T12:17:52.529 INFO:tasks.workunit.client.0.smithi093.stderr:111300K .......... .......... .......... .......... .......... 66% 1.14M 65s 2020-11-20T12:17:52.583 INFO:tasks.workunit.client.0.smithi093.stderr:111350K .......... .......... .......... .......... .......... 66% 1.05M 65s 2020-11-20T12:17:52.633 INFO:tasks.workunit.client.0.smithi093.stderr:111400K .......... .......... .......... .......... .......... 66% 846K 65s 2020-11-20T12:17:52.689 INFO:tasks.workunit.client.0.smithi093.stderr:111450K .......... .......... .......... .......... .......... 66% 906K 65s 2020-11-20T12:17:52.727 INFO:tasks.workunit.client.0.smithi093.stderr:111500K .......... .......... .......... .......... .......... 66% 1.30M 65s 2020-11-20T12:17:52.786 INFO:tasks.workunit.client.0.smithi093.stderr:111550K .......... .......... .......... .......... .......... 66% 837K 65s 2020-11-20T12:17:52.835 INFO:tasks.workunit.client.0.smithi093.stderr:111600K .......... .......... .......... .......... .......... 66% 1010K 65s 2020-11-20T12:17:52.877 INFO:tasks.workunit.client.0.smithi093.stderr:111650K .......... .......... .......... .......... .......... 66% 1.21M 64s 2020-11-20T12:17:52.933 INFO:tasks.workunit.client.0.smithi093.stderr:111700K .......... .......... .......... .......... .......... 66% 873K 64s 2020-11-20T12:17:52.984 INFO:tasks.workunit.client.0.smithi093.stderr:111750K .......... .......... .......... .......... .......... 66% 970K 64s 2020-11-20T12:17:53.029 INFO:tasks.workunit.client.0.smithi093.stderr:111800K .......... .......... .......... .......... .......... 66% 1.10M 64s 2020-11-20T12:17:53.085 INFO:tasks.workunit.client.0.smithi093.stderr:111850K .......... .......... .......... .......... .......... 66% 897K 64s 2020-11-20T12:17:53.218 INFO:tasks.workunit.client.0.smithi093.stderr:111900K .......... .......... .......... .......... .......... 66% 1.15M 64s 2020-11-20T12:17:53.219 INFO:tasks.workunit.client.0.smithi093.stderr:111950K .......... .......... .......... .......... .......... 66% 552K 64s 2020-11-20T12:17:53.244 INFO:tasks.workunit.client.0.smithi093.stderr:112000K .......... .......... .......... .......... .......... 66% 1.87M 64s 2020-11-20T12:17:53.314 INFO:tasks.workunit.client.0.smithi093.stderr:112050K .......... .......... .......... .......... .......... 66% 717K 64s 2020-11-20T12:17:53.371 INFO:tasks.workunit.client.0.smithi093.stderr:112100K .......... .......... .......... .......... .......... 66% 875K 64s 2020-11-20T12:17:53.439 INFO:tasks.workunit.client.0.smithi093.stderr:112150K .......... .......... .......... .......... .......... 66% 754K 64s 2020-11-20T12:17:53.489 INFO:tasks.workunit.client.0.smithi093.stderr:112200K .......... .......... .......... .......... .......... 66% 966K 64s 2020-11-20T12:17:53.556 INFO:tasks.workunit.client.0.smithi093.stderr:112250K .......... .......... .......... .......... .......... 66% 944K 64s 2020-11-20T12:17:53.614 INFO:tasks.workunit.client.0.smithi093.stderr:112300K .......... .......... .......... .......... .......... 66% 693K 64s 2020-11-20T12:17:53.684 INFO:tasks.workunit.client.0.smithi093.stderr:112350K .......... .......... .......... .......... .......... 66% 715K 64s 2020-11-20T12:17:53.750 INFO:tasks.workunit.client.0.smithi093.stderr:112400K .......... .......... .......... .......... .......... 66% 756K 64s 2020-11-20T12:17:53.802 INFO:tasks.workunit.client.0.smithi093.stderr:112450K .......... .......... .......... .......... .......... 66% 974K 64s 2020-11-20T12:17:53.854 INFO:tasks.workunit.client.0.smithi093.stderr:112500K .......... .......... .......... .......... .......... 66% 942K 64s 2020-11-20T12:17:53.916 INFO:tasks.workunit.client.0.smithi093.stderr:112550K .......... .......... .......... .......... .......... 66% 814K 63s 2020-11-20T12:17:53.993 INFO:tasks.workunit.client.0.smithi093.stderr:112600K .......... .......... .......... .......... .......... 66% 680K 63s 2020-11-20T12:17:54.139 INFO:tasks.workunit.client.0.smithi093.stderr:112650K .......... .......... .......... .......... .......... 66% 336K 63s 2020-11-20T12:17:54.139 INFO:tasks.workunit.client.0.smithi093.stderr:112700K .......... .......... .......... .......... .......... 66% 182M 63s 2020-11-20T12:17:54.214 INFO:tasks.workunit.client.0.smithi093.stderr:112750K .......... .......... .......... .......... .......... 66% 839K 63s 2020-11-20T12:17:54.290 INFO:tasks.workunit.client.0.smithi093.stderr:112800K .......... .......... .......... .......... .......... 66% 546K 63s 2020-11-20T12:17:54.371 INFO:tasks.workunit.client.0.smithi093.stderr:112850K .......... .......... .......... .......... .......... 66% 612K 63s 2020-11-20T12:17:54.446 INFO:tasks.workunit.client.0.smithi093.stderr:112900K .......... .......... .......... .......... .......... 67% 672K 63s 2020-11-20T12:17:54.517 INFO:tasks.workunit.client.0.smithi093.stderr:112950K .......... .......... .......... .......... .......... 67% 703K 63s 2020-11-20T12:17:54.592 INFO:tasks.workunit.client.0.smithi093.stderr:113000K .......... .......... .......... .......... .......... 67% 668K 63s 2020-11-20T12:17:54.669 INFO:tasks.workunit.client.0.smithi093.stderr:113050K .......... .......... .......... .......... .......... 67% 663K 63s 2020-11-20T12:17:54.754 INFO:tasks.workunit.client.0.smithi093.stderr:113100K .......... .......... .......... .......... .......... 67% 610K 63s 2020-11-20T12:17:54.828 INFO:tasks.workunit.client.0.smithi093.stderr:113150K .......... .......... .......... .......... .......... 67% 644K 63s 2020-11-20T12:17:54.913 INFO:tasks.workunit.client.0.smithi093.stderr:113200K .......... .......... .......... .......... .......... 67% 607K 63s 2020-11-20T12:17:54.987 INFO:tasks.workunit.client.0.smithi093.stderr:113250K .......... .......... .......... .......... .......... 67% 652K 63s 2020-11-20T12:17:55.066 INFO:tasks.workunit.client.0.smithi093.stderr:113300K .......... .......... .......... .......... .......... 67% 621K 63s 2020-11-20T12:17:55.144 INFO:tasks.workunit.client.0.smithi093.stderr:113350K .......... .......... .......... .......... .......... 67% 645K 63s 2020-11-20T12:17:55.208 INFO:tasks.workunit.client.0.smithi093.stderr:113400K .......... .......... .......... .......... .......... 67% 775K 63s 2020-11-20T12:17:55.274 INFO:tasks.workunit.client.0.smithi093.stderr:113450K .......... .......... .......... .......... .......... 67% 761K 63s 2020-11-20T12:17:55.328 INFO:tasks.workunit.client.0.smithi093.stderr:113500K .......... .......... .......... .......... .......... 67% 1.00M 63s 2020-11-20T12:17:55.389 INFO:tasks.workunit.client.0.smithi093.stderr:113550K .......... .......... .......... .......... .......... 67% 748K 62s 2020-11-20T12:17:55.459 INFO:tasks.workunit.client.0.smithi093.stderr:113600K .......... .......... .......... .......... .......... 67% 744K 62s 2020-11-20T12:17:55.516 INFO:tasks.workunit.client.0.smithi093.stderr:113650K .......... .......... .......... .......... .......... 67% 840K 62s 2020-11-20T12:17:55.571 INFO:tasks.workunit.client.0.smithi093.stderr:113700K .......... .......... .......... .......... .......... 67% 965K 62s 2020-11-20T12:17:55.638 INFO:tasks.workunit.client.0.smithi093.stderr:113750K .......... .......... .......... .......... .......... 67% 710K 62s 2020-11-20T12:17:55.706 INFO:tasks.workunit.client.0.smithi093.stderr:113800K .......... .......... .......... .......... .......... 67% 754K 62s 2020-11-20T12:17:55.763 INFO:tasks.workunit.client.0.smithi093.stderr:113850K .......... .......... .......... .......... .......... 67% 885K 62s 2020-11-20T12:17:55.809 INFO:tasks.workunit.client.0.smithi093.stderr:113900K .......... .......... .......... .......... .......... 67% 1.02M 62s 2020-11-20T12:17:55.884 INFO:tasks.workunit.client.0.smithi093.stderr:113950K .......... .......... .......... .......... .......... 67% 685K 62s 2020-11-20T12:17:55.945 INFO:tasks.workunit.client.0.smithi093.stderr:114000K .......... .......... .......... .......... .......... 67% 802K 62s 2020-11-20T12:17:56.013 INFO:tasks.workunit.client.0.smithi093.stderr:114050K .......... .......... .......... .......... .......... 67% 734K 62s 2020-11-20T12:17:56.084 INFO:tasks.workunit.client.0.smithi093.stderr:114100K .......... .......... .......... .......... .......... 67% 699K 62s 2020-11-20T12:17:56.130 INFO:tasks.workunit.client.0.smithi093.stderr:114150K .......... .......... .......... .......... .......... 67% 1.08M 62s 2020-11-20T12:17:56.205 INFO:tasks.workunit.client.0.smithi093.stderr:114200K .......... .......... .......... .......... .......... 67% 669K 62s 2020-11-20T12:17:56.346 INFO:tasks.workunit.client.0.smithi093.stderr:114250K .......... .......... .......... .......... .......... 67% 355K 62s 2020-11-20T12:17:56.346 INFO:tasks.workunit.client.0.smithi093.stderr:114300K .......... .......... .......... .......... .......... 67% 391M 62s 2020-11-20T12:17:56.402 INFO:tasks.workunit.client.0.smithi093.stderr:114350K .......... .......... .......... .......... .......... 67% 874K 62s 2020-11-20T12:17:56.477 INFO:tasks.workunit.client.0.smithi093.stderr:114400K .......... .......... .......... .......... .......... 67% 742K 62s 2020-11-20T12:17:56.544 INFO:tasks.workunit.client.0.smithi093.stderr:114450K .......... .......... .......... .......... .......... 67% 672K 62s 2020-11-20T12:17:56.621 INFO:tasks.workunit.client.0.smithi093.stderr:114500K .......... .......... .......... .......... .......... 67% 729K 61s 2020-11-20T12:17:56.684 INFO:tasks.workunit.client.0.smithi093.stderr:114550K .......... .......... .......... .......... .......... 67% 711K 61s 2020-11-20T12:17:56.749 INFO:tasks.workunit.client.0.smithi093.stderr:114600K .......... .......... .......... .......... .......... 68% 817K 61s 2020-11-20T12:17:56.817 INFO:tasks.workunit.client.0.smithi093.stderr:114650K .......... .......... .......... .......... .......... 68% 690K 61s 2020-11-20T12:17:56.890 INFO:tasks.workunit.client.0.smithi093.stderr:114700K .......... .......... .......... .......... .......... 68% 708K 61s 2020-11-20T12:17:56.960 INFO:tasks.workunit.client.0.smithi093.stderr:114750K .......... .......... .......... .......... .......... 68% 695K 61s 2020-11-20T12:17:57.027 INFO:tasks.workunit.client.0.smithi093.stderr:114800K .......... .......... .......... .......... .......... 68% 745K 61s 2020-11-20T12:17:57.101 INFO:tasks.workunit.client.0.smithi093.stderr:114850K .......... .......... .......... .......... .......... 68% 673K 61s 2020-11-20T12:17:57.173 INFO:tasks.workunit.client.0.smithi093.stderr:114900K .......... .......... .......... .......... .......... 68% 737K 61s 2020-11-20T12:17:57.219 INFO:tasks.workunit.client.0.smithi093.stderr:114950K .......... .......... .......... .......... .......... 68% 1022K 61s 2020-11-20T12:17:57.300 INFO:tasks.workunit.client.0.smithi093.stderr:115000K .......... .......... .......... .......... .......... 68% 619K 61s 2020-11-20T12:17:57.378 INFO:tasks.workunit.client.0.smithi093.stderr:115050K .......... .......... .......... .......... .......... 68% 650K 61s 2020-11-20T12:17:57.497 INFO:tasks.workunit.client.0.smithi093.stderr:115100K .......... .......... .......... .......... .......... 68% 414K 61s 2020-11-20T12:17:57.538 INFO:tasks.workunit.client.0.smithi093.stderr:115150K .......... .......... .......... .......... .......... 68% 1.20M 61s 2020-11-20T12:17:57.619 INFO:tasks.workunit.client.0.smithi093.stderr:115200K .......... .......... .......... .......... .......... 68% 609K 61s 2020-11-20T12:17:57.716 INFO:tasks.workunit.client.0.smithi093.stderr:115250K .......... .......... .......... .......... .......... 68% 516K 61s 2020-11-20T12:17:57.799 INFO:tasks.workunit.client.0.smithi093.stderr:115300K .......... .......... .......... .......... .......... 68% 619K 61s 2020-11-20T12:17:57.876 INFO:tasks.workunit.client.0.smithi093.stderr:115350K .......... .......... .......... .......... .......... 68% 632K 61s 2020-11-20T12:17:57.962 INFO:tasks.workunit.client.0.smithi093.stderr:115400K .......... .......... .......... .......... .......... 68% 580K 61s 2020-11-20T12:17:58.040 INFO:tasks.workunit.client.0.smithi093.stderr:115450K .......... .......... .......... .......... .......... 68% 638K 61s 2020-11-20T12:17:58.125 INFO:tasks.workunit.client.0.smithi093.stderr:115500K .......... .......... .......... .......... .......... 68% 588K 61s 2020-11-20T12:17:58.202 INFO:tasks.workunit.client.0.smithi093.stderr:115550K .......... .......... .......... .......... .......... 68% 648K 60s 2020-11-20T12:17:58.368 INFO:tasks.workunit.client.0.smithi093.stderr:115600K .......... .......... .......... .......... .......... 68% 302K 60s 2020-11-20T12:17:58.420 INFO:tasks.workunit.client.0.smithi093.stderr:115650K .......... .......... .......... .......... .......... 68% 949K 60s 2020-11-20T12:17:58.518 INFO:tasks.workunit.client.0.smithi093.stderr:115700K .......... .......... .......... .......... .......... 68% 514K 60s 2020-11-20T12:17:58.638 INFO:tasks.workunit.client.0.smithi093.stderr:115750K .......... .......... .......... .......... .......... 68% 425K 60s 2020-11-20T12:17:58.724 INFO:tasks.workunit.client.0.smithi093.stderr:115800K .......... .......... .......... .......... .......... 68% 571K 60s 2020-11-20T12:17:58.801 INFO:tasks.workunit.client.0.smithi093.stderr:115850K .......... .......... .......... .......... .......... 68% 635K 60s 2020-11-20T12:17:58.919 INFO:tasks.workunit.client.0.smithi093.stderr:115900K .......... .......... .......... .......... .......... 68% 427K 60s 2020-11-20T12:17:59.016 INFO:tasks.workunit.client.0.smithi093.stderr:115950K .......... .......... .......... .......... .......... 68% 558K 60s 2020-11-20T12:17:59.097 INFO:tasks.workunit.client.0.smithi093.stderr:116000K .......... .......... .......... .......... .......... 68% 561K 60s 2020-11-20T12:17:59.227 INFO:tasks.workunit.client.0.smithi093.stderr:116050K .......... .......... .......... .......... .......... 68% 385K 60s 2020-11-20T12:17:59.314 INFO:tasks.workunit.client.0.smithi093.stderr:116100K .......... .......... .......... .......... .......... 68% 576K 60s 2020-11-20T12:17:59.406 INFO:tasks.workunit.client.0.smithi093.stderr:116150K .......... .......... .......... .......... .......... 68% 543K 60s 2020-11-20T12:17:59.492 INFO:tasks.workunit.client.0.smithi093.stderr:116200K .......... .......... .......... .......... .......... 68% 608K 60s 2020-11-20T12:17:59.567 INFO:tasks.workunit.client.0.smithi093.stderr:116250K .......... .......... .......... .......... .......... 68% 633K 60s 2020-11-20T12:17:59.680 INFO:tasks.workunit.client.0.smithi093.stderr:116300K .......... .......... .......... .......... .......... 69% 476K 60s 2020-11-20T12:17:59.748 INFO:tasks.workunit.client.0.smithi093.stderr:116350K .......... .......... .......... .......... .......... 69% 659K 60s 2020-11-20T12:17:59.822 INFO:tasks.workunit.client.0.smithi093.stderr:116400K .......... .......... .......... .......... .......... 69% 747K 60s 2020-11-20T12:17:59.889 INFO:tasks.workunit.client.0.smithi093.stderr:116450K .......... .......... .......... .......... .......... 69% 675K 60s 2020-11-20T12:17:59.953 INFO:tasks.workunit.client.0.smithi093.stderr:116500K .......... .......... .......... .......... .......... 69% 775K 60s 2020-11-20T12:18:00.019 INFO:tasks.workunit.client.0.smithi093.stderr:116550K .......... .......... .......... .......... .......... 69% 763K 60s 2020-11-20T12:18:00.091 INFO:tasks.workunit.client.0.smithi093.stderr:116600K .......... .......... .......... .......... .......... 69% 749K 60s 2020-11-20T12:18:00.166 INFO:tasks.workunit.client.0.smithi093.stderr:116650K .......... .......... .......... .......... .......... 69% 679K 60s 2020-11-20T12:18:00.241 INFO:tasks.workunit.client.0.smithi093.stderr:116700K .......... .......... .......... .......... .......... 69% 611K 59s 2020-11-20T12:18:00.317 INFO:tasks.workunit.client.0.smithi093.stderr:116750K .......... .......... .......... .......... .......... 69% 714K 59s 2020-11-20T12:18:00.386 INFO:tasks.workunit.client.0.smithi093.stderr:116800K .......... .......... .......... .......... .......... 69% 666K 59s 2020-11-20T12:18:00.461 INFO:tasks.workunit.client.0.smithi093.stderr:116850K .......... .......... .......... .......... .......... 69% 668K 59s 2020-11-20T12:18:00.618 INFO:tasks.workunit.client.0.smithi093.stderr:116900K .......... .......... .......... .......... .......... 69% 321K 59s 2020-11-20T12:18:00.626 INFO:tasks.workunit.client.0.smithi093.stderr:116950K .......... .......... .......... .......... .......... 69% 5.67M 59s 2020-11-20T12:18:00.716 INFO:tasks.workunit.client.0.smithi093.stderr:117000K .......... .......... .......... .......... .......... 69% 555K 59s 2020-11-20T12:18:00.795 INFO:tasks.workunit.client.0.smithi093.stderr:117050K .......... .......... .......... .......... .......... 69% 629K 59s 2020-11-20T12:18:00.933 INFO:tasks.workunit.client.0.smithi093.stderr:117100K .......... .......... .......... .......... .......... 69% 383K 59s 2020-11-20T12:18:01.009 INFO:tasks.workunit.client.0.smithi093.stderr:117150K .......... .......... .......... .......... .......... 69% 599K 59s 2020-11-20T12:18:01.098 INFO:tasks.workunit.client.0.smithi093.stderr:117200K .......... .......... .......... .......... .......... 69% 593K 59s 2020-11-20T12:18:01.179 INFO:tasks.workunit.client.0.smithi093.stderr:117250K .......... .......... .......... .......... .......... 69% 588K 59s 2020-11-20T12:18:01.262 INFO:tasks.workunit.client.0.smithi093.stderr:117300K .......... .......... .......... .......... .......... 69% 621K 59s 2020-11-20T12:18:01.341 INFO:tasks.workunit.client.0.smithi093.stderr:117350K .......... .......... .......... .......... .......... 69% 611K 59s 2020-11-20T12:18:01.418 INFO:tasks.workunit.client.0.smithi093.stderr:117400K .......... .......... .......... .......... .......... 69% 652K 59s 2020-11-20T12:18:01.498 INFO:tasks.workunit.client.0.smithi093.stderr:117450K .......... .......... .......... .......... .......... 69% 627K 59s 2020-11-20T12:18:01.565 INFO:tasks.workunit.client.0.smithi093.stderr:117500K .......... .......... .......... .......... .......... 69% 739K 59s 2020-11-20T12:18:01.634 INFO:tasks.workunit.client.0.smithi093.stderr:117550K .......... .......... .......... .......... .......... 69% 726K 59s 2020-11-20T12:18:01.708 INFO:tasks.workunit.client.0.smithi093.stderr:117600K .......... .......... .......... .......... .......... 69% 679K 59s 2020-11-20T12:18:01.805 INFO:tasks.workunit.client.0.smithi093.stderr:117650K .......... .......... .......... .......... .......... 69% 731K 59s 2020-11-20T12:18:01.852 INFO:tasks.workunit.client.0.smithi093.stderr:117700K .......... .......... .......... .......... .......... 69% 657K 59s 2020-11-20T12:18:01.955 INFO:tasks.workunit.client.0.smithi093.stderr:117750K .......... .......... .......... .......... .......... 69% 655K 58s 2020-11-20T12:18:01.999 INFO:tasks.workunit.client.0.smithi093.stderr:117800K .......... .......... .......... .......... .......... 69% 712K 58s 2020-11-20T12:18:02.069 INFO:tasks.workunit.client.0.smithi093.stderr:117850K .......... .......... .......... .......... .......... 69% 709K 58s 2020-11-20T12:18:02.146 INFO:tasks.workunit.client.0.smithi093.stderr:117900K .......... .......... .......... .......... .......... 69% 649K 58s 2020-11-20T12:18:02.218 INFO:tasks.workunit.client.0.smithi093.stderr:117950K .......... .......... .......... .......... .......... 70% 700K 58s 2020-11-20T12:18:02.294 INFO:tasks.workunit.client.0.smithi093.stderr:118000K .......... .......... .......... .......... .......... 70% 689K 58s 2020-11-20T12:18:02.356 INFO:tasks.workunit.client.0.smithi093.stderr:118050K .......... .......... .......... .......... .......... 70% 757K 58s 2020-11-20T12:18:02.423 INFO:tasks.workunit.client.0.smithi093.stderr:118100K .......... .......... .......... .......... .......... 70% 756K 58s 2020-11-20T12:18:02.493 INFO:tasks.workunit.client.0.smithi093.stderr:118150K .......... .......... .......... .......... .......... 70% 714K 58s 2020-11-20T12:18:02.565 INFO:tasks.workunit.client.0.smithi093.stderr:118200K .......... .......... .......... .......... .......... 70% 759K 58s 2020-11-20T12:18:02.621 INFO:tasks.workunit.client.0.smithi093.stderr:118250K .......... .......... .......... .......... .......... 70% 800K 58s 2020-11-20T12:18:02.689 INFO:tasks.workunit.client.0.smithi093.stderr:118300K .......... .......... .......... .......... .......... 70% 740K 58s 2020-11-20T12:18:02.749 INFO:tasks.workunit.client.0.smithi093.stderr:118350K .......... .......... .......... .......... .......... 70% 827K 58s 2020-11-20T12:18:02.827 INFO:tasks.workunit.client.0.smithi093.stderr:118400K .......... .......... .......... .......... .......... 70% 643K 58s 2020-11-20T12:18:02.862 INFO:tasks.workunit.client.0.smithi093.stderr:118450K .......... .......... .......... .......... .......... 70% 1.58M 58s 2020-11-20T12:18:02.932 INFO:tasks.workunit.client.0.smithi093.stderr:118500K .......... .......... .......... .......... .......... 70% 669K 58s 2020-11-20T12:18:03.008 INFO:tasks.workunit.client.0.smithi093.stderr:118550K .......... .......... .......... .......... .......... 70% 663K 58s 2020-11-20T12:18:03.075 INFO:tasks.workunit.client.0.smithi093.stderr:118600K .......... .......... .......... .......... .......... 70% 739K 58s 2020-11-20T12:18:03.154 INFO:tasks.workunit.client.0.smithi093.stderr:118650K .......... .......... .......... .......... .......... 70% 726K 58s 2020-11-20T12:18:03.213 INFO:tasks.workunit.client.0.smithi093.stderr:118700K .......... .......... .......... .......... .......... 70% 728K 57s 2020-11-20T12:18:03.253 INFO:tasks.workunit.client.0.smithi093.stderr:118750K .......... .......... .......... .......... .......... 70% 1.20M 57s 2020-11-20T12:18:03.397 INFO:tasks.workunit.client.0.smithi093.stderr:118800K .......... .......... .......... .......... .......... 70% 351K 57s 2020-11-20T12:18:03.413 INFO:tasks.workunit.client.0.smithi093.stderr:118850K .......... .......... .......... .......... .......... 70% 2.89M 57s 2020-11-20T12:18:03.488 INFO:tasks.workunit.client.0.smithi093.stderr:118900K .......... .......... .......... .......... .......... 70% 677K 57s 2020-11-20T12:18:03.595 INFO:tasks.workunit.client.0.smithi093.stderr:118950K .......... .......... .......... .......... .......... 70% 462K 57s 2020-11-20T12:18:03.664 INFO:tasks.workunit.client.0.smithi093.stderr:119000K .......... .......... .......... .......... .......... 70% 722K 57s 2020-11-20T12:18:03.733 INFO:tasks.workunit.client.0.smithi093.stderr:119050K .......... .......... .......... .......... .......... 70% 726K 57s 2020-11-20T12:18:03.806 INFO:tasks.workunit.client.0.smithi093.stderr:119100K .......... .......... .......... .......... .......... 70% 681K 57s 2020-11-20T12:18:03.882 INFO:tasks.workunit.client.0.smithi093.stderr:119150K .......... .......... .......... .......... .......... 70% 664K 57s 2020-11-20T12:18:03.956 INFO:tasks.workunit.client.0.smithi093.stderr:119200K .......... .......... .......... .......... .......... 70% 674K 57s 2020-11-20T12:18:04.028 INFO:tasks.workunit.client.0.smithi093.stderr:119250K .......... .......... .......... .......... .......... 70% 690K 57s 2020-11-20T12:18:04.066 INFO:tasks.workunit.client.0.smithi093.stderr:119300K .......... .......... .......... .......... .......... 70% 1.31M 57s 2020-11-20T12:18:04.142 INFO:tasks.workunit.client.0.smithi093.stderr:119350K .......... .......... .......... .......... .......... 70% 662K 57s 2020-11-20T12:18:04.221 INFO:tasks.workunit.client.0.smithi093.stderr:119400K .......... .......... .......... .......... .......... 70% 626K 57s 2020-11-20T12:18:04.296 INFO:tasks.workunit.client.0.smithi093.stderr:119450K .......... .......... .......... .......... .......... 70% 684K 57s 2020-11-20T12:18:04.367 INFO:tasks.workunit.client.0.smithi093.stderr:119500K .......... .......... .......... .......... .......... 70% 689K 57s 2020-11-20T12:18:04.442 INFO:tasks.workunit.client.0.smithi093.stderr:119550K .......... .......... .......... .......... .......... 70% 660K 57s 2020-11-20T12:18:04.610 INFO:tasks.workunit.client.0.smithi093.stderr:119600K .......... .......... .......... .......... .......... 70% 305K 57s 2020-11-20T12:18:04.611 INFO:tasks.workunit.client.0.smithi093.stderr:119650K .......... .......... .......... .......... .......... 71% 474M 56s 2020-11-20T12:18:04.695 INFO:tasks.workunit.client.0.smithi093.stderr:119700K .......... .......... .......... .......... .......... 71% 564K 56s 2020-11-20T12:18:04.772 INFO:tasks.workunit.client.0.smithi093.stderr:119750K .......... .......... .......... .......... .......... 71% 649K 56s 2020-11-20T12:18:04.888 INFO:tasks.workunit.client.0.smithi093.stderr:119800K .......... .......... .......... .......... .......... 71% 434K 56s 2020-11-20T12:18:04.966 INFO:tasks.workunit.client.0.smithi093.stderr:119850K .......... .......... .......... .......... .......... 71% 640K 56s 2020-11-20T12:18:05.071 INFO:tasks.workunit.client.0.smithi093.stderr:119900K .......... .......... .......... .......... .......... 71% 609K 56s 2020-11-20T12:18:05.157 INFO:tasks.workunit.client.0.smithi093.stderr:119950K .......... .......... .......... .......... .......... 71% 459K 56s 2020-11-20T12:18:05.316 INFO:tasks.workunit.client.0.smithi093.stderr:120000K .......... .......... .......... .......... .......... 71% 314K 56s 2020-11-20T12:18:05.369 INFO:tasks.workunit.client.0.smithi093.stderr:120050K .......... .......... .......... .......... .......... 71% 938K 56s 2020-11-20T12:18:05.454 INFO:tasks.workunit.client.0.smithi093.stderr:120100K .......... .......... .......... .......... .......... 71% 590K 56s 2020-11-20T12:18:05.568 INFO:tasks.workunit.client.0.smithi093.stderr:120150K .......... .......... .......... .......... .......... 71% 438K 56s 2020-11-20T12:18:05.651 INFO:tasks.workunit.client.0.smithi093.stderr:120200K .......... .......... .......... .......... .......... 71% 604K 56s 2020-11-20T12:18:05.745 INFO:tasks.workunit.client.0.smithi093.stderr:120250K .......... .......... .......... .......... .......... 71% 539K 56s 2020-11-20T12:18:05.819 INFO:tasks.workunit.client.0.smithi093.stderr:120300K .......... .......... .......... .......... .......... 71% 664K 56s 2020-11-20T12:18:05.931 INFO:tasks.workunit.client.0.smithi093.stderr:120350K .......... .......... .......... .......... .......... 71% 446K 56s 2020-11-20T12:18:05.996 INFO:tasks.workunit.client.0.smithi093.stderr:120400K .......... .......... .......... .......... .......... 71% 768K 56s 2020-11-20T12:18:06.095 INFO:tasks.workunit.client.0.smithi093.stderr:120450K .......... .......... .......... .......... .......... 71% 531K 56s 2020-11-20T12:18:06.191 INFO:tasks.workunit.client.0.smithi093.stderr:120500K .......... .......... .......... .......... .......... 71% 497K 56s 2020-11-20T12:18:06.262 INFO:tasks.workunit.client.0.smithi093.stderr:120550K .......... .......... .......... .......... .......... 71% 703K 56s 2020-11-20T12:18:06.349 INFO:tasks.workunit.client.0.smithi093.stderr:120600K .......... .......... .......... .......... .......... 71% 584K 56s 2020-11-20T12:18:06.430 INFO:tasks.workunit.client.0.smithi093.stderr:120650K .......... .......... .......... .......... .......... 71% 609K 56s 2020-11-20T12:18:06.499 INFO:tasks.workunit.client.0.smithi093.stderr:120700K .......... .......... .......... .......... .......... 71% 722K 56s 2020-11-20T12:18:06.618 INFO:tasks.workunit.client.0.smithi093.stderr:120750K .......... .......... .......... .......... .......... 71% 426K 56s 2020-11-20T12:18:06.693 INFO:tasks.workunit.client.0.smithi093.stderr:120800K .......... .......... .......... .......... .......... 71% 654K 55s 2020-11-20T12:18:06.781 INFO:tasks.workunit.client.0.smithi093.stderr:120850K .......... .......... .......... .......... .......... 71% 587K 55s 2020-11-20T12:18:06.865 INFO:tasks.workunit.client.0.smithi093.stderr:120900K .......... .......... .......... .......... .......... 71% 610K 55s 2020-11-20T12:18:06.947 INFO:tasks.workunit.client.0.smithi093.stderr:120950K .......... .......... .......... .......... .......... 71% 589K 55s 2020-11-20T12:18:07.025 INFO:tasks.workunit.client.0.smithi093.stderr:121000K .......... .......... .......... .......... .......... 71% 626K 55s 2020-11-20T12:18:07.112 INFO:tasks.workunit.client.0.smithi093.stderr:121050K .......... .......... .......... .......... .......... 71% 623K 55s 2020-11-20T12:18:07.270 INFO:tasks.workunit.client.0.smithi093.stderr:121100K .......... .......... .......... .......... .......... 71% 306K 55s 2020-11-20T12:18:07.316 INFO:tasks.workunit.client.0.smithi093.stderr:121150K .......... .......... .......... .......... .......... 71% 1.03M 55s 2020-11-20T12:18:07.405 INFO:tasks.workunit.client.0.smithi093.stderr:121200K .......... .......... .......... .......... .......... 71% 565K 55s 2020-11-20T12:18:07.483 INFO:tasks.workunit.client.0.smithi093.stderr:121250K .......... .......... .......... .......... .......... 71% 677K 55s 2020-11-20T12:18:07.590 INFO:tasks.workunit.client.0.smithi093.stderr:121300K .......... .......... .......... .......... .......... 71% 464K 55s 2020-11-20T12:18:07.672 INFO:tasks.workunit.client.0.smithi093.stderr:121350K .......... .......... .......... .......... .......... 72% 584K 55s 2020-11-20T12:18:07.744 INFO:tasks.workunit.client.0.smithi093.stderr:121400K .......... .......... .......... .......... .......... 72% 709K 55s 2020-11-20T12:18:07.807 INFO:tasks.workunit.client.0.smithi093.stderr:121450K .......... .......... .......... .......... .......... 72% 776K 55s 2020-11-20T12:18:07.872 INFO:tasks.workunit.client.0.smithi093.stderr:121500K .......... .......... .......... .......... .......... 72% 779K 55s 2020-11-20T12:18:07.982 INFO:tasks.workunit.client.0.smithi093.stderr:121550K .......... .......... .......... .......... .......... 72% 465K 55s 2020-11-20T12:18:08.065 INFO:tasks.workunit.client.0.smithi093.stderr:121600K .......... .......... .......... .......... .......... 72% 579K 55s 2020-11-20T12:18:08.140 INFO:tasks.workunit.client.0.smithi093.stderr:121650K .......... .......... .......... .......... .......... 72% 664K 55s 2020-11-20T12:18:08.210 INFO:tasks.workunit.client.0.smithi093.stderr:121700K .......... .......... .......... .......... .......... 72% 741K 55s 2020-11-20T12:18:08.280 INFO:tasks.workunit.client.0.smithi093.stderr:121750K .......... .......... .......... .......... .......... 72% 693K 55s 2020-11-20T12:18:08.361 INFO:tasks.workunit.client.0.smithi093.stderr:121800K .......... .......... .......... .......... .......... 72% 624K 54s 2020-11-20T12:18:08.435 INFO:tasks.workunit.client.0.smithi093.stderr:121850K .......... .......... .......... .......... .......... 72% 664K 54s 2020-11-20T12:18:08.512 INFO:tasks.workunit.client.0.smithi093.stderr:121900K .......... .......... .......... .......... .......... 72% 654K 54s 2020-11-20T12:18:08.628 INFO:tasks.workunit.client.0.smithi093.stderr:121950K .......... .......... .......... .......... .......... 72% 443K 54s 2020-11-20T12:18:08.709 INFO:tasks.workunit.client.0.smithi093.stderr:122000K .......... .......... .......... .......... .......... 72% 596K 54s 2020-11-20T12:18:08.784 INFO:tasks.workunit.client.0.smithi093.stderr:122050K .......... .......... .......... .......... .......... 72% 660K 54s 2020-11-20T12:18:08.938 INFO:tasks.workunit.client.0.smithi093.stderr:122100K .......... .......... .......... .......... .......... 72% 326K 54s 2020-11-20T12:18:08.986 INFO:tasks.workunit.client.0.smithi093.stderr:122150K .......... .......... .......... .......... .......... 72% 1.05M 54s 2020-11-20T12:18:09.095 INFO:tasks.workunit.client.0.smithi093.stderr:122200K .......... .......... .......... .......... .......... 72% 457K 54s 2020-11-20T12:18:09.220 INFO:tasks.workunit.client.0.smithi093.stderr:122250K .......... .......... .......... .......... .......... 72% 447K 54s 2020-11-20T12:18:09.297 INFO:tasks.workunit.client.0.smithi093.stderr:122300K .......... .......... .......... .......... .......... 72% 542K 54s 2020-11-20T12:18:09.387 INFO:tasks.workunit.client.0.smithi093.stderr:122350K .......... .......... .......... .......... .......... 72% 559K 54s 2020-11-20T12:18:09.474 INFO:tasks.workunit.client.0.smithi093.stderr:122400K .......... .......... .......... .......... .......... 72% 614K 54s 2020-11-20T12:18:09.579 INFO:tasks.workunit.client.0.smithi093.stderr:122450K .......... .......... .......... .......... .......... 72% 454K 54s 2020-11-20T12:18:09.669 INFO:tasks.workunit.client.0.smithi093.stderr:122500K .......... .......... .......... .......... .......... 72% 553K 54s 2020-11-20T12:18:09.831 INFO:tasks.workunit.client.0.smithi093.stderr:122550K .......... .......... .......... .......... .......... 72% 309K 54s 2020-11-20T12:18:09.896 INFO:tasks.workunit.client.0.smithi093.stderr:122600K .......... .......... .......... .......... .......... 72% 769K 54s 2020-11-20T12:18:10.003 INFO:tasks.workunit.client.0.smithi093.stderr:122650K .......... .......... .......... .......... .......... 72% 465K 54s 2020-11-20T12:18:10.098 INFO:tasks.workunit.client.0.smithi093.stderr:122700K .......... .......... .......... .......... .......... 72% 527K 54s 2020-11-20T12:18:10.209 INFO:tasks.workunit.client.0.smithi093.stderr:122750K .......... .......... .......... .......... .......... 72% 449K 54s 2020-11-20T12:18:10.309 INFO:tasks.workunit.client.0.smithi093.stderr:122800K .......... .......... .......... .......... .......... 72% 504K 54s 2020-11-20T12:18:10.391 INFO:tasks.workunit.client.0.smithi093.stderr:122850K .......... .......... .......... .......... .......... 72% 606K 54s 2020-11-20T12:18:10.522 INFO:tasks.workunit.client.0.smithi093.stderr:122900K .......... .......... .......... .......... .......... 72% 385K 54s 2020-11-20T12:18:10.608 INFO:tasks.workunit.client.0.smithi093.stderr:122950K .......... .......... .......... .......... .......... 72% 576K 53s 2020-11-20T12:18:10.732 INFO:tasks.workunit.client.0.smithi093.stderr:123000K .......... .......... .......... .......... .......... 72% 576K 53s 2020-11-20T12:18:10.812 INFO:tasks.workunit.client.0.smithi093.stderr:123050K .......... .......... .......... .......... .......... 73% 425K 53s 2020-11-20T12:18:11.001 INFO:tasks.workunit.client.0.smithi093.stderr:123100K .......... .......... .......... .......... .......... 73% 266K 53s 2020-11-20T12:18:11.050 INFO:tasks.workunit.client.0.smithi093.stderr:123150K .......... .......... .......... .......... .......... 73% 1014K 53s 2020-11-20T12:18:11.187 INFO:tasks.workunit.client.0.smithi093.stderr:123200K .......... .......... .......... .......... .......... 73% 366K 53s 2020-11-20T12:18:11.276 INFO:tasks.workunit.client.0.smithi093.stderr:123250K .......... .......... .......... .......... .......... 73% 563K 53s 2020-11-20T12:18:11.375 INFO:tasks.workunit.client.0.smithi093.stderr:123300K .......... .......... .......... .......... .......... 73% 503K 53s 2020-11-20T12:18:11.473 INFO:tasks.workunit.client.0.smithi093.stderr:123350K .......... .......... .......... .......... .......... 73% 557K 53s 2020-11-20T12:18:11.576 INFO:tasks.workunit.client.0.smithi093.stderr:123400K .......... .......... .......... .......... .......... 73% 448K 53s 2020-11-20T12:18:11.671 INFO:tasks.workunit.client.0.smithi093.stderr:123450K .......... .......... .......... .......... .......... 73% 530K 53s 2020-11-20T12:18:11.790 INFO:tasks.workunit.client.0.smithi093.stderr:123500K .......... .......... .......... .......... .......... 73% 419K 53s 2020-11-20T12:18:11.879 INFO:tasks.workunit.client.0.smithi093.stderr:123550K .......... .......... .......... .......... .......... 73% 669K 53s 2020-11-20T12:18:11.976 INFO:tasks.workunit.client.0.smithi093.stderr:123600K .......... .......... .......... .......... .......... 73% 451K 53s 2020-11-20T12:18:12.094 INFO:tasks.workunit.client.0.smithi093.stderr:123650K .......... .......... .......... .......... .......... 73% 423K 53s 2020-11-20T12:18:12.174 INFO:tasks.workunit.client.0.smithi093.stderr:123700K .......... .......... .......... .......... .......... 73% 620K 53s 2020-11-20T12:18:12.283 INFO:tasks.workunit.client.0.smithi093.stderr:123750K .......... .......... .......... .......... .......... 73% 463K 53s 2020-11-20T12:18:12.374 INFO:tasks.workunit.client.0.smithi093.stderr:123800K .......... .......... .......... .......... .......... 73% 552K 53s 2020-11-20T12:18:12.565 INFO:tasks.workunit.client.0.smithi093.stderr:123850K .......... .......... .......... .......... .......... 73% 261K 53s 2020-11-20T12:18:12.592 INFO:tasks.workunit.client.0.smithi093.stderr:123900K .......... .......... .......... .......... .......... 73% 1.80M 53s 2020-11-20T12:18:12.697 INFO:tasks.workunit.client.0.smithi093.stderr:123950K .......... .......... .......... .......... .......... 73% 489K 53s 2020-11-20T12:18:12.781 INFO:tasks.workunit.client.0.smithi093.stderr:124000K .......... .......... .......... .......... .......... 73% 574K 53s 2020-11-20T12:18:12.871 INFO:tasks.workunit.client.0.smithi093.stderr:124050K .......... .......... .......... .......... .......... 73% 552K 53s 2020-11-20T12:18:12.959 INFO:tasks.workunit.client.0.smithi093.stderr:124100K .......... .......... .......... .......... .......... 73% 573K 52s 2020-11-20T12:18:13.065 INFO:tasks.workunit.client.0.smithi093.stderr:124150K .......... .......... .......... .......... .......... 73% 470K 52s 2020-11-20T12:18:13.145 INFO:tasks.workunit.client.0.smithi093.stderr:124200K .......... .......... .......... .......... .......... 73% 628K 52s 2020-11-20T12:18:13.244 INFO:tasks.workunit.client.0.smithi093.stderr:124250K .......... .......... .......... .......... .......... 73% 508K 52s 2020-11-20T12:18:13.344 INFO:tasks.workunit.client.0.smithi093.stderr:124300K .......... .......... .......... .......... .......... 73% 504K 52s 2020-11-20T12:18:13.437 INFO:tasks.workunit.client.0.smithi093.stderr:124350K .......... .......... .......... .......... .......... 73% 532K 52s 2020-11-20T12:18:13.532 INFO:tasks.workunit.client.0.smithi093.stderr:124400K .......... .......... .......... .......... .......... 73% 624K 52s 2020-11-20T12:18:13.615 INFO:tasks.workunit.client.0.smithi093.stderr:124450K .......... .......... .......... .......... .......... 73% 512K 52s 2020-11-20T12:18:13.685 INFO:tasks.workunit.client.0.smithi093.stderr:124500K .......... .......... .......... .......... .......... 73% 706K 52s 2020-11-20T12:18:13.787 INFO:tasks.workunit.client.0.smithi093.stderr:124550K .......... .......... .......... .......... .......... 73% 493K 52s 2020-11-20T12:18:13.890 INFO:tasks.workunit.client.0.smithi093.stderr:124600K .......... .......... .......... .......... .......... 73% 487K 52s 2020-11-20T12:18:13.979 INFO:tasks.workunit.client.0.smithi093.stderr:124650K .......... .......... .......... .......... .......... 73% 624K 52s 2020-11-20T12:18:14.060 INFO:tasks.workunit.client.0.smithi093.stderr:124700K .......... .......... .......... .......... .......... 74% 551K 52s 2020-11-20T12:18:14.141 INFO:tasks.workunit.client.0.smithi093.stderr:124750K .......... .......... .......... .......... .......... 74% 618K 52s 2020-11-20T12:18:14.256 INFO:tasks.workunit.client.0.smithi093.stderr:124800K .......... .......... .......... .......... .......... 74% 437K 52s 2020-11-20T12:18:14.422 INFO:tasks.workunit.client.0.smithi093.stderr:124850K .......... .......... .......... .......... .......... 74% 301K 52s 2020-11-20T12:18:14.465 INFO:tasks.workunit.client.0.smithi093.stderr:124900K .......... .......... .......... .......... .......... 74% 1.15M 52s 2020-11-20T12:18:14.566 INFO:tasks.workunit.client.0.smithi093.stderr:124950K .......... .......... .......... .......... .......... 74% 493K 52s 2020-11-20T12:18:14.662 INFO:tasks.workunit.client.0.smithi093.stderr:125000K .......... .......... .......... .......... .......... 74% 521K 52s 2020-11-20T12:18:14.721 INFO:tasks.workunit.client.0.smithi093.stderr:125050K .......... .......... .......... .......... .......... 74% 854K 52s 2020-11-20T12:18:14.834 INFO:tasks.workunit.client.0.smithi093.stderr:125100K .......... .......... .......... .......... .......... 74% 447K 52s 2020-11-20T12:18:14.900 INFO:tasks.workunit.client.0.smithi093.stderr:125150K .......... .......... .......... .......... .......... 74% 742K 51s 2020-11-20T12:18:14.990 INFO:tasks.workunit.client.0.smithi093.stderr:125200K .......... .......... .......... .......... .......... 74% 574K 51s 2020-11-20T12:18:15.089 INFO:tasks.workunit.client.0.smithi093.stderr:125250K .......... .......... .......... .......... .......... 74% 488K 51s 2020-11-20T12:18:15.165 INFO:tasks.workunit.client.0.smithi093.stderr:125300K .......... .......... .......... .......... .......... 74% 657K 51s 2020-11-20T12:18:15.235 INFO:tasks.workunit.client.0.smithi093.stderr:125350K .......... .......... .......... .......... .......... 74% 714K 51s 2020-11-20T12:18:15.341 INFO:tasks.workunit.client.0.smithi093.stderr:125400K .......... .......... .......... .......... .......... 74% 472K 51s 2020-11-20T12:18:15.445 INFO:tasks.workunit.client.0.smithi093.stderr:125450K .......... .......... .......... .......... .......... 74% 483K 51s 2020-11-20T12:18:15.524 INFO:tasks.workunit.client.0.smithi093.stderr:125500K .......... .......... .......... .......... .......... 74% 628K 51s 2020-11-20T12:18:15.603 INFO:tasks.workunit.client.0.smithi093.stderr:125550K .......... .......... .......... .......... .......... 74% 641K 51s 2020-11-20T12:18:15.680 INFO:tasks.workunit.client.0.smithi093.stderr:125600K .......... .......... .......... .......... .......... 74% 661K 51s 2020-11-20T12:18:15.802 INFO:tasks.workunit.client.0.smithi093.stderr:125650K .......... .......... .......... .......... .......... 74% 646K 51s 2020-11-20T12:18:15.916 INFO:tasks.workunit.client.0.smithi093.stderr:125700K .......... .......... .......... .......... .......... 74% 313K 51s 2020-11-20T12:18:15.992 INFO:tasks.workunit.client.0.smithi093.stderr:125750K .......... .......... .......... .......... .......... 74% 653K 51s 2020-11-20T12:18:16.136 INFO:tasks.workunit.client.0.smithi093.stderr:125800K .......... .......... .......... .......... .......... 74% 346K 51s 2020-11-20T12:18:16.220 INFO:tasks.workunit.client.0.smithi093.stderr:125850K .......... .......... .......... .......... .......... 74% 598K 51s 2020-11-20T12:18:16.338 INFO:tasks.workunit.client.0.smithi093.stderr:125900K .......... .......... .......... .......... .......... 74% 423K 51s 2020-11-20T12:18:16.443 INFO:tasks.workunit.client.0.smithi093.stderr:125950K .......... .......... .......... .......... .......... 74% 477K 51s 2020-11-20T12:18:16.539 INFO:tasks.workunit.client.0.smithi093.stderr:126000K .......... .......... .......... .......... .......... 74% 537K 51s 2020-11-20T12:18:16.681 INFO:tasks.workunit.client.0.smithi093.stderr:126050K .......... .......... .......... .......... .......... 74% 348K 51s 2020-11-20T12:18:16.811 INFO:tasks.workunit.client.0.smithi093.stderr:126100K .......... .......... .......... .......... .......... 74% 385K 51s 2020-11-20T12:18:16.927 INFO:tasks.workunit.client.0.smithi093.stderr:126150K .......... .......... .......... .......... .......... 74% 428K 51s 2020-11-20T12:18:17.076 INFO:tasks.workunit.client.0.smithi093.stderr:126200K .......... .......... .......... .......... .......... 74% 335K 51s 2020-11-20T12:18:17.181 INFO:tasks.workunit.client.0.smithi093.stderr:126250K .......... .......... .......... .......... .......... 74% 474K 51s 2020-11-20T12:18:17.302 INFO:tasks.workunit.client.0.smithi093.stderr:126300K .......... .......... .......... .......... .......... 74% 414K 50s 2020-11-20T12:18:17.431 INFO:tasks.workunit.client.0.smithi093.stderr:126350K .......... .......... .......... .......... .......... 74% 387K 50s 2020-11-20T12:18:17.519 INFO:tasks.workunit.client.0.smithi093.stderr:126400K .......... .......... .......... .......... .......... 75% 572K 50s 2020-11-20T12:18:17.616 INFO:tasks.workunit.client.0.smithi093.stderr:126450K .......... .......... .......... .......... .......... 75% 528K 50s 2020-11-20T12:18:17.740 INFO:tasks.workunit.client.0.smithi093.stderr:126500K .......... .......... .......... .......... .......... 75% 395K 50s 2020-11-20T12:18:17.844 INFO:tasks.workunit.client.0.smithi093.stderr:126550K .......... .......... .......... .......... .......... 75% 482K 50s 2020-11-20T12:18:17.955 INFO:tasks.workunit.client.0.smithi093.stderr:126600K .......... .......... .......... .......... .......... 75% 449K 50s 2020-11-20T12:18:18.049 INFO:tasks.workunit.client.0.smithi093.stderr:126650K .......... .......... .......... .......... .......... 75% 546K 50s 2020-11-20T12:18:18.161 INFO:tasks.workunit.client.0.smithi093.stderr:126700K .......... .......... .......... .......... .......... 75% 439K 50s 2020-11-20T12:18:18.322 INFO:tasks.workunit.client.0.smithi093.stderr:126750K .......... .......... .......... .......... .......... 75% 315K 50s 2020-11-20T12:18:18.380 INFO:tasks.workunit.client.0.smithi093.stderr:126800K .......... .......... .......... .......... .......... 75% 1020K 50s 2020-11-20T12:18:18.516 INFO:tasks.workunit.client.0.smithi093.stderr:126850K .......... .......... .......... .......... .......... 75% 340K 50s 2020-11-20T12:18:18.625 INFO:tasks.workunit.client.0.smithi093.stderr:126900K .......... .......... .......... .......... .......... 75% 458K 50s 2020-11-20T12:18:18.744 INFO:tasks.workunit.client.0.smithi093.stderr:126950K .......... .......... .......... .......... .......... 75% 423K 50s 2020-11-20T12:18:18.862 INFO:tasks.workunit.client.0.smithi093.stderr:127000K .......... .......... .......... .......... .......... 75% 422K 50s 2020-11-20T12:18:18.984 INFO:tasks.workunit.client.0.smithi093.stderr:127050K .......... .......... .......... .......... .......... 75% 412K 50s 2020-11-20T12:18:19.100 INFO:tasks.workunit.client.0.smithi093.stderr:127100K .......... .......... .......... .......... .......... 75% 594K 50s 2020-11-20T12:18:19.174 INFO:tasks.workunit.client.0.smithi093.stderr:127150K .......... .......... .......... .......... .......... 75% 467K 50s 2020-11-20T12:18:19.276 INFO:tasks.workunit.client.0.smithi093.stderr:127200K .......... .......... .......... .......... .......... 75% 492K 50s 2020-11-20T12:18:19.353 INFO:tasks.workunit.client.0.smithi093.stderr:127250K .......... .......... .......... .......... .......... 75% 647K 50s 2020-11-20T12:18:19.439 INFO:tasks.workunit.client.0.smithi093.stderr:127300K .......... .......... .......... .......... .......... 75% 587K 50s 2020-11-20T12:18:19.537 INFO:tasks.workunit.client.0.smithi093.stderr:127350K .......... .......... .......... .......... .......... 75% 510K 50s 2020-11-20T12:18:19.606 INFO:tasks.workunit.client.0.smithi093.stderr:127400K .......... .......... .......... .......... .......... 75% 723K 49s 2020-11-20T12:18:19.712 INFO:tasks.workunit.client.0.smithi093.stderr:127450K .......... .......... .......... .......... .......... 75% 471K 49s 2020-11-20T12:18:19.787 INFO:tasks.workunit.client.0.smithi093.stderr:127500K .......... .......... .......... .......... .......... 75% 660K 49s 2020-11-20T12:18:19.889 INFO:tasks.workunit.client.0.smithi093.stderr:127550K .......... .......... .......... .......... .......... 75% 493K 49s 2020-11-20T12:18:19.969 INFO:tasks.workunit.client.0.smithi093.stderr:127600K .......... .......... .......... .......... .......... 75% 624K 49s 2020-11-20T12:18:20.044 INFO:tasks.workunit.client.0.smithi093.stderr:127650K .......... .......... .......... .......... .......... 75% 669K 49s 2020-11-20T12:18:20.161 INFO:tasks.workunit.client.0.smithi093.stderr:127700K .......... .......... .......... .......... .......... 75% 428K 49s 2020-11-20T12:18:20.241 INFO:tasks.workunit.client.0.smithi093.stderr:127750K .......... .......... .......... .......... .......... 75% 624K 49s 2020-11-20T12:18:20.320 INFO:tasks.workunit.client.0.smithi093.stderr:127800K .......... .......... .......... .......... .......... 75% 645K 49s 2020-11-20T12:18:20.399 INFO:tasks.workunit.client.0.smithi093.stderr:127850K .......... .......... .......... .......... .......... 75% 619K 49s 2020-11-20T12:18:20.481 INFO:tasks.workunit.client.0.smithi093.stderr:127900K .......... .......... .......... .......... .......... 75% 609K 49s 2020-11-20T12:18:20.632 INFO:tasks.workunit.client.0.smithi093.stderr:127950K .......... .......... .......... .......... .......... 75% 333K 49s 2020-11-20T12:18:20.703 INFO:tasks.workunit.client.0.smithi093.stderr:128000K .......... .......... .......... .......... .......... 75% 696K 49s 2020-11-20T12:18:20.771 INFO:tasks.workunit.client.0.smithi093.stderr:128050K .......... .......... .......... .......... .......... 75% 732K 49s 2020-11-20T12:18:20.776 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:20.779 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:20.782 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:20.872 INFO:tasks.workunit.client.0.smithi093.stderr:128100K .......... .......... .......... .......... .......... 76% 497K 49s 2020-11-20T12:18:20.956 INFO:tasks.workunit.client.0.smithi093.stderr:128150K .......... .......... .......... .......... .......... 76% 590K 49s 2020-11-20T12:18:21.053 INFO:tasks.workunit.client.0.smithi093.stderr:128200K .......... .......... .......... .......... .......... 76% 520K 49s 2020-11-20T12:18:21.128 INFO:tasks.workunit.client.0.smithi093.stderr:128250K .......... .......... .......... .......... .......... 76% 662K 49s 2020-11-20T12:18:21.221 INFO:tasks.workunit.client.0.smithi093.stderr:128300K .......... .......... .......... .......... .......... 76% 539K 49s 2020-11-20T12:18:21.288 INFO:tasks.workunit.client.0.smithi093.stderr:128350K .......... .......... .......... .......... .......... 76% 738K 49s 2020-11-20T12:18:21.361 INFO:tasks.workunit.client.0.smithi093.stderr:128400K .......... .......... .......... .......... .......... 76% 687K 48s 2020-11-20T12:18:21.469 INFO:tasks.workunit.client.0.smithi093.stderr:128450K .......... .......... .......... .......... .......... 76% 467K 48s 2020-11-20T12:18:21.545 INFO:tasks.workunit.client.0.smithi093.stderr:128500K .......... .......... .......... .......... .......... 76% 654K 48s 2020-11-20T12:18:21.622 INFO:tasks.workunit.client.0.smithi093.stderr:128550K .......... .......... .......... .......... .......... 76% 650K 48s 2020-11-20T12:18:21.726 INFO:tasks.workunit.client.0.smithi093.stderr:128600K .......... .......... .......... .......... .......... 76% 479K 48s 2020-11-20T12:18:21.806 INFO:tasks.workunit.client.0.smithi093.stderr:128650K .......... .......... .......... .......... .......... 76% 626K 48s 2020-11-20T12:18:21.974 INFO:tasks.workunit.client.0.smithi093.stderr:128700K .......... .......... .......... .......... .......... 76% 298K 48s 2020-11-20T12:18:22.017 INFO:tasks.workunit.client.0.smithi093.stderr:128750K .......... .......... .......... .......... .......... 76% 1.44M 48s 2020-11-20T12:18:22.164 INFO:tasks.workunit.client.0.smithi093.stderr:128800K .......... .......... .......... .......... .......... 76% 407K 48s 2020-11-20T12:18:22.285 INFO:tasks.workunit.client.0.smithi093.stderr:128850K .......... .......... .......... .......... .......... 76% 398K 48s 2020-11-20T12:18:22.371 INFO:tasks.workunit.client.0.smithi093.stderr:128900K .......... .......... .......... .......... .......... 76% 433K 48s 2020-11-20T12:18:22.493 INFO:tasks.workunit.client.0.smithi093.stderr:128950K .......... .......... .......... .......... .......... 76% 411K 48s 2020-11-20T12:18:22.605 INFO:tasks.workunit.client.0.smithi093.stderr:129000K .......... .......... .......... .......... .......... 76% 447K 48s 2020-11-20T12:18:22.758 INFO:tasks.workunit.client.0.smithi093.stderr:129050K .......... .......... .......... .......... .......... 76% 327K 48s 2020-11-20T12:18:22.860 INFO:tasks.workunit.client.0.smithi093.stderr:129100K .......... .......... .......... .......... .......... 76% 504K 48s 2020-11-20T12:18:22.994 INFO:tasks.workunit.client.0.smithi093.stderr:129150K .......... .......... .......... .......... .......... 76% 374K 48s 2020-11-20T12:18:23.119 INFO:tasks.workunit.client.0.smithi093.stderr:129200K .......... .......... .......... .......... .......... 76% 391K 48s 2020-11-20T12:18:23.258 INFO:tasks.workunit.client.0.smithi093.stderr:129250K .......... .......... .......... .......... .......... 76% 360K 48s 2020-11-20T12:18:23.365 INFO:tasks.workunit.client.0.smithi093.stderr:129300K .......... .......... .......... .......... .......... 76% 464K 48s 2020-11-20T12:18:23.480 INFO:tasks.workunit.client.0.smithi093.stderr:129350K .......... .......... .......... .......... .......... 76% 435K 48s 2020-11-20T12:18:23.602 INFO:tasks.workunit.client.0.smithi093.stderr:129400K .......... .......... .......... .......... .......... 76% 410K 48s 2020-11-20T12:18:23.709 INFO:tasks.workunit.client.0.smithi093.stderr:129450K .......... .......... .......... .......... .......... 76% 469K 48s 2020-11-20T12:18:23.864 INFO:tasks.workunit.client.0.smithi093.stderr:129500K .......... .......... .......... .......... .......... 76% 404K 47s 2020-11-20T12:18:24.056 INFO:tasks.workunit.client.0.smithi093.stderr:129550K .......... .......... .......... .......... .......... 76% 224K 47s 2020-11-20T12:18:24.101 INFO:tasks.workunit.client.0.smithi093.stderr:129600K .......... .......... .......... .......... .......... 76% 1.08M 47s 2020-11-20T12:18:24.244 INFO:tasks.workunit.client.0.smithi093.stderr:129650K .......... .......... .......... .......... .......... 76% 352K 47s 2020-11-20T12:18:24.366 INFO:tasks.workunit.client.0.smithi093.stderr:129700K .......... .......... .......... .......... .......... 76% 410K 47s 2020-11-20T12:18:24.465 INFO:tasks.workunit.client.0.smithi093.stderr:129750K .......... .......... .......... .......... .......... 77% 503K 47s 2020-11-20T12:18:24.570 INFO:tasks.workunit.client.0.smithi093.stderr:129800K .......... .......... .......... .......... .......... 77% 489K 47s 2020-11-20T12:18:24.703 INFO:tasks.workunit.client.0.smithi093.stderr:129850K .......... .......... .......... .......... .......... 77% 370K 47s 2020-11-20T12:18:24.803 INFO:tasks.workunit.client.0.smithi093.stderr:129900K .......... .......... .......... .......... .......... 77% 496K 47s 2020-11-20T12:18:24.916 INFO:tasks.workunit.client.0.smithi093.stderr:129950K .......... .......... .......... .......... .......... 77% 444K 47s 2020-11-20T12:18:25.025 INFO:tasks.workunit.client.0.smithi093.stderr:130000K .......... .......... .......... .......... .......... 77% 458K 47s 2020-11-20T12:18:25.139 INFO:tasks.workunit.client.0.smithi093.stderr:130050K .......... .......... .......... .......... .......... 77% 439K 47s 2020-11-20T12:18:25.251 INFO:tasks.workunit.client.0.smithi093.stderr:130100K .......... .......... .......... .......... .......... 77% 445K 47s 2020-11-20T12:18:25.371 INFO:tasks.workunit.client.0.smithi093.stderr:130150K .......... .......... .......... .......... .......... 77% 418K 47s 2020-11-20T12:18:25.451 INFO:tasks.workunit.client.0.smithi093.stderr:130200K .......... .......... .......... .......... .......... 77% 622K 47s 2020-11-20T12:18:25.567 INFO:tasks.workunit.client.0.smithi093.stderr:130250K .......... .......... .......... .......... .......... 77% 443K 47s 2020-11-20T12:18:25.674 INFO:tasks.workunit.client.0.smithi093.stderr:130300K .......... .......... .......... .......... .......... 77% 455K 47s 2020-11-20T12:18:25.749 INFO:tasks.workunit.client.0.smithi093.stderr:130350K .......... .......... .......... .......... .......... 77% 659K 47s 2020-11-20T12:18:25.835 INFO:tasks.workunit.client.0.smithi093.stderr:130400K .......... .......... .......... .......... .......... 77% 588K 47s 2020-11-20T12:18:25.953 INFO:tasks.workunit.client.0.smithi093.stderr:130450K .......... .......... .......... .......... .......... 77% 422K 47s 2020-11-20T12:18:26.059 INFO:tasks.workunit.client.0.smithi093.stderr:130500K .......... .......... .......... .......... .......... 77% 590K 47s 2020-11-20T12:18:26.140 INFO:tasks.workunit.client.0.smithi093.stderr:130550K .......... .......... .......... .......... .......... 77% 487K 46s 2020-11-20T12:18:26.224 INFO:tasks.workunit.client.0.smithi093.stderr:130600K .......... .......... .......... .......... .......... 77% 609K 46s 2020-11-20T12:18:26.310 INFO:tasks.workunit.client.0.smithi093.stderr:130650K .......... .......... .......... .......... .......... 77% 569K 46s 2020-11-20T12:18:26.388 INFO:tasks.workunit.client.0.smithi093.stderr:130700K .......... .......... .......... .......... .......... 77% 664K 46s 2020-11-20T12:18:26.486 INFO:tasks.workunit.client.0.smithi093.stderr:130750K .......... .......... .......... .......... .......... 77% 500K 46s 2020-11-20T12:18:26.547 INFO:tasks.workunit.client.0.smithi093.stderr:130800K .......... .......... .......... .......... .......... 77% 827K 46s 2020-11-20T12:18:26.612 INFO:tasks.workunit.client.0.smithi093.stderr:130850K .......... .......... .......... .......... .......... 77% 773K 46s 2020-11-20T12:18:26.677 INFO:tasks.workunit.client.0.smithi093.stderr:130900K .......... .......... .......... .......... .......... 77% 758K 46s 2020-11-20T12:18:26.740 INFO:tasks.workunit.client.0.smithi093.stderr:130950K .......... .......... .......... .......... .......... 77% 794K 46s 2020-11-20T12:18:26.807 INFO:tasks.workunit.client.0.smithi093.stderr:131000K .......... .......... .......... .......... .......... 77% 749K 46s 2020-11-20T12:18:26.877 INFO:tasks.workunit.client.0.smithi093.stderr:131050K .......... .......... .......... .......... .......... 77% 706K 46s 2020-11-20T12:18:26.947 INFO:tasks.workunit.client.0.smithi093.stderr:131100K .......... .......... .......... .......... .......... 77% 717K 46s 2020-11-20T12:18:27.018 INFO:tasks.workunit.client.0.smithi093.stderr:131150K .......... .......... .......... .......... .......... 77% 710K 46s 2020-11-20T12:18:27.089 INFO:tasks.workunit.client.0.smithi093.stderr:131200K .......... .......... .......... .......... .......... 77% 695K 46s 2020-11-20T12:18:27.164 INFO:tasks.workunit.client.0.smithi093.stderr:131250K .......... .......... .......... .......... .......... 77% 677K 46s 2020-11-20T12:18:27.236 INFO:tasks.workunit.client.0.smithi093.stderr:131300K .......... .......... .......... .......... .......... 77% 1.17M 46s 2020-11-20T12:18:27.277 INFO:tasks.workunit.client.0.smithi093.stderr:131350K .......... .......... .......... .......... .......... 77% 693K 46s 2020-11-20T12:18:27.354 INFO:tasks.workunit.client.0.smithi093.stderr:131400K .......... .......... .......... .......... .......... 77% 651K 45s 2020-11-20T12:18:27.426 INFO:tasks.workunit.client.0.smithi093.stderr:131450K .......... .......... .......... .......... .......... 78% 688K 45s 2020-11-20T12:18:27.504 INFO:tasks.workunit.client.0.smithi093.stderr:131500K .......... .......... .......... .......... .......... 78% 645K 45s 2020-11-20T12:18:27.582 INFO:tasks.workunit.client.0.smithi093.stderr:131550K .......... .......... .......... .......... .......... 78% 642K 45s 2020-11-20T12:18:27.714 INFO:tasks.workunit.client.0.smithi093.stderr:131600K .......... .......... .......... .......... .......... 78% 381K 45s 2020-11-20T12:18:27.714 INFO:tasks.workunit.client.0.smithi093.stderr:131650K .......... .......... .......... .......... .......... 78% 173M 45s 2020-11-20T12:18:27.794 INFO:tasks.workunit.client.0.smithi093.stderr:131700K .......... .......... .......... .......... .......... 78% 620K 45s 2020-11-20T12:18:27.898 INFO:tasks.workunit.client.0.smithi093.stderr:131750K .......... .......... .......... .......... .......... 78% 490K 45s 2020-11-20T12:18:27.977 INFO:tasks.workunit.client.0.smithi093.stderr:131800K .......... .......... .......... .......... .......... 78% 622K 45s 2020-11-20T12:18:28.049 INFO:tasks.workunit.client.0.smithi093.stderr:131850K .......... .......... .......... .......... .......... 78% 700K 45s 2020-11-20T12:18:28.157 INFO:tasks.workunit.client.0.smithi093.stderr:131900K .......... .......... .......... .......... .......... 78% 461K 45s 2020-11-20T12:18:28.234 INFO:tasks.workunit.client.0.smithi093.stderr:131950K .......... .......... .......... .......... .......... 78% 648K 45s 2020-11-20T12:18:28.313 INFO:tasks.workunit.client.0.smithi093.stderr:132000K .......... .......... .......... .......... .......... 78% 635K 45s 2020-11-20T12:18:28.387 INFO:tasks.workunit.client.0.smithi093.stderr:132050K .......... .......... .......... .......... .......... 78% 679K 45s 2020-11-20T12:18:28.468 INFO:tasks.workunit.client.0.smithi093.stderr:132100K .......... .......... .......... .......... .......... 78% 623K 45s 2020-11-20T12:18:28.548 INFO:tasks.workunit.client.0.smithi093.stderr:132150K .......... .......... .......... .......... .......... 78% 617K 45s 2020-11-20T12:18:28.629 INFO:tasks.workunit.client.0.smithi093.stderr:132200K .......... .......... .......... .......... .......... 78% 1.17M 45s 2020-11-20T12:18:28.670 INFO:tasks.workunit.client.0.smithi093.stderr:132250K .......... .......... .......... .......... .......... 78% 624K 45s 2020-11-20T12:18:28.748 INFO:tasks.workunit.client.0.smithi093.stderr:132300K .......... .......... .......... .......... .......... 78% 653K 44s 2020-11-20T12:18:28.822 INFO:tasks.workunit.client.0.smithi093.stderr:132350K .......... .......... .......... .......... .......... 78% 662K 44s 2020-11-20T12:18:28.885 INFO:tasks.workunit.client.0.smithi093.stderr:132400K .......... .......... .......... .......... .......... 78% 793K 44s 2020-11-20T12:18:28.957 INFO:tasks.workunit.client.0.smithi093.stderr:132450K .......... .......... .......... .......... .......... 78% 714K 44s 2020-11-20T12:18:29.020 INFO:tasks.workunit.client.0.smithi093.stderr:132500K .......... .......... .......... .......... .......... 78% 762K 44s 2020-11-20T12:18:29.091 INFO:tasks.workunit.client.0.smithi093.stderr:132550K .......... .......... .......... .......... .......... 78% 703K 44s 2020-11-20T12:18:29.167 INFO:tasks.workunit.client.0.smithi093.stderr:132600K .......... .......... .......... .......... .......... 78% 657K 44s 2020-11-20T12:18:29.244 INFO:tasks.workunit.client.0.smithi093.stderr:132650K .......... .......... .......... .......... .......... 78% 665K 44s 2020-11-20T12:18:29.321 INFO:tasks.workunit.client.0.smithi093.stderr:132700K .......... .......... .......... .......... .......... 78% 642K 44s 2020-11-20T12:18:29.353 INFO:tasks.workunit.client.0.smithi093.stderr:132750K .......... .......... .......... .......... .......... 78% 1.51M 44s 2020-11-20T12:18:29.432 INFO:tasks.workunit.client.0.smithi093.stderr:132800K .......... .......... .......... .......... .......... 78% 635K 44s 2020-11-20T12:18:29.507 INFO:tasks.workunit.client.0.smithi093.stderr:132850K .......... .......... .......... .......... .......... 78% 664K 44s 2020-11-20T12:18:29.584 INFO:tasks.workunit.client.0.smithi093.stderr:132900K .......... .......... .......... .......... .......... 78% 768K 44s 2020-11-20T12:18:29.632 INFO:tasks.workunit.client.0.smithi093.stderr:132950K .......... .......... .......... .......... .......... 78% 826K 44s 2020-11-20T12:18:29.694 INFO:tasks.workunit.client.0.smithi093.stderr:133000K .......... .......... .......... .......... .......... 78% 818K 44s 2020-11-20T12:18:29.753 INFO:tasks.workunit.client.0.smithi093.stderr:133050K .......... .......... .......... .......... .......... 78% 844K 44s 2020-11-20T12:18:29.792 INFO:tasks.workunit.client.0.smithi093.stderr:133100K .......... .......... .......... .......... .......... 78% 1.73M 43s 2020-11-20T12:18:29.839 INFO:tasks.workunit.client.0.smithi093.stderr:133150K .......... .......... .......... .......... .......... 79% 872K 43s 2020-11-20T12:18:29.895 INFO:tasks.workunit.client.0.smithi093.stderr:133200K .......... .......... .......... .......... .......... 79% 907K 43s 2020-11-20T12:18:29.939 INFO:tasks.workunit.client.0.smithi093.stderr:133250K .......... .......... .......... .......... .......... 79% 1.09M 43s 2020-11-20T12:18:29.994 INFO:tasks.workunit.client.0.smithi093.stderr:133300K .......... .......... .......... .......... .......... 79% 896K 43s 2020-11-20T12:18:30.018 INFO:tasks.workunit.client.0.smithi093.stderr:133350K .......... .......... .......... .......... .......... 79% 2.24M 43s 2020-11-20T12:18:30.080 INFO:tasks.workunit.client.0.smithi093.stderr:133400K .......... .......... .......... .......... .......... 79% 824K 43s 2020-11-20T12:18:30.136 INFO:tasks.workunit.client.0.smithi093.stderr:133450K .......... .......... .......... .......... .......... 79% 840K 43s 2020-11-20T12:18:30.189 INFO:tasks.workunit.client.0.smithi093.stderr:133500K .......... .......... .......... .......... .......... 79% 956K 43s 2020-11-20T12:18:30.256 INFO:tasks.workunit.client.0.smithi093.stderr:133550K .......... .......... .......... .......... .......... 79% 783K 43s 2020-11-20T12:18:30.275 INFO:tasks.workunit.client.0.smithi093.stderr:133600K .......... .......... .......... .......... .......... 79% 2.24M 43s 2020-11-20T12:18:30.338 INFO:tasks.workunit.client.0.smithi093.stderr:133650K .......... .......... .......... .......... .......... 79% 789K 43s 2020-11-20T12:18:30.390 INFO:tasks.workunit.client.0.smithi093.stderr:133700K .......... .......... .......... .......... .......... 79% 962K 43s 2020-11-20T12:18:30.451 INFO:tasks.workunit.client.0.smithi093.stderr:133750K .......... .......... .......... .......... .......... 79% 819K 43s 2020-11-20T12:18:30.478 INFO:tasks.workunit.client.0.smithi093.stderr:133800K .......... .......... .......... .......... .......... 79% 1.96M 43s 2020-11-20T12:18:30.543 INFO:tasks.workunit.client.0.smithi093.stderr:133850K .......... .......... .......... .......... .......... 79% 741K 43s 2020-11-20T12:18:30.600 INFO:tasks.workunit.client.0.smithi093.stderr:133900K .......... .......... .......... .......... .......... 79% 905K 42s 2020-11-20T12:18:30.664 INFO:tasks.workunit.client.0.smithi093.stderr:133950K .......... .......... .......... .......... .......... 79% 765K 42s 2020-11-20T12:18:30.688 INFO:tasks.workunit.client.0.smithi093.stderr:134000K .......... .......... .......... .......... .......... 79% 1.99M 42s 2020-11-20T12:18:30.752 INFO:tasks.workunit.client.0.smithi093.stderr:134050K .......... .......... .......... .......... .......... 79% 784K 42s 2020-11-20T12:18:30.801 INFO:tasks.workunit.client.0.smithi093.stderr:134100K .......... .......... .......... .......... .......... 79% 1.02M 42s 2020-11-20T12:18:30.863 INFO:tasks.workunit.client.0.smithi093.stderr:134150K .......... .......... .......... .......... .......... 79% 793K 42s 2020-11-20T12:18:30.894 INFO:tasks.workunit.client.0.smithi093.stderr:134200K .......... .......... .......... .......... .......... 79% 1.60M 42s 2020-11-20T12:18:30.952 INFO:tasks.workunit.client.0.smithi093.stderr:134250K .......... .......... .......... .......... .......... 79% 855K 42s 2020-11-20T12:18:31.012 INFO:tasks.workunit.client.0.smithi093.stderr:134300K .......... .......... .......... .......... .......... 79% 835K 42s 2020-11-20T12:18:31.045 INFO:tasks.workunit.client.0.smithi093.stderr:134350K .......... .......... .......... .......... .......... 79% 1.46M 42s 2020-11-20T12:18:31.099 INFO:tasks.workunit.client.0.smithi093.stderr:134400K .......... .......... .......... .......... .......... 79% 943K 42s 2020-11-20T12:18:31.161 INFO:tasks.workunit.client.0.smithi093.stderr:134450K .......... .......... .......... .......... .......... 79% 798K 42s 2020-11-20T12:18:31.195 INFO:tasks.workunit.client.0.smithi093.stderr:134500K .......... .......... .......... .......... .......... 79% 1.42M 42s 2020-11-20T12:18:31.263 INFO:tasks.workunit.client.0.smithi093.stderr:134550K .......... .......... .......... .......... .......... 79% 762K 42s 2020-11-20T12:18:31.312 INFO:tasks.workunit.client.0.smithi093.stderr:134600K .......... .......... .......... .......... .......... 79% 987K 42s 2020-11-20T12:18:31.348 INFO:tasks.workunit.client.0.smithi093.stderr:134650K .......... .......... .......... .......... .......... 79% 1.34M 42s 2020-11-20T12:18:31.416 INFO:tasks.workunit.client.0.smithi093.stderr:134700K .......... .......... .......... .......... .......... 79% 741K 41s 2020-11-20T12:18:31.465 INFO:tasks.workunit.client.0.smithi093.stderr:134750K .......... .......... .......... .......... .......... 79% 999K 41s 2020-11-20T12:18:31.501 INFO:tasks.workunit.client.0.smithi093.stderr:134800K .......... .......... .......... .......... .......... 79% 1.40M 41s 2020-11-20T12:18:31.553 INFO:tasks.workunit.client.0.smithi093.stderr:134850K .......... .......... .......... .......... .......... 80% 960K 41s 2020-11-20T12:18:31.620 INFO:tasks.workunit.client.0.smithi093.stderr:134900K .......... .......... .......... .......... .......... 80% 742K 41s 2020-11-20T12:18:31.653 INFO:tasks.workunit.client.0.smithi093.stderr:134950K .......... .......... .......... .......... .......... 80% 1.51M 41s 2020-11-20T12:18:31.717 INFO:tasks.workunit.client.0.smithi093.stderr:135000K .......... .......... .......... .......... .......... 80% 822K 41s 2020-11-20T12:18:31.776 INFO:tasks.workunit.client.0.smithi093.stderr:135050K .......... .......... .......... .......... .......... 80% 2.20M 41s 2020-11-20T12:18:31.805 INFO:tasks.workunit.client.0.smithi093.stderr:135100K .......... .......... .......... .......... .......... 80% 756K 41s 2020-11-20T12:18:31.857 INFO:tasks.workunit.client.0.smithi093.stderr:135150K .......... .......... .......... .......... .......... 80% 894K 41s 2020-11-20T12:18:31.882 INFO:tasks.workunit.client.0.smithi093.stderr:135200K .......... .......... .......... .......... .......... 80% 1.97M 41s 2020-11-20T12:18:31.943 INFO:tasks.workunit.client.0.smithi093.stderr:135250K .......... .......... .......... .......... .......... 80% 820K 41s 2020-11-20T12:18:31.996 INFO:tasks.workunit.client.0.smithi093.stderr:135300K .......... .......... .......... .......... .......... 80% 935K 41s 2020-11-20T12:18:32.022 INFO:tasks.workunit.client.0.smithi093.stderr:135350K .......... .......... .......... .......... .......... 80% 2.05M 41s 2020-11-20T12:18:32.078 INFO:tasks.workunit.client.0.smithi093.stderr:135400K .......... .......... .......... .......... .......... 80% 931K 41s 2020-11-20T12:18:32.102 INFO:tasks.workunit.client.0.smithi093.stderr:135450K .......... .......... .......... .......... .......... 80% 1.81M 40s 2020-11-20T12:18:32.162 INFO:tasks.workunit.client.0.smithi093.stderr:135500K .......... .......... .......... .......... .......... 80% 811K 40s 2020-11-20T12:18:32.217 INFO:tasks.workunit.client.0.smithi093.stderr:135550K .......... .......... .......... .......... .......... 80% 944K 40s 2020-11-20T12:18:32.245 INFO:tasks.workunit.client.0.smithi093.stderr:135600K .......... .......... .......... .......... .......... 80% 1.66M 40s 2020-11-20T12:18:32.290 INFO:tasks.workunit.client.0.smithi093.stderr:135650K .......... .......... .......... .......... .......... 80% 1.09M 40s 2020-11-20T12:18:32.319 INFO:tasks.workunit.client.0.smithi093.stderr:135700K .......... .......... .......... .......... .......... 80% 1.68M 40s 2020-11-20T12:18:32.380 INFO:tasks.workunit.client.0.smithi093.stderr:135750K .......... .......... .......... .......... .......... 80% 817K 40s 2020-11-20T12:18:32.440 INFO:tasks.workunit.client.0.smithi093.stderr:135800K .......... .......... .......... .......... .......... 80% 842K 40s 2020-11-20T12:18:32.470 INFO:tasks.workunit.client.0.smithi093.stderr:135850K .......... .......... .......... .......... .......... 80% 1.58M 40s 2020-11-20T12:18:32.515 INFO:tasks.workunit.client.0.smithi093.stderr:135900K .......... .......... .......... .......... .......... 80% 1.08M 40s 2020-11-20T12:18:32.549 INFO:tasks.workunit.client.0.smithi093.stderr:135950K .......... .......... .......... .......... .......... 80% 1.46M 40s 2020-11-20T12:18:32.604 INFO:tasks.workunit.client.0.smithi093.stderr:136000K .......... .......... .......... .......... .......... 80% 905K 40s 2020-11-20T12:18:32.626 INFO:tasks.workunit.client.0.smithi093.stderr:136050K .......... .......... .......... .......... .......... 80% 2.22M 40s 2020-11-20T12:18:32.690 INFO:tasks.workunit.client.0.smithi093.stderr:136100K .......... .......... .......... .......... .......... 80% 785K 40s 2020-11-20T12:18:32.751 INFO:tasks.workunit.client.0.smithi093.stderr:136150K .......... .......... .......... .......... .......... 80% 820K 40s 2020-11-20T12:18:32.777 INFO:tasks.workunit.client.0.smithi093.stderr:136200K .......... .......... .......... .......... .......... 80% 1.86M 40s 2020-11-20T12:18:32.833 INFO:tasks.workunit.client.0.smithi093.stderr:136250K .......... .......... .......... .......... .......... 80% 901K 39s 2020-11-20T12:18:32.862 INFO:tasks.workunit.client.0.smithi093.stderr:136300K .......... .......... .......... .......... .......... 80% 1.67M 39s 2020-11-20T12:18:32.916 INFO:tasks.workunit.client.0.smithi093.stderr:136350K .......... .......... .......... .......... .......... 80% 937K 39s 2020-11-20T12:18:32.944 INFO:tasks.workunit.client.0.smithi093.stderr:136400K .......... .......... .......... .......... .......... 80% 1.69M 39s 2020-11-20T12:18:32.999 INFO:tasks.workunit.client.0.smithi093.stderr:136450K .......... .......... .......... .......... .......... 80% 904K 39s 2020-11-20T12:18:33.020 INFO:tasks.workunit.client.0.smithi093.stderr:136500K .......... .......... .......... .......... .......... 81% 2.30M 39s 2020-11-20T12:18:33.080 INFO:tasks.workunit.client.0.smithi093.stderr:136550K .......... .......... .......... .......... .......... 81% 847K 39s 2020-11-20T12:18:33.141 INFO:tasks.workunit.client.0.smithi093.stderr:136600K .......... .......... .......... .......... .......... 81% 812K 39s 2020-11-20T12:18:33.164 INFO:tasks.workunit.client.0.smithi093.stderr:136650K .......... .......... .......... .......... .......... 81% 2.12M 39s 2020-11-20T12:18:33.216 INFO:tasks.workunit.client.0.smithi093.stderr:136700K .......... .......... .......... .......... .......... 81% 963K 39s 2020-11-20T12:18:33.239 INFO:tasks.workunit.client.0.smithi093.stderr:136750K .......... .......... .......... .......... .......... 81% 2.15M 39s 2020-11-20T12:18:33.289 INFO:tasks.workunit.client.0.smithi093.stderr:136800K .......... .......... .......... .......... .......... 81% 1007K 39s 2020-11-20T12:18:33.310 INFO:tasks.workunit.client.0.smithi093.stderr:136850K .......... .......... .......... .......... .......... 81% 2.30M 39s 2020-11-20T12:18:33.363 INFO:tasks.workunit.client.0.smithi093.stderr:136900K .......... .......... .......... .......... .......... 81% 964K 39s 2020-11-20T12:18:33.386 INFO:tasks.workunit.client.0.smithi093.stderr:136950K .......... .......... .......... .......... .......... 81% 1.96M 39s 2020-11-20T12:18:33.444 INFO:tasks.workunit.client.0.smithi093.stderr:137000K .......... .......... .......... .......... .......... 81% 870K 38s 2020-11-20T12:18:33.470 INFO:tasks.workunit.client.0.smithi093.stderr:137050K .......... .......... .......... .......... .......... 81% 1.88M 38s 2020-11-20T12:18:33.524 INFO:tasks.workunit.client.0.smithi093.stderr:137100K .......... .......... .......... .......... .......... 81% 923K 38s 2020-11-20T12:18:33.550 INFO:tasks.workunit.client.0.smithi093.stderr:137150K .......... .......... .......... .......... .......... 81% 1.91M 38s 2020-11-20T12:18:33.600 INFO:tasks.workunit.client.0.smithi093.stderr:137200K .......... .......... .......... .......... .......... 81% 989K 38s 2020-11-20T12:18:33.630 INFO:tasks.workunit.client.0.smithi093.stderr:137250K .......... .......... .......... .......... .......... 81% 1.79M 38s 2020-11-20T12:18:33.680 INFO:tasks.workunit.client.0.smithi093.stderr:137300K .......... .......... .......... .......... .......... 81% 948K 38s 2020-11-20T12:18:33.709 INFO:tasks.workunit.client.0.smithi093.stderr:137350K .......... .......... .......... .......... .......... 81% 1.68M 38s 2020-11-20T12:18:33.765 INFO:tasks.workunit.client.0.smithi093.stderr:137400K .......... .......... .......... .......... .......... 81% 891K 38s 2020-11-20T12:18:33.791 INFO:tasks.workunit.client.0.smithi093.stderr:137450K .......... .......... .......... .......... .......... 81% 2.07M 38s 2020-11-20T12:18:33.903 INFO:tasks.workunit.client.0.smithi093.stderr:137500K .......... .......... .......... .......... .......... 81% 443K 38s 2020-11-20T12:18:33.903 INFO:tasks.workunit.client.0.smithi093.stderr:137550K .......... .......... .......... .......... .......... 81% 251M 38s 2020-11-20T12:18:33.935 INFO:tasks.workunit.client.0.smithi093.stderr:137600K .......... .......... .......... .......... .......... 81% 1.48M 38s 2020-11-20T12:18:33.984 INFO:tasks.workunit.client.0.smithi093.stderr:137650K .......... .......... .......... .......... .......... 81% 1.00M 38s 2020-11-20T12:18:34.041 INFO:tasks.workunit.client.0.smithi093.stderr:137700K .......... .......... .......... .......... .......... 81% 875K 38s 2020-11-20T12:18:34.078 INFO:tasks.workunit.client.0.smithi093.stderr:137750K .......... .......... .......... .......... .......... 81% 1.33M 37s 2020-11-20T12:18:34.136 INFO:tasks.workunit.client.0.smithi093.stderr:137800K .......... .......... .......... .......... .......... 81% 934K 37s 2020-11-20T12:18:34.181 INFO:tasks.workunit.client.0.smithi093.stderr:137850K .......... .......... .......... .......... .......... 81% 1009K 37s 2020-11-20T12:18:34.213 INFO:tasks.workunit.client.0.smithi093.stderr:137900K .......... .......... .......... .......... .......... 81% 1.54M 37s 2020-11-20T12:18:34.270 INFO:tasks.workunit.client.0.smithi093.stderr:137950K .......... .......... .......... .......... .......... 81% 936K 37s 2020-11-20T12:18:34.317 INFO:tasks.workunit.client.0.smithi093.stderr:138000K .......... .......... .......... .......... .......... 81% 978K 37s 2020-11-20T12:18:34.352 INFO:tasks.workunit.client.0.smithi093.stderr:138050K .......... .......... .......... .......... .......... 81% 1.38M 37s 2020-11-20T12:18:34.414 INFO:tasks.workunit.client.0.smithi093.stderr:138100K .......... .......... .......... .......... .......... 81% 806K 37s 2020-11-20T12:18:34.469 INFO:tasks.workunit.client.0.smithi093.stderr:138150K .......... .......... .......... .......... .......... 81% 915K 37s 2020-11-20T12:18:34.501 INFO:tasks.workunit.client.0.smithi093.stderr:138200K .......... .......... .......... .......... .......... 82% 1.52M 37s 2020-11-20T12:18:34.555 INFO:tasks.workunit.client.0.smithi093.stderr:138250K .......... .......... .......... .......... .......... 82% 933K 37s 2020-11-20T12:18:34.590 INFO:tasks.workunit.client.0.smithi093.stderr:138300K .......... .......... .......... .......... .......... 82% 1.40M 37s 2020-11-20T12:18:34.655 INFO:tasks.workunit.client.0.smithi093.stderr:138350K .......... .......... .......... .......... .......... 82% 763K 37s 2020-11-20T12:18:34.704 INFO:tasks.workunit.client.0.smithi093.stderr:138400K .......... .......... .......... .......... .......... 82% 1.06M 37s 2020-11-20T12:18:34.739 INFO:tasks.workunit.client.0.smithi093.stderr:138450K .......... .......... .......... .......... .......... 82% 1.31M 37s 2020-11-20T12:18:34.788 INFO:tasks.workunit.client.0.smithi093.stderr:138500K .......... .......... .......... .......... .......... 82% 1021K 37s 2020-11-20T12:18:34.828 INFO:tasks.workunit.client.0.smithi093.stderr:138550K .......... .......... .......... .......... .......... 82% 1.22M 36s 2020-11-20T12:18:34.895 INFO:tasks.workunit.client.0.smithi093.stderr:138600K .......... .......... .......... .......... .......... 82% 797K 36s 2020-11-20T12:18:34.914 INFO:tasks.workunit.client.0.smithi093.stderr:138650K .......... .......... .......... .......... .......... 82% 2.08M 36s 2020-11-20T12:18:34.977 INFO:tasks.workunit.client.0.smithi093.stderr:138700K .......... .......... .......... .......... .......... 82% 783K 36s 2020-11-20T12:18:35.016 INFO:tasks.workunit.client.0.smithi093.stderr:138750K .......... .......... .......... .......... .......... 82% 1.25M 36s 2020-11-20T12:18:35.054 INFO:tasks.workunit.client.0.smithi093.stderr:138800K .......... .......... .......... .......... .......... 82% 1.30M 36s 2020-11-20T12:18:35.090 INFO:tasks.workunit.client.0.smithi093.stderr:138850K .......... .......... .......... .......... .......... 82% 1.35M 36s 2020-11-20T12:18:35.162 INFO:tasks.workunit.client.0.smithi093.stderr:138900K .......... .......... .......... .......... .......... 82% 710K 36s 2020-11-20T12:18:35.162 INFO:tasks.workunit.client.0.smithi093.stderr:138950K .......... .......... .......... .......... .......... 82% 441M 36s 2020-11-20T12:18:35.222 INFO:tasks.workunit.client.0.smithi093.stderr:139000K .......... .......... .......... .......... .......... 82% 812K 36s 2020-11-20T12:18:35.251 INFO:tasks.workunit.client.0.smithi093.stderr:139050K .......... .......... .......... .......... .......... 82% 2.00M 36s 2020-11-20T12:18:35.289 INFO:tasks.workunit.client.0.smithi093.stderr:139100K .......... .......... .......... .......... .......... 82% 1.17M 36s 2020-11-20T12:18:35.318 INFO:tasks.workunit.client.0.smithi093.stderr:139150K .......... .......... .......... .......... .......... 82% 1.70M 36s 2020-11-20T12:18:35.359 INFO:tasks.workunit.client.0.smithi093.stderr:139200K .......... .......... .......... .......... .......... 82% 1.17M 36s 2020-11-20T12:18:35.387 INFO:tasks.workunit.client.0.smithi093.stderr:139250K .......... .......... .......... .......... .......... 82% 1.71M 36s 2020-11-20T12:18:35.432 INFO:tasks.workunit.client.0.smithi093.stderr:139300K .......... .......... .......... .......... .......... 82% 1.23M 35s 2020-11-20T12:18:35.491 INFO:tasks.workunit.client.0.smithi093.stderr:139350K .......... .......... .......... .......... .......... 82% 1.73M 35s 2020-11-20T12:18:35.505 INFO:tasks.workunit.client.0.smithi093.stderr:139400K .......... .......... .......... .......... .......... 82% 1.04M 35s 2020-11-20T12:18:35.566 INFO:tasks.workunit.client.0.smithi093.stderr:139450K .......... .......... .......... .......... .......... 82% 782K 35s 2020-11-20T12:18:35.581 INFO:tasks.workunit.client.0.smithi093.stderr:139500K .......... .......... .......... .......... .......... 82% 3.36M 35s 2020-11-20T12:18:35.638 INFO:tasks.workunit.client.0.smithi093.stderr:139550K .......... .......... .......... .......... .......... 82% 865K 35s 2020-11-20T12:18:35.651 INFO:tasks.workunit.client.0.smithi093.stderr:139600K .......... .......... .......... .......... .......... 82% 3.72M 35s 2020-11-20T12:18:35.714 INFO:tasks.workunit.client.0.smithi093.stderr:139650K .......... .......... .......... .......... .......... 82% 802K 35s 2020-11-20T12:18:35.741 INFO:tasks.workunit.client.0.smithi093.stderr:139700K .......... .......... .......... .......... .......... 82% 1.85M 35s 2020-11-20T12:18:35.791 INFO:tasks.workunit.client.0.smithi093.stderr:139750K .......... .......... .......... .......... .......... 82% 1.00M 35s 2020-11-20T12:18:35.822 INFO:tasks.workunit.client.0.smithi093.stderr:139800K .......... .......... .......... .......... .......... 82% 1.49M 35s 2020-11-20T12:18:35.866 INFO:tasks.workunit.client.0.smithi093.stderr:139850K .......... .......... .......... .......... .......... 82% 1.09M 35s 2020-11-20T12:18:35.900 INFO:tasks.workunit.client.0.smithi093.stderr:139900K .......... .......... .......... .......... .......... 83% 1.46M 35s 2020-11-20T12:18:35.946 INFO:tasks.workunit.client.0.smithi093.stderr:139950K .......... .......... .......... .......... .......... 83% 1.07M 35s 2020-11-20T12:18:35.977 INFO:tasks.workunit.client.0.smithi093.stderr:140000K .......... .......... .......... .......... .......... 83% 1.55M 35s 2020-11-20T12:18:36.024 INFO:tasks.workunit.client.0.smithi093.stderr:140050K .......... .......... .......... .......... .......... 83% 1.05M 34s 2020-11-20T12:18:36.058 INFO:tasks.workunit.client.0.smithi093.stderr:140100K .......... .......... .......... .......... .......... 83% 1.42M 34s 2020-11-20T12:18:36.179 INFO:tasks.workunit.client.0.smithi093.stderr:140150K .......... .......... .......... .......... .......... 83% 414K 34s 2020-11-20T12:18:36.190 INFO:tasks.workunit.client.0.smithi093.stderr:140200K .......... .......... .......... .......... .......... 83% 4.44M 34s 2020-11-20T12:18:36.192 INFO:tasks.workunit.client.0.smithi093.stderr:140250K .......... .......... .......... .......... .......... 83% 408M 34s 2020-11-20T12:18:36.259 INFO:tasks.workunit.client.0.smithi093.stderr:140300K .......... .......... .......... .......... .......... 83% 724K 34s 2020-11-20T12:18:36.330 INFO:tasks.workunit.client.0.smithi093.stderr:140350K .......... .......... .......... .......... .......... 83% 704K 34s 2020-11-20T12:18:36.359 INFO:tasks.workunit.client.0.smithi093.stderr:140400K .......... .......... .......... .......... .......... 83% 3.19M 34s 2020-11-20T12:18:36.412 INFO:tasks.workunit.client.0.smithi093.stderr:140450K .......... .......... .......... .......... .......... 83% 749K 34s 2020-11-20T12:18:36.474 INFO:tasks.workunit.client.0.smithi093.stderr:140500K .......... .......... .......... .......... .......... 83% 805K 34s 2020-11-20T12:18:36.506 INFO:tasks.workunit.client.0.smithi093.stderr:140550K .......... .......... .......... .......... .......... 83% 1.51M 34s 2020-11-20T12:18:36.554 INFO:tasks.workunit.client.0.smithi093.stderr:140600K .......... .......... .......... .......... .......... 83% 1.01M 34s 2020-11-20T12:18:36.612 INFO:tasks.workunit.client.0.smithi093.stderr:140650K .......... .......... .......... .......... .......... 83% 872K 34s 2020-11-20T12:18:36.651 INFO:tasks.workunit.client.0.smithi093.stderr:140700K .......... .......... .......... .......... .......... 83% 1.24M 34s 2020-11-20T12:18:36.695 INFO:tasks.workunit.client.0.smithi093.stderr:140750K .......... .......... .......... .......... .......... 83% 1.10M 34s 2020-11-20T12:18:36.757 INFO:tasks.workunit.client.0.smithi093.stderr:140800K .......... .......... .......... .......... .......... 83% 811K 34s 2020-11-20T12:18:36.796 INFO:tasks.workunit.client.0.smithi093.stderr:140850K .......... .......... .......... .......... .......... 83% 1.27M 33s 2020-11-20T12:18:36.844 INFO:tasks.workunit.client.0.smithi093.stderr:140900K .......... .......... .......... .......... .......... 83% 1.01M 33s 2020-11-20T12:18:36.908 INFO:tasks.workunit.client.0.smithi093.stderr:140950K .......... .......... .......... .......... .......... 83% 782K 33s 2020-11-20T12:18:36.948 INFO:tasks.workunit.client.0.smithi093.stderr:141000K .......... .......... .......... .......... .......... 83% 1.22M 33s 2020-11-20T12:18:36.994 INFO:tasks.workunit.client.0.smithi093.stderr:141050K .......... .......... .......... .......... .......... 83% 1.06M 33s 2020-11-20T12:18:37.062 INFO:tasks.workunit.client.0.smithi093.stderr:141100K .......... .......... .......... .......... .......... 83% 1.02M 33s 2020-11-20T12:18:37.082 INFO:tasks.workunit.client.0.smithi093.stderr:141150K .......... .......... .......... .......... .......... 83% 1.20M 33s 2020-11-20T12:18:37.230 INFO:tasks.workunit.client.0.smithi093.stderr:141200K .......... .......... .......... .......... .......... 83% 726K 33s 2020-11-20T12:18:37.267 INFO:tasks.workunit.client.0.smithi093.stderr:141250K .......... .......... .......... .......... .......... 83% 438K 33s 2020-11-20T12:18:37.267 INFO:tasks.workunit.client.0.smithi093.stderr:141300K .......... .......... .......... .......... .......... 83% 198M 33s 2020-11-20T12:18:37.330 INFO:tasks.workunit.client.0.smithi093.stderr:141350K .......... .......... .......... .......... .......... 83% 775K 33s 2020-11-20T12:18:37.391 INFO:tasks.workunit.client.0.smithi093.stderr:141400K .......... .......... .......... .......... .......... 83% 824K 33s 2020-11-20T12:18:37.465 INFO:tasks.workunit.client.0.smithi093.stderr:141450K .......... .......... .......... .......... .......... 83% 674K 33s 2020-11-20T12:18:37.525 INFO:tasks.workunit.client.0.smithi093.stderr:141500K .......... .......... .......... .......... .......... 83% 837K 33s 2020-11-20T12:18:37.593 INFO:tasks.workunit.client.0.smithi093.stderr:141550K .......... .......... .......... .......... .......... 84% 734K 33s 2020-11-20T12:18:37.661 INFO:tasks.workunit.client.0.smithi093.stderr:141600K .......... .......... .......... .......... .......... 84% 739K 33s 2020-11-20T12:18:37.714 INFO:tasks.workunit.client.0.smithi093.stderr:141650K .......... .......... .......... .......... .......... 84% 1021K 33s 2020-11-20T12:18:37.770 INFO:tasks.workunit.client.0.smithi093.stderr:141700K .......... .......... .......... .......... .......... 84% 828K 32s 2020-11-20T12:18:37.831 INFO:tasks.workunit.client.0.smithi093.stderr:141750K .......... .......... .......... .......... .......... 84% 812K 32s 2020-11-20T12:18:37.891 INFO:tasks.workunit.client.0.smithi093.stderr:141800K .......... .......... .......... .......... .......... 84% 844K 32s 2020-11-20T12:18:37.965 INFO:tasks.workunit.client.0.smithi093.stderr:141850K .......... .......... .......... .......... .......... 84% 670K 32s 2020-11-20T12:18:38.027 INFO:tasks.workunit.client.0.smithi093.stderr:141900K .......... .......... .......... .......... .......... 84% 809K 32s 2020-11-20T12:18:38.082 INFO:tasks.workunit.client.0.smithi093.stderr:141950K .......... .......... .......... .......... .......... 84% 904K 32s 2020-11-20T12:18:38.145 INFO:tasks.workunit.client.0.smithi093.stderr:142000K .......... .......... .......... .......... .......... 84% 800K 32s 2020-11-20T12:18:38.269 INFO:tasks.workunit.client.0.smithi093.stderr:142050K .......... .......... .......... .......... .......... 84% 403K 32s 2020-11-20T12:18:38.306 INFO:tasks.workunit.client.0.smithi093.stderr:142100K .......... .......... .......... .......... .......... 84% 1.33M 32s 2020-11-20T12:18:38.383 INFO:tasks.workunit.client.0.smithi093.stderr:142150K .......... .......... .......... .......... .......... 84% 644K 32s 2020-11-20T12:18:38.453 INFO:tasks.workunit.client.0.smithi093.stderr:142200K .......... .......... .......... .......... .......... 84% 713K 32s 2020-11-20T12:18:38.549 INFO:tasks.workunit.client.0.smithi093.stderr:142250K .......... .......... .......... .......... .......... 84% 530K 32s 2020-11-20T12:18:38.616 INFO:tasks.workunit.client.0.smithi093.stderr:142300K .......... .......... .......... .......... .......... 84% 734K 32s 2020-11-20T12:18:38.683 INFO:tasks.workunit.client.0.smithi093.stderr:142350K .......... .......... .......... .......... .......... 84% 750K 32s 2020-11-20T12:18:38.751 INFO:tasks.workunit.client.0.smithi093.stderr:142400K .......... .......... .......... .......... .......... 84% 734K 32s 2020-11-20T12:18:38.828 INFO:tasks.workunit.client.0.smithi093.stderr:142450K .......... .......... .......... .......... .......... 84% 673K 32s 2020-11-20T12:18:38.900 INFO:tasks.workunit.client.0.smithi093.stderr:142500K .......... .......... .......... .......... .......... 84% 662K 32s 2020-11-20T12:18:38.972 INFO:tasks.workunit.client.0.smithi093.stderr:142550K .......... .......... .......... .......... .......... 84% 726K 31s 2020-11-20T12:18:39.044 INFO:tasks.workunit.client.0.smithi093.stderr:142600K .......... .......... .......... .......... .......... 84% 670K 31s 2020-11-20T12:18:39.117 INFO:tasks.workunit.client.0.smithi093.stderr:142650K .......... .......... .......... .......... .......... 84% 694K 31s 2020-11-20T12:18:39.192 INFO:tasks.workunit.client.0.smithi093.stderr:142700K .......... .......... .......... .......... .......... 84% 661K 31s 2020-11-20T12:18:39.241 INFO:tasks.workunit.client.0.smithi093.stderr:142750K .......... .......... .......... .......... .......... 84% 1008K 31s 2020-11-20T12:18:39.321 INFO:tasks.workunit.client.0.smithi093.stderr:142800K .......... .......... .......... .......... .......... 84% 630K 31s 2020-11-20T12:18:39.400 INFO:tasks.workunit.client.0.smithi093.stderr:142850K .......... .......... .......... .......... .......... 84% 656K 31s 2020-11-20T12:18:39.473 INFO:tasks.workunit.client.0.smithi093.stderr:142900K .......... .......... .......... .......... .......... 84% 729K 31s 2020-11-20T12:18:39.543 INFO:tasks.workunit.client.0.smithi093.stderr:142950K .......... .......... .......... .......... .......... 84% 649K 31s 2020-11-20T12:18:39.623 INFO:tasks.workunit.client.0.smithi093.stderr:143000K .......... .......... .......... .......... .......... 84% 626K 31s 2020-11-20T12:18:39.699 INFO:tasks.workunit.client.0.smithi093.stderr:143050K .......... .......... .......... .......... .......... 84% 653K 31s 2020-11-20T12:18:39.777 INFO:tasks.workunit.client.0.smithi093.stderr:143100K .......... .......... .......... .......... .......... 84% 658K 31s 2020-11-20T12:18:39.828 INFO:tasks.workunit.client.0.smithi093.stderr:143150K .......... .......... .......... .......... .......... 84% 953K 31s 2020-11-20T12:18:39.872 INFO:tasks.workunit.client.0.smithi093.stderr:143200K .......... .......... .......... .......... .......... 84% 1.10M 31s 2020-11-20T12:18:39.935 INFO:tasks.workunit.client.0.smithi093.stderr:143250K .......... .......... .......... .......... .......... 85% 797K 31s 2020-11-20T12:18:39.998 INFO:tasks.workunit.client.0.smithi093.stderr:143300K .......... .......... .......... .......... .......... 85% 787K 31s 2020-11-20T12:18:40.064 INFO:tasks.workunit.client.0.smithi093.stderr:143350K .......... .......... .......... .......... .......... 85% 753K 31s 2020-11-20T12:18:40.128 INFO:tasks.workunit.client.0.smithi093.stderr:143400K .......... .......... .......... .......... .......... 85% 794K 30s 2020-11-20T12:18:40.167 INFO:tasks.workunit.client.0.smithi093.stderr:143450K .......... .......... .......... .......... .......... 85% 1.26M 30s 2020-11-20T12:18:40.205 INFO:tasks.workunit.client.0.smithi093.stderr:143500K .......... .......... .......... .......... .......... 85% 1.25M 30s 2020-11-20T12:18:40.262 INFO:tasks.workunit.client.0.smithi093.stderr:143550K .......... .......... .......... .......... .......... 85% 890K 30s 2020-11-20T12:18:40.329 INFO:tasks.workunit.client.0.smithi093.stderr:143600K .......... .......... .......... .......... .......... 85% 742K 30s 2020-11-20T12:18:40.373 INFO:tasks.workunit.client.0.smithi093.stderr:143650K .......... .......... .......... .......... .......... 85% 1.11M 30s 2020-11-20T12:18:40.443 INFO:tasks.workunit.client.0.smithi093.stderr:143700K .......... .......... .......... .......... .......... 85% 714K 30s 2020-11-20T12:18:40.477 INFO:tasks.workunit.client.0.smithi093.stderr:143750K .......... .......... .......... .......... .......... 85% 1.42M 30s 2020-11-20T12:18:40.542 INFO:tasks.workunit.client.0.smithi093.stderr:143800K .......... .......... .......... .......... .......... 85% 770K 30s 2020-11-20T12:18:40.606 INFO:tasks.workunit.client.0.smithi093.stderr:143850K .......... .......... .......... .......... .......... 85% 805K 30s 2020-11-20T12:18:40.653 INFO:tasks.workunit.client.0.smithi093.stderr:143900K .......... .......... .......... .......... .......... 85% 1.01M 30s 2020-11-20T12:18:40.691 INFO:tasks.workunit.client.0.smithi093.stderr:143950K .......... .......... .......... .......... .......... 85% 1.27M 30s 2020-11-20T12:18:40.765 INFO:tasks.workunit.client.0.smithi093.stderr:144000K .......... .......... .......... .......... .......... 85% 699K 30s 2020-11-20T12:18:40.829 INFO:tasks.workunit.client.0.smithi093.stderr:144050K .......... .......... .......... .......... .......... 85% 773K 30s 2020-11-20T12:18:40.856 INFO:tasks.workunit.client.0.smithi093.stderr:144100K .......... .......... .......... .......... .......... 85% 1.73M 30s 2020-11-20T12:18:40.920 INFO:tasks.workunit.client.0.smithi093.stderr:144150K .......... .......... .......... .......... .......... 85% 779K 30s 2020-11-20T12:18:40.984 INFO:tasks.workunit.client.0.smithi093.stderr:144200K .......... .......... .......... .......... .......... 85% 784K 29s 2020-11-20T12:18:41.031 INFO:tasks.workunit.client.0.smithi093.stderr:144250K .......... .......... .......... .......... .......... 85% 1.06M 29s 2020-11-20T12:18:41.081 INFO:tasks.workunit.client.0.smithi093.stderr:144300K .......... .......... .......... .......... .......... 85% 991K 29s 2020-11-20T12:18:41.147 INFO:tasks.workunit.client.0.smithi093.stderr:144350K .......... .......... .......... .......... .......... 85% 753K 29s 2020-11-20T12:18:41.193 INFO:tasks.workunit.client.0.smithi093.stderr:144400K .......... .......... .......... .......... .......... 85% 1.04M 29s 2020-11-20T12:18:41.245 INFO:tasks.workunit.client.0.smithi093.stderr:144450K .......... .......... .......... .......... .......... 85% 976K 29s 2020-11-20T12:18:41.304 INFO:tasks.workunit.client.0.smithi093.stderr:144500K .......... .......... .......... .......... .......... 85% 841K 29s 2020-11-20T12:18:41.367 INFO:tasks.workunit.client.0.smithi093.stderr:144550K .......... .......... .......... .......... .......... 85% 807K 29s 2020-11-20T12:18:41.415 INFO:tasks.workunit.client.0.smithi093.stderr:144600K .......... .......... .......... .......... .......... 85% 1024K 29s 2020-11-20T12:18:41.454 INFO:tasks.workunit.client.0.smithi093.stderr:144650K .......... .......... .......... .......... .......... 85% 1.28M 29s 2020-11-20T12:18:41.517 INFO:tasks.workunit.client.0.smithi093.stderr:144700K .......... .......... .......... .......... .......... 85% 787K 29s 2020-11-20T12:18:41.566 INFO:tasks.workunit.client.0.smithi093.stderr:144750K .......... .......... .......... .......... .......... 85% 1.00M 29s 2020-11-20T12:18:41.600 INFO:tasks.workunit.client.0.smithi093.stderr:144800K .......... .......... .......... .......... .......... 85% 1.40M 29s 2020-11-20T12:18:41.659 INFO:tasks.workunit.client.0.smithi093.stderr:144850K .......... .......... .......... .......... .......... 85% 854K 29s 2020-11-20T12:18:41.707 INFO:tasks.workunit.client.0.smithi093.stderr:144900K .......... .......... .......... .......... .......... 85% 2.13M 29s 2020-11-20T12:18:41.747 INFO:tasks.workunit.client.0.smithi093.stderr:144950K .......... .......... .......... .......... .......... 86% 782K 29s 2020-11-20T12:18:41.787 INFO:tasks.workunit.client.0.smithi093.stderr:145000K .......... .......... .......... .......... .......... 86% 1.20M 28s 2020-11-20T12:18:41.829 INFO:tasks.workunit.client.0.smithi093.stderr:145050K .......... .......... .......... .......... .......... 86% 1.14M 28s 2020-11-20T12:18:41.891 INFO:tasks.workunit.client.0.smithi093.stderr:145100K .......... .......... .......... .......... .......... 86% 817K 28s 2020-11-20T12:18:41.937 INFO:tasks.workunit.client.0.smithi093.stderr:145150K .......... .......... .......... .......... .......... 86% 1.10M 28s 2020-11-20T12:18:41.984 INFO:tasks.workunit.client.0.smithi093.stderr:145200K .......... .......... .......... .......... .......... 86% 1021K 28s 2020-11-20T12:18:42.048 INFO:tasks.workunit.client.0.smithi093.stderr:145250K .......... .......... .......... .......... .......... 86% 786K 28s 2020-11-20T12:18:42.090 INFO:tasks.workunit.client.0.smithi093.stderr:145300K .......... .......... .......... .......... .......... 86% 1.15M 28s 2020-11-20T12:18:42.135 INFO:tasks.workunit.client.0.smithi093.stderr:145350K .......... .......... .......... .......... .......... 86% 1.16M 28s 2020-11-20T12:18:42.201 INFO:tasks.workunit.client.0.smithi093.stderr:145400K .......... .......... .......... .......... .......... 86% 731K 28s 2020-11-20T12:18:42.225 INFO:tasks.workunit.client.0.smithi093.stderr:145450K .......... .......... .......... .......... .......... 86% 2.35M 28s 2020-11-20T12:18:42.287 INFO:tasks.workunit.client.0.smithi093.stderr:145500K .......... .......... .......... .......... .......... 86% 759K 28s 2020-11-20T12:18:42.333 INFO:tasks.workunit.client.0.smithi093.stderr:145550K .......... .......... .......... .......... .......... 86% 1.07M 28s 2020-11-20T12:18:42.378 INFO:tasks.workunit.client.0.smithi093.stderr:145600K .......... .......... .......... .......... .......... 86% 1.07M 28s 2020-11-20T12:18:42.439 INFO:tasks.workunit.client.0.smithi093.stderr:145650K .......... .......... .......... .......... .......... 86% 820K 28s 2020-11-20T12:18:42.463 INFO:tasks.workunit.client.0.smithi093.stderr:145700K .......... .......... .......... .......... .......... 86% 2.14M 28s 2020-11-20T12:18:42.528 INFO:tasks.workunit.client.0.smithi093.stderr:145750K .......... .......... .......... .......... .......... 86% 756K 28s 2020-11-20T12:18:42.566 INFO:tasks.workunit.client.0.smithi093.stderr:145800K .......... .......... .......... .......... .......... 86% 1.35M 27s 2020-11-20T12:18:42.605 INFO:tasks.workunit.client.0.smithi093.stderr:145850K .......... .......... .......... .......... .......... 86% 1.18M 27s 2020-11-20T12:18:42.665 INFO:tasks.workunit.client.0.smithi093.stderr:145900K .......... .......... .......... .......... .......... 86% 847K 27s 2020-11-20T12:18:42.682 INFO:tasks.workunit.client.0.smithi093.stderr:145950K .......... .......... .......... .......... .......... 86% 2.86M 27s 2020-11-20T12:18:42.746 INFO:tasks.workunit.client.0.smithi093.stderr:146000K .......... .......... .......... .......... .......... 86% 780K 27s 2020-11-20T12:18:42.785 INFO:tasks.workunit.client.0.smithi093.stderr:146050K .......... .......... .......... .......... .......... 86% 1.32M 27s 2020-11-20T12:18:42.817 INFO:tasks.workunit.client.0.smithi093.stderr:146100K .......... .......... .......... .......... .......... 86% 1.42M 27s 2020-11-20T12:18:42.858 INFO:tasks.workunit.client.0.smithi093.stderr:146150K .......... .......... .......... .......... .......... 86% 1.22M 27s 2020-11-20T12:18:42.894 INFO:tasks.workunit.client.0.smithi093.stderr:146200K .......... .......... .......... .......... .......... 86% 1.34M 27s 2020-11-20T12:18:42.957 INFO:tasks.workunit.client.0.smithi093.stderr:146250K .......... .......... .......... .......... .......... 86% 797K 27s 2020-11-20T12:18:42.973 INFO:tasks.workunit.client.0.smithi093.stderr:146300K .......... .......... .......... .......... .......... 86% 3.03M 27s 2020-11-20T12:18:43.039 INFO:tasks.workunit.client.0.smithi093.stderr:146350K .......... .......... .......... .......... .......... 86% 750K 27s 2020-11-20T12:18:43.078 INFO:tasks.workunit.client.0.smithi093.stderr:146400K .......... .......... .......... .......... .......... 86% 1.27M 27s 2020-11-20T12:18:43.117 INFO:tasks.workunit.client.0.smithi093.stderr:146450K .......... .......... .......... .......... .......... 86% 1.25M 27s 2020-11-20T12:18:43.160 INFO:tasks.workunit.client.0.smithi093.stderr:146500K .......... .......... .......... .......... .......... 86% 1.18M 27s 2020-11-20T12:18:43.201 INFO:tasks.workunit.client.0.smithi093.stderr:146550K .......... .......... .......... .......... .......... 86% 1.13M 27s 2020-11-20T12:18:43.323 INFO:tasks.workunit.client.0.smithi093.stderr:146600K .......... .......... .......... .......... .......... 86% 416K 26s 2020-11-20T12:18:43.323 INFO:tasks.workunit.client.0.smithi093.stderr:146650K .......... .......... .......... .......... .......... 87% 381M 26s 2020-11-20T12:18:43.354 INFO:tasks.workunit.client.0.smithi093.stderr:146700K .......... .......... .......... .......... .......... 87% 1.77M 26s 2020-11-20T12:18:43.397 INFO:tasks.workunit.client.0.smithi093.stderr:146750K .......... .......... .......... .......... .......... 87% 1.03M 26s 2020-11-20T12:18:43.471 INFO:tasks.workunit.client.0.smithi093.stderr:146800K .......... .......... .......... .......... .......... 87% 680K 26s 2020-11-20T12:18:43.521 INFO:tasks.workunit.client.0.smithi093.stderr:146850K .......... .......... .......... .......... .......... 87% 992K 26s 2020-11-20T12:18:43.592 INFO:tasks.workunit.client.0.smithi093.stderr:146900K .......... .......... .......... .......... .......... 87% 704K 26s 2020-11-20T12:18:43.635 INFO:tasks.workunit.client.0.smithi093.stderr:146950K .......... .......... .......... .......... .......... 87% 1.14M 26s 2020-11-20T12:18:43.685 INFO:tasks.workunit.client.0.smithi093.stderr:147000K .......... .......... .......... .......... .......... 87% 997K 26s 2020-11-20T12:18:43.759 INFO:tasks.workunit.client.0.smithi093.stderr:147050K .......... .......... .......... .......... .......... 87% 701K 26s 2020-11-20T12:18:43.827 INFO:tasks.workunit.client.0.smithi093.stderr:147100K .......... .......... .......... .......... .......... 87% 708K 26s 2020-11-20T12:18:43.918 INFO:tasks.workunit.client.0.smithi093.stderr:147150K .......... .......... .......... .......... .......... 87% 553K 26s 2020-11-20T12:18:43.925 INFO:tasks.workunit.client.0.smithi093.stderr:147200K .......... .......... .......... .......... .......... 87% 5.86M 26s 2020-11-20T12:18:44.003 INFO:tasks.workunit.client.0.smithi093.stderr:147250K .......... .......... .......... .......... .......... 87% 643K 26s 2020-11-20T12:18:44.083 INFO:tasks.workunit.client.0.smithi093.stderr:147300K .......... .......... .......... .......... .......... 87% 647K 26s 2020-11-20T12:18:44.150 INFO:tasks.workunit.client.0.smithi093.stderr:147350K .......... .......... .......... .......... .......... 87% 724K 26s 2020-11-20T12:18:44.204 INFO:tasks.workunit.client.0.smithi093.stderr:147400K .......... .......... .......... .......... .......... 87% 926K 25s 2020-11-20T12:18:44.268 INFO:tasks.workunit.client.0.smithi093.stderr:147450K .......... .......... .......... .......... .......... 87% 780K 25s 2020-11-20T12:18:44.333 INFO:tasks.workunit.client.0.smithi093.stderr:147500K .......... .......... .......... .......... .......... 87% 853K 25s 2020-11-20T12:18:44.391 INFO:tasks.workunit.client.0.smithi093.stderr:147550K .......... .......... .......... .......... .......... 87% 769K 25s 2020-11-20T12:18:44.462 INFO:tasks.workunit.client.0.smithi093.stderr:147600K .......... .......... .......... .......... .......... 87% 985K 25s 2020-11-20T12:18:44.513 INFO:tasks.workunit.client.0.smithi093.stderr:147650K .......... .......... .......... .......... .......... 87% 708K 25s 2020-11-20T12:18:44.586 INFO:tasks.workunit.client.0.smithi093.stderr:147700K .......... .......... .......... .......... .......... 87% 685K 25s 2020-11-20T12:18:44.624 INFO:tasks.workunit.client.0.smithi093.stderr:147750K .......... .......... .......... .......... .......... 87% 1.28M 25s 2020-11-20T12:18:44.696 INFO:tasks.workunit.client.0.smithi093.stderr:147800K .......... .......... .......... .......... .......... 87% 700K 25s 2020-11-20T12:18:44.765 INFO:tasks.workunit.client.0.smithi093.stderr:147850K .......... .......... .......... .......... .......... 87% 716K 25s 2020-11-20T12:18:44.838 INFO:tasks.workunit.client.0.smithi093.stderr:147900K .......... .......... .......... .......... .......... 87% 684K 25s 2020-11-20T12:18:44.915 INFO:tasks.workunit.client.0.smithi093.stderr:147950K .......... .......... .......... .......... .......... 87% 927K 25s 2020-11-20T12:18:44.969 INFO:tasks.workunit.client.0.smithi093.stderr:148000K .......... .......... .......... .......... .......... 87% 650K 25s 2020-11-20T12:18:45.014 INFO:tasks.workunit.client.0.smithi093.stderr:148050K .......... .......... .......... .......... .......... 87% 1.09M 25s 2020-11-20T12:18:45.093 INFO:tasks.workunit.client.0.smithi093.stderr:148100K .......... .......... .......... .......... .......... 87% 633K 25s 2020-11-20T12:18:45.245 INFO:tasks.workunit.client.0.smithi093.stderr:148150K .......... .......... .......... .......... .......... 87% 330K 25s 2020-11-20T12:18:45.245 INFO:tasks.workunit.client.0.smithi093.stderr:148200K .......... .......... .......... .......... .......... 87% 408M 25s 2020-11-20T12:18:45.319 INFO:tasks.workunit.client.0.smithi093.stderr:148250K .......... .......... .......... .......... .......... 87% 689K 24s 2020-11-20T12:18:45.394 INFO:tasks.workunit.client.0.smithi093.stderr:148300K .......... .......... .......... .......... .......... 88% 651K 24s 2020-11-20T12:18:45.469 INFO:tasks.workunit.client.0.smithi093.stderr:148350K .......... .......... .......... .......... .......... 88% 668K 24s 2020-11-20T12:18:45.529 INFO:tasks.workunit.client.0.smithi093.stderr:148400K .......... .......... .......... .......... .......... 88% 838K 24s 2020-11-20T12:18:45.586 INFO:tasks.workunit.client.0.smithi093.stderr:148450K .......... .......... .......... .......... .......... 88% 866K 24s 2020-11-20T12:18:45.643 INFO:tasks.workunit.client.0.smithi093.stderr:148500K .......... .......... .......... .......... .......... 88% 885K 24s 2020-11-20T12:18:45.701 INFO:tasks.workunit.client.0.smithi093.stderr:148550K .......... .......... .......... .......... .......... 88% 863K 24s 2020-11-20T12:18:45.758 INFO:tasks.workunit.client.0.smithi093.stderr:148600K .......... .......... .......... .......... .......... 88% 876K 24s 2020-11-20T12:18:45.819 INFO:tasks.workunit.client.0.smithi093.stderr:148650K .......... .......... .......... .......... .......... 88% 827K 24s 2020-11-20T12:18:45.881 INFO:tasks.workunit.client.0.smithi093.stderr:148700K .......... .......... .......... .......... .......... 88% 790K 24s 2020-11-20T12:18:45.945 INFO:tasks.workunit.client.0.smithi093.stderr:148750K .......... .......... .......... .......... .......... 88% 965K 24s 2020-11-20T12:18:45.997 INFO:tasks.workunit.client.0.smithi093.stderr:148800K .......... .......... .......... .......... .......... 88% 785K 24s 2020-11-20T12:18:46.060 INFO:tasks.workunit.client.0.smithi093.stderr:148850K .......... .......... .......... .......... .......... 88% 803K 24s 2020-11-20T12:18:46.129 INFO:tasks.workunit.client.0.smithi093.stderr:148900K .......... .......... .......... .......... .......... 88% 718K 24s 2020-11-20T12:18:46.199 INFO:tasks.workunit.client.0.smithi093.stderr:148950K .......... .......... .......... .......... .......... 88% 732K 24s 2020-11-20T12:18:46.263 INFO:tasks.workunit.client.0.smithi093.stderr:149000K .......... .......... .......... .......... .......... 88% 907K 24s 2020-11-20T12:18:46.311 INFO:tasks.workunit.client.0.smithi093.stderr:149050K .......... .......... .......... .......... .......... 88% 858K 24s 2020-11-20T12:18:46.384 INFO:tasks.workunit.client.0.smithi093.stderr:149100K .......... .......... .......... .......... .......... 88% 1.06M 23s 2020-11-20T12:18:46.424 INFO:tasks.workunit.client.0.smithi093.stderr:149150K .......... .......... .......... .......... .......... 88% 740K 23s 2020-11-20T12:18:46.487 INFO:tasks.workunit.client.0.smithi093.stderr:149200K .......... .......... .......... .......... .......... 88% 807K 23s 2020-11-20T12:18:46.557 INFO:tasks.workunit.client.0.smithi093.stderr:149250K .......... .......... .......... .......... .......... 88% 714K 23s 2020-11-20T12:18:46.631 INFO:tasks.workunit.client.0.smithi093.stderr:149300K .......... .......... .......... .......... .......... 88% 692K 23s 2020-11-20T12:18:46.689 INFO:tasks.workunit.client.0.smithi093.stderr:149350K .......... .......... .......... .......... .......... 88% 830K 23s 2020-11-20T12:18:46.758 INFO:tasks.workunit.client.0.smithi093.stderr:149400K .......... .......... .......... .......... .......... 88% 726K 23s 2020-11-20T12:18:46.802 INFO:tasks.workunit.client.0.smithi093.stderr:149450K .......... .......... .......... .......... .......... 88% 1.09M 23s 2020-11-20T12:18:46.877 INFO:tasks.workunit.client.0.smithi093.stderr:149500K .......... .......... .......... .......... .......... 88% 675K 23s 2020-11-20T12:18:47.035 INFO:tasks.workunit.client.0.smithi093.stderr:149550K .......... .......... .......... .......... .......... 88% 316K 23s 2020-11-20T12:18:47.067 INFO:tasks.workunit.client.0.smithi093.stderr:149600K .......... .......... .......... .......... .......... 88% 1.55M 23s 2020-11-20T12:18:47.145 INFO:tasks.workunit.client.0.smithi093.stderr:149650K .......... .......... .......... .......... .......... 88% 640K 23s 2020-11-20T12:18:47.220 INFO:tasks.workunit.client.0.smithi093.stderr:149700K .......... .......... .......... .......... .......... 88% 661K 23s 2020-11-20T12:18:47.293 INFO:tasks.workunit.client.0.smithi093.stderr:149750K .......... .......... .......... .......... .......... 88% 689K 23s 2020-11-20T12:18:47.367 INFO:tasks.workunit.client.0.smithi093.stderr:149800K .......... .......... .......... .......... .......... 88% 669K 23s 2020-11-20T12:18:47.439 INFO:tasks.workunit.client.0.smithi093.stderr:149850K .......... .......... .......... .......... .......... 88% 696K 23s 2020-11-20T12:18:47.534 INFO:tasks.workunit.client.0.smithi093.stderr:149900K .......... .......... .......... .......... .......... 88% 528K 23s 2020-11-20T12:18:47.607 INFO:tasks.workunit.client.0.smithi093.stderr:149950K .......... .......... .......... .......... .......... 88% 688K 22s 2020-11-20T12:18:47.684 INFO:tasks.workunit.client.0.smithi093.stderr:150000K .......... .......... .......... .......... .......... 89% 662K 22s 2020-11-20T12:18:47.756 INFO:tasks.workunit.client.0.smithi093.stderr:150050K .......... .......... .......... .......... .......... 89% 678K 22s 2020-11-20T12:18:47.832 INFO:tasks.workunit.client.0.smithi093.stderr:150100K .......... .......... .......... .......... .......... 89% 660K 22s 2020-11-20T12:18:47.910 INFO:tasks.workunit.client.0.smithi093.stderr:150150K .......... .......... .......... .......... .......... 89% 635K 22s 2020-11-20T12:18:47.991 INFO:tasks.workunit.client.0.smithi093.stderr:150200K .......... .......... .......... .......... .......... 89% 624K 22s 2020-11-20T12:18:48.070 INFO:tasks.workunit.client.0.smithi093.stderr:150250K .......... .......... .......... .......... .......... 89% 634K 22s 2020-11-20T12:18:48.134 INFO:tasks.workunit.client.0.smithi093.stderr:150300K .......... .......... .......... .......... .......... 89% 778K 22s 2020-11-20T12:18:48.205 INFO:tasks.workunit.client.0.smithi093.stderr:150350K .......... .......... .......... .......... .......... 89% 706K 22s 2020-11-20T12:18:48.281 INFO:tasks.workunit.client.0.smithi093.stderr:150400K .......... .......... .......... .......... .......... 89% 652K 22s 2020-11-20T12:18:48.357 INFO:tasks.workunit.client.0.smithi093.stderr:150450K .......... .......... .......... .......... .......... 89% 661K 22s 2020-11-20T12:18:48.431 INFO:tasks.workunit.client.0.smithi093.stderr:150500K .......... .......... .......... .......... .......... 89% 678K 22s 2020-11-20T12:18:48.498 INFO:tasks.workunit.client.0.smithi093.stderr:150550K .......... .......... .......... .......... .......... 89% 756K 22s 2020-11-20T12:18:48.560 INFO:tasks.workunit.client.0.smithi093.stderr:150600K .......... .......... .......... .......... .......... 89% 795K 22s 2020-11-20T12:18:48.608 INFO:tasks.workunit.client.0.smithi093.stderr:150650K .......... .......... .......... .......... .......... 89% 1.14M 22s 2020-11-20T12:18:48.663 INFO:tasks.workunit.client.0.smithi093.stderr:150700K .......... .......... .......... .......... .......... 89% 820K 22s 2020-11-20T12:18:48.723 INFO:tasks.workunit.client.0.smithi093.stderr:150750K .......... .......... .......... .......... .......... 89% 838K 22s 2020-11-20T12:18:48.779 INFO:tasks.workunit.client.0.smithi093.stderr:150800K .......... .......... .......... .......... .......... 89% 893K 21s 2020-11-20T12:18:48.819 INFO:tasks.workunit.client.0.smithi093.stderr:150850K .......... .......... .......... .......... .......... 89% 1.24M 21s 2020-11-20T12:18:48.885 INFO:tasks.workunit.client.0.smithi093.stderr:150900K .......... .......... .......... .......... .......... 89% 756K 21s 2020-11-20T12:18:48.955 INFO:tasks.workunit.client.0.smithi093.stderr:150950K .......... .......... .......... .......... .......... 89% 714K 21s 2020-11-20T12:18:48.997 INFO:tasks.workunit.client.0.smithi093.stderr:151000K .......... .......... .......... .......... .......... 89% 1.16M 21s 2020-11-20T12:18:49.064 INFO:tasks.workunit.client.0.smithi093.stderr:151050K .......... .......... .......... .......... .......... 89% 749K 21s 2020-11-20T12:18:49.105 INFO:tasks.workunit.client.0.smithi093.stderr:151100K .......... .......... .......... .......... .......... 89% 1.30M 21s 2020-11-20T12:18:49.174 INFO:tasks.workunit.client.0.smithi093.stderr:151150K .......... .......... .......... .......... .......... 89% 693K 21s 2020-11-20T12:18:49.245 INFO:tasks.workunit.client.0.smithi093.stderr:151200K .......... .......... .......... .......... .......... 89% 699K 21s 2020-11-20T12:18:49.287 INFO:tasks.workunit.client.0.smithi093.stderr:151250K .......... .......... .......... .......... .......... 89% 1.16M 21s 2020-11-20T12:18:49.356 INFO:tasks.workunit.client.0.smithi093.stderr:151300K .......... .......... .......... .......... .......... 89% 731K 21s 2020-11-20T12:18:49.398 INFO:tasks.workunit.client.0.smithi093.stderr:151350K .......... .......... .......... .......... .......... 89% 1.18M 21s 2020-11-20T12:18:49.475 INFO:tasks.workunit.client.0.smithi093.stderr:151400K .......... .......... .......... .......... .......... 89% 641K 21s 2020-11-20T12:18:49.522 INFO:tasks.workunit.client.0.smithi093.stderr:151450K .......... .......... .......... .......... .......... 89% 1.04M 21s 2020-11-20T12:18:49.588 INFO:tasks.workunit.client.0.smithi093.stderr:151500K .......... .......... .......... .......... .......... 89% 752K 21s 2020-11-20T12:18:49.634 INFO:tasks.workunit.client.0.smithi093.stderr:151550K .......... .......... .......... .......... .......... 89% 1.07M 21s 2020-11-20T12:18:49.711 INFO:tasks.workunit.client.0.smithi093.stderr:151600K .......... .......... .......... .......... .......... 89% 649K 20s 2020-11-20T12:18:49.756 INFO:tasks.workunit.client.0.smithi093.stderr:151650K .......... .......... .......... .......... .......... 89% 1.10M 20s 2020-11-20T12:18:49.828 INFO:tasks.workunit.client.0.smithi093.stderr:151700K .......... .......... .......... .......... .......... 90% 685K 20s 2020-11-20T12:18:49.962 INFO:tasks.workunit.client.0.smithi093.stderr:151750K .......... .......... .......... .......... .......... 90% 383K 20s 2020-11-20T12:18:49.974 INFO:tasks.workunit.client.0.smithi093.stderr:151800K .......... .......... .......... .......... .......... 90% 10.2M 20s 2020-11-20T12:18:50.047 INFO:tasks.workunit.client.0.smithi093.stderr:151850K .......... .......... .......... .......... .......... 90% 653K 20s 2020-11-20T12:18:50.112 INFO:tasks.workunit.client.0.smithi093.stderr:151900K .......... .......... .......... .......... .......... 90% 727K 20s 2020-11-20T12:18:50.178 INFO:tasks.workunit.client.0.smithi093.stderr:151950K .......... .......... .......... .......... .......... 90% 727K 20s 2020-11-20T12:18:50.236 INFO:tasks.workunit.client.0.smithi093.stderr:152000K .......... .......... .......... .......... .......... 90% 863K 20s 2020-11-20T12:18:50.295 INFO:tasks.workunit.client.0.smithi093.stderr:152050K .......... .......... .......... .......... .......... 90% 839K 20s 2020-11-20T12:18:50.358 INFO:tasks.workunit.client.0.smithi093.stderr:152100K .......... .......... .......... .......... .......... 90% 792K 20s 2020-11-20T12:18:50.416 INFO:tasks.workunit.client.0.smithi093.stderr:152150K .......... .......... .......... .......... .......... 90% 865K 20s 2020-11-20T12:18:50.440 INFO:tasks.workunit.client.0.smithi093.stderr:152200K .......... .......... .......... .......... .......... 90% 2.07M 20s 2020-11-20T12:18:50.507 INFO:tasks.workunit.client.0.smithi093.stderr:152250K .......... .......... .......... .......... .......... 90% 746K 20s 2020-11-20T12:18:50.575 INFO:tasks.workunit.client.0.smithi093.stderr:152300K .......... .......... .......... .......... .......... 90% 736K 20s 2020-11-20T12:18:50.645 INFO:tasks.workunit.client.0.smithi093.stderr:152350K .......... .......... .......... .......... .......... 90% 712K 20s 2020-11-20T12:18:50.703 INFO:tasks.workunit.client.0.smithi093.stderr:152400K .......... .......... .......... .......... .......... 90% 862K 20s 2020-11-20T12:18:50.767 INFO:tasks.workunit.client.0.smithi093.stderr:152450K .......... .......... .......... .......... .......... 90% 780K 19s 2020-11-20T12:18:50.832 INFO:tasks.workunit.client.0.smithi093.stderr:152500K .......... .......... .......... .......... .......... 90% 770K 19s 2020-11-20T12:18:50.848 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:50.851 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:50.854 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:18:50.863 INFO:tasks.workunit.client.0.smithi093.stderr:152550K .......... .......... .......... .......... .......... 90% 1.56M 19s 2020-11-20T12:18:50.936 INFO:tasks.workunit.client.0.smithi093.stderr:152600K .......... .......... .......... .......... .......... 90% 691K 19s 2020-11-20T12:18:51.009 INFO:tasks.workunit.client.0.smithi093.stderr:152650K .......... .......... .......... .......... .......... 90% 761K 19s 2020-11-20T12:18:51.074 INFO:tasks.workunit.client.0.smithi093.stderr:152700K .......... .......... .......... .......... .......... 90% 712K 19s 2020-11-20T12:18:51.097 INFO:tasks.workunit.client.0.smithi093.stderr:152750K .......... .......... .......... .......... .......... 90% 1.91M 19s 2020-11-20T12:18:51.172 INFO:tasks.workunit.client.0.smithi093.stderr:152800K .......... .......... .......... .......... .......... 90% 667K 19s 2020-11-20T12:18:51.360 INFO:tasks.workunit.client.0.smithi093.stderr:152850K .......... .......... .......... .......... .......... 90% 620K 19s 2020-11-20T12:18:51.360 INFO:tasks.workunit.client.0.smithi093.stderr:152900K .......... .......... .......... .......... .......... 90% 628K 19s 2020-11-20T12:18:51.400 INFO:tasks.workunit.client.0.smithi093.stderr:152950K .......... .......... .......... .......... .......... 90% 866K 19s 2020-11-20T12:18:51.474 INFO:tasks.workunit.client.0.smithi093.stderr:153000K .......... .......... .......... .......... .......... 90% 599K 19s 2020-11-20T12:18:51.546 INFO:tasks.workunit.client.0.smithi093.stderr:153050K .......... .......... .......... .......... .......... 90% 689K 19s 2020-11-20T12:18:51.619 INFO:tasks.workunit.client.0.smithi093.stderr:153100K .......... .......... .......... .......... .......... 90% 688K 19s 2020-11-20T12:18:51.694 INFO:tasks.workunit.client.0.smithi093.stderr:153150K .......... .......... .......... .......... .......... 90% 666K 19s 2020-11-20T12:18:51.771 INFO:tasks.workunit.client.0.smithi093.stderr:153200K .......... .......... .......... .......... .......... 90% 650K 19s 2020-11-20T12:18:51.851 INFO:tasks.workunit.client.0.smithi093.stderr:153250K .......... .......... .......... .......... .......... 90% 631K 18s 2020-11-20T12:18:51.927 INFO:tasks.workunit.client.0.smithi093.stderr:153300K .......... .......... .......... .......... .......... 90% 653K 18s 2020-11-20T12:18:52.004 INFO:tasks.workunit.client.0.smithi093.stderr:153350K .......... .......... .......... .......... .......... 91% 648K 18s 2020-11-20T12:18:52.085 INFO:tasks.workunit.client.0.smithi093.stderr:153400K .......... .......... .......... .......... .......... 91% 615K 18s 2020-11-20T12:18:52.143 INFO:tasks.workunit.client.0.smithi093.stderr:153450K .......... .......... .......... .......... .......... 91% 858K 18s 2020-11-20T12:18:52.220 INFO:tasks.workunit.client.0.smithi093.stderr:153500K .......... .......... .......... .......... .......... 91% 650K 18s 2020-11-20T12:18:52.296 INFO:tasks.workunit.client.0.smithi093.stderr:153550K .......... .......... .......... .......... .......... 91% 661K 18s 2020-11-20T12:18:52.369 INFO:tasks.workunit.client.0.smithi093.stderr:153600K .......... .......... .......... .......... .......... 91% 687K 18s 2020-11-20T12:18:52.442 INFO:tasks.workunit.client.0.smithi093.stderr:153650K .......... .......... .......... .......... .......... 91% 684K 18s 2020-11-20T12:18:52.512 INFO:tasks.workunit.client.0.smithi093.stderr:153700K .......... .......... .......... .......... .......... 91% 1.30M 18s 2020-11-20T12:18:52.548 INFO:tasks.workunit.client.0.smithi093.stderr:153750K .......... .......... .......... .......... .......... 91% 727K 18s 2020-11-20T12:18:52.619 INFO:tasks.workunit.client.0.smithi093.stderr:153800K .......... .......... .......... .......... .......... 91% 710K 18s 2020-11-20T12:18:52.693 INFO:tasks.workunit.client.0.smithi093.stderr:153850K .......... .......... .......... .......... .......... 91% 672K 18s 2020-11-20T12:18:52.755 INFO:tasks.workunit.client.0.smithi093.stderr:153900K .......... .......... .......... .......... .......... 91% 804K 18s 2020-11-20T12:18:52.814 INFO:tasks.workunit.client.0.smithi093.stderr:153950K .......... .......... .......... .......... .......... 91% 840K 18s 2020-11-20T12:18:52.889 INFO:tasks.workunit.client.0.smithi093.stderr:154000K .......... .......... .......... .......... .......... 91% 675K 18s 2020-11-20T12:18:52.924 INFO:tasks.workunit.client.0.smithi093.stderr:154050K .......... .......... .......... .......... .......... 91% 1.40M 18s 2020-11-20T12:18:52.998 INFO:tasks.workunit.client.0.smithi093.stderr:154100K .......... .......... .......... .......... .......... 91% 676K 17s 2020-11-20T12:18:53.072 INFO:tasks.workunit.client.0.smithi093.stderr:154150K .......... .......... .......... .......... .......... 91% 683K 17s 2020-11-20T12:18:53.138 INFO:tasks.workunit.client.0.smithi093.stderr:154200K .......... .......... .......... .......... .......... 91% 746K 17s 2020-11-20T12:18:53.196 INFO:tasks.workunit.client.0.smithi093.stderr:154250K .......... .......... .......... .......... .......... 91% 888K 17s 2020-11-20T12:18:53.275 INFO:tasks.workunit.client.0.smithi093.stderr:154300K .......... .......... .......... .......... .......... 91% 622K 17s 2020-11-20T12:18:53.302 INFO:tasks.workunit.client.0.smithi093.stderr:154350K .......... .......... .......... .......... .......... 91% 1.76M 17s 2020-11-20T12:18:53.373 INFO:tasks.workunit.client.0.smithi093.stderr:154400K .......... .......... .......... .......... .......... 91% 708K 17s 2020-11-20T12:18:53.436 INFO:tasks.workunit.client.0.smithi093.stderr:154450K .......... .......... .......... .......... .......... 91% 799K 17s 2020-11-20T12:18:53.498 INFO:tasks.workunit.client.0.smithi093.stderr:154500K .......... .......... .......... .......... .......... 91% 805K 17s 2020-11-20T12:18:53.522 INFO:tasks.workunit.client.0.smithi093.stderr:154550K .......... .......... .......... .......... .......... 91% 1.97M 17s 2020-11-20T12:18:53.586 INFO:tasks.workunit.client.0.smithi093.stderr:154600K .......... .......... .......... .......... .......... 91% 789K 17s 2020-11-20T12:18:53.651 INFO:tasks.workunit.client.0.smithi093.stderr:154650K .......... .......... .......... .......... .......... 91% 767K 17s 2020-11-20T12:18:53.702 INFO:tasks.workunit.client.0.smithi093.stderr:154700K .......... .......... .......... .......... .......... 91% 985K 17s 2020-11-20T12:18:53.723 INFO:tasks.workunit.client.0.smithi093.stderr:154750K .......... .......... .......... .......... .......... 91% 2.32M 17s 2020-11-20T12:18:53.791 INFO:tasks.workunit.client.0.smithi093.stderr:154800K .......... .......... .......... .......... .......... 91% 733K 17s 2020-11-20T12:18:53.854 INFO:tasks.workunit.client.0.smithi093.stderr:154850K .......... .......... .......... .......... .......... 91% 789K 17s 2020-11-20T12:18:53.913 INFO:tasks.workunit.client.0.smithi093.stderr:154900K .......... .......... .......... .......... .......... 91% 857K 16s 2020-11-20T12:18:53.935 INFO:tasks.workunit.client.0.smithi093.stderr:154950K .......... .......... .......... .......... .......... 91% 2.13M 16s 2020-11-20T12:18:54.002 INFO:tasks.workunit.client.0.smithi093.stderr:155000K .......... .......... .......... .......... .......... 91% 754K 16s 2020-11-20T12:18:54.064 INFO:tasks.workunit.client.0.smithi093.stderr:155050K .......... .......... .......... .......... .......... 92% 815K 16s 2020-11-20T12:18:54.128 INFO:tasks.workunit.client.0.smithi093.stderr:155100K .......... .......... .......... .......... .......... 92% 2.38M 16s 2020-11-20T12:18:54.155 INFO:tasks.workunit.client.0.smithi093.stderr:155150K .......... .......... .......... .......... .......... 92% 709K 16s 2020-11-20T12:18:54.219 INFO:tasks.workunit.client.0.smithi093.stderr:155200K .......... .......... .......... .......... .......... 92% 788K 16s 2020-11-20T12:18:54.279 INFO:tasks.workunit.client.0.smithi093.stderr:155250K .......... .......... .......... .......... .......... 92% 812K 16s 2020-11-20T12:18:54.310 INFO:tasks.workunit.client.0.smithi093.stderr:155300K .......... .......... .......... .......... .......... 92% 1.69M 16s 2020-11-20T12:18:54.381 INFO:tasks.workunit.client.0.smithi093.stderr:155350K .......... .......... .......... .......... .......... 92% 735K 16s 2020-11-20T12:18:54.445 INFO:tasks.workunit.client.0.smithi093.stderr:155400K .......... .......... .......... .......... .......... 92% 831K 16s 2020-11-20T12:18:54.472 INFO:tasks.workunit.client.0.smithi093.stderr:155450K .......... .......... .......... .......... .......... 92% 1.38M 16s 2020-11-20T12:18:54.537 INFO:tasks.workunit.client.0.smithi093.stderr:155500K .......... .......... .......... .......... .......... 92% 847K 16s 2020-11-20T12:18:54.594 INFO:tasks.workunit.client.0.smithi093.stderr:155550K .......... .......... .......... .......... .......... 92% 795K 16s 2020-11-20T12:18:54.624 INFO:tasks.workunit.client.0.smithi093.stderr:155600K .......... .......... .......... .......... .......... 92% 1.64M 16s 2020-11-20T12:18:54.678 INFO:tasks.workunit.client.0.smithi093.stderr:155650K .......... .......... .......... .......... .......... 92% 924K 16s 2020-11-20T12:18:54.737 INFO:tasks.workunit.client.0.smithi093.stderr:155700K .......... .......... .......... .......... .......... 92% 837K 16s 2020-11-20T12:18:54.763 INFO:tasks.workunit.client.0.smithi093.stderr:155750K .......... .......... .......... .......... .......... 92% 2.05M 15s 2020-11-20T12:18:54.818 INFO:tasks.workunit.client.0.smithi093.stderr:155800K .......... .......... .......... .......... .......... 92% 882K 15s 2020-11-20T12:18:54.839 INFO:tasks.workunit.client.0.smithi093.stderr:155850K .......... .......... .......... .......... .......... 92% 2.32M 15s 2020-11-20T12:18:54.901 INFO:tasks.workunit.client.0.smithi093.stderr:155900K .......... .......... .......... .......... .......... 92% 803K 15s 2020-11-20T12:18:54.960 INFO:tasks.workunit.client.0.smithi093.stderr:155950K .......... .......... .......... .......... .......... 92% 854K 15s 2020-11-20T12:18:54.981 INFO:tasks.workunit.client.0.smithi093.stderr:156000K .......... .......... .......... .......... .......... 92% 2.32M 15s 2020-11-20T12:18:55.043 INFO:tasks.workunit.client.0.smithi093.stderr:156050K .......... .......... .......... .......... .......... 92% 890K 15s 2020-11-20T12:18:55.101 INFO:tasks.workunit.client.0.smithi093.stderr:156100K .......... .......... .......... .......... .......... 92% 777K 15s 2020-11-20T12:18:55.120 INFO:tasks.workunit.client.0.smithi093.stderr:156150K .......... .......... .......... .......... .......... 92% 2.60M 15s 2020-11-20T12:18:55.186 INFO:tasks.workunit.client.0.smithi093.stderr:156200K .......... .......... .......... .......... .......... 92% 771K 15s 2020-11-20T12:18:55.202 INFO:tasks.workunit.client.0.smithi093.stderr:156250K .......... .......... .......... .......... .......... 92% 2.93M 15s 2020-11-20T12:18:55.275 INFO:tasks.workunit.client.0.smithi093.stderr:156300K .......... .......... .......... .......... .......... 92% 690K 15s 2020-11-20T12:18:55.333 INFO:tasks.workunit.client.0.smithi093.stderr:156350K .......... .......... .......... .......... .......... 92% 903K 15s 2020-11-20T12:18:55.357 INFO:tasks.workunit.client.0.smithi093.stderr:156400K .......... .......... .......... .......... .......... 92% 1.83M 15s 2020-11-20T12:18:55.418 INFO:tasks.workunit.client.0.smithi093.stderr:156450K .......... .......... .......... .......... .......... 92% 805K 15s 2020-11-20T12:18:55.438 INFO:tasks.workunit.client.0.smithi093.stderr:156500K .......... .......... .......... .......... .......... 92% 2.45M 15s 2020-11-20T12:18:55.513 INFO:tasks.workunit.client.0.smithi093.stderr:156550K .......... .......... .......... .......... .......... 92% 666K 14s 2020-11-20T12:18:55.566 INFO:tasks.workunit.client.0.smithi093.stderr:156600K .......... .......... .......... .......... .......... 92% 946K 14s 2020-11-20T12:18:55.593 INFO:tasks.workunit.client.0.smithi093.stderr:156650K .......... .......... .......... .......... .......... 92% 1.80M 14s 2020-11-20T12:18:55.655 INFO:tasks.workunit.client.0.smithi093.stderr:156700K .......... .......... .......... .......... .......... 92% 814K 14s 2020-11-20T12:18:55.799 INFO:tasks.workunit.client.0.smithi093.stderr:156750K .......... .......... .......... .......... .......... 93% 349K 14s 2020-11-20T12:18:55.799 INFO:tasks.workunit.client.0.smithi093.stderr:156800K .......... .......... .......... .......... .......... 93% 371M 14s 2020-11-20T12:18:55.834 INFO:tasks.workunit.client.0.smithi093.stderr:156850K .......... .......... .......... .......... .......... 93% 1.55M 14s 2020-11-20T12:18:55.882 INFO:tasks.workunit.client.0.smithi093.stderr:156900K .......... .......... .......... .......... .......... 93% 961K 14s 2020-11-20T12:18:55.940 INFO:tasks.workunit.client.0.smithi093.stderr:156950K .......... .......... .......... .......... .......... 93% 862K 14s 2020-11-20T12:18:55.991 INFO:tasks.workunit.client.0.smithi093.stderr:157000K .......... .......... .......... .......... .......... 93% 963K 14s 2020-11-20T12:18:56.028 INFO:tasks.workunit.client.0.smithi093.stderr:157050K .......... .......... .......... .......... .......... 93% 1.36M 14s 2020-11-20T12:18:56.084 INFO:tasks.workunit.client.0.smithi093.stderr:157100K .......... .......... .......... .......... .......... 93% 884K 14s 2020-11-20T12:18:56.136 INFO:tasks.workunit.client.0.smithi093.stderr:157150K .......... .......... .......... .......... .......... 93% 956K 14s 2020-11-20T12:18:56.197 INFO:tasks.workunit.client.0.smithi093.stderr:157200K .......... .......... .......... .......... .......... 93% 824K 14s 2020-11-20T12:18:56.231 INFO:tasks.workunit.client.0.smithi093.stderr:157250K .......... .......... .......... .......... .......... 93% 1.43M 14s 2020-11-20T12:18:56.282 INFO:tasks.workunit.client.0.smithi093.stderr:157300K .......... .......... .......... .......... .......... 93% 977K 14s 2020-11-20T12:18:56.351 INFO:tasks.workunit.client.0.smithi093.stderr:157350K .......... .......... .......... .......... .......... 93% 731K 13s 2020-11-20T12:18:56.411 INFO:tasks.workunit.client.0.smithi093.stderr:157400K .......... .......... .......... .......... .......... 93% 827K 13s 2020-11-20T12:18:56.436 INFO:tasks.workunit.client.0.smithi093.stderr:157450K .......... .......... .......... .......... .......... 93% 1.97M 13s 2020-11-20T12:18:56.500 INFO:tasks.workunit.client.0.smithi093.stderr:157500K .......... .......... .......... .......... .......... 93% 784K 13s 2020-11-20T12:18:56.561 INFO:tasks.workunit.client.0.smithi093.stderr:157550K .......... .......... .......... .......... .......... 93% 832K 13s 2020-11-20T12:18:56.595 INFO:tasks.workunit.client.0.smithi093.stderr:157600K .......... .......... .......... .......... .......... 93% 1.38M 13s 2020-11-20T12:18:56.657 INFO:tasks.workunit.client.0.smithi093.stderr:157650K .......... .......... .......... .......... .......... 93% 815K 13s 2020-11-20T12:18:56.719 INFO:tasks.workunit.client.0.smithi093.stderr:157700K .......... .......... .......... .......... .......... 93% 811K 13s 2020-11-20T12:18:56.788 INFO:tasks.workunit.client.0.smithi093.stderr:157750K .......... .......... .......... .......... .......... 93% 1.62M 13s 2020-11-20T12:18:56.809 INFO:tasks.workunit.client.0.smithi093.stderr:157800K .......... .......... .......... .......... .......... 93% 823K 13s 2020-11-20T12:18:56.874 INFO:tasks.workunit.client.0.smithi093.stderr:157850K .......... .......... .......... .......... .......... 93% 775K 13s 2020-11-20T12:18:56.900 INFO:tasks.workunit.client.0.smithi093.stderr:157900K .......... .......... .......... .......... .......... 93% 1.88M 13s 2020-11-20T12:18:56.961 INFO:tasks.workunit.client.0.smithi093.stderr:157950K .......... .......... .......... .......... .......... 93% 812K 13s 2020-11-20T12:18:56.990 INFO:tasks.workunit.client.0.smithi093.stderr:158000K .......... .......... .......... .......... .......... 93% 1.99M 13s 2020-11-20T12:18:57.048 INFO:tasks.workunit.client.0.smithi093.stderr:158050K .......... .......... .......... .......... .......... 93% 802K 13s 2020-11-20T12:18:57.103 INFO:tasks.workunit.client.0.smithi093.stderr:158100K .......... .......... .......... .......... .......... 93% 916K 13s 2020-11-20T12:18:57.135 INFO:tasks.workunit.client.0.smithi093.stderr:158150K .......... .......... .......... .......... .......... 93% 1.49M 13s 2020-11-20T12:18:57.194 INFO:tasks.workunit.client.0.smithi093.stderr:158200K .......... .......... .......... .......... .......... 93% 877K 12s 2020-11-20T12:18:57.248 INFO:tasks.workunit.client.0.smithi093.stderr:158250K .......... .......... .......... .......... .......... 93% 904K 12s 2020-11-20T12:18:57.276 INFO:tasks.workunit.client.0.smithi093.stderr:158300K .......... .......... .......... .......... .......... 93% 1.73M 12s 2020-11-20T12:18:57.326 INFO:tasks.workunit.client.0.smithi093.stderr:158350K .......... .......... .......... .......... .......... 93% 1001K 12s 2020-11-20T12:18:57.365 INFO:tasks.workunit.client.0.smithi093.stderr:158400K .......... .......... .......... .......... .......... 93% 1.25M 12s 2020-11-20T12:18:57.421 INFO:tasks.workunit.client.0.smithi093.stderr:158450K .......... .......... .......... .......... .......... 94% 895K 12s 2020-11-20T12:18:57.476 INFO:tasks.workunit.client.0.smithi093.stderr:158500K .......... .......... .......... .......... .......... 94% 906K 12s 2020-11-20T12:18:57.506 INFO:tasks.workunit.client.0.smithi093.stderr:158550K .......... .......... .......... .......... .......... 94% 1.66M 12s 2020-11-20T12:18:57.642 INFO:tasks.workunit.client.0.smithi093.stderr:158600K .......... .......... .......... .......... .......... 94% 369K 12s 2020-11-20T12:18:57.642 INFO:tasks.workunit.client.0.smithi093.stderr:158650K .......... .......... .......... .......... .......... 94% 199M 12s 2020-11-20T12:18:57.680 INFO:tasks.workunit.client.0.smithi093.stderr:158700K .......... .......... .......... .......... .......... 94% 1.26M 12s 2020-11-20T12:18:57.735 INFO:tasks.workunit.client.0.smithi093.stderr:158750K .......... .......... .......... .......... .......... 94% 910K 12s 2020-11-20T12:18:57.800 INFO:tasks.workunit.client.0.smithi093.stderr:158800K .......... .......... .......... .......... .......... 94% 765K 12s 2020-11-20T12:18:57.861 INFO:tasks.workunit.client.0.smithi093.stderr:158850K .......... .......... .......... .......... .......... 94% 824K 12s 2020-11-20T12:18:57.902 INFO:tasks.workunit.client.0.smithi093.stderr:158900K .......... .......... .......... .......... .......... 94% 1.21M 12s 2020-11-20T12:18:57.963 INFO:tasks.workunit.client.0.smithi093.stderr:158950K .......... .......... .......... .......... .......... 94% 817K 12s 2020-11-20T12:18:58.011 INFO:tasks.workunit.client.0.smithi093.stderr:159000K .......... .......... .......... .......... .......... 94% 1.00M 11s 2020-11-20T12:18:58.069 INFO:tasks.workunit.client.0.smithi093.stderr:159050K .......... .......... .......... .......... .......... 94% 885K 11s 2020-11-20T12:18:58.131 INFO:tasks.workunit.client.0.smithi093.stderr:159100K .......... .......... .......... .......... .......... 94% 796K 11s 2020-11-20T12:18:58.175 INFO:tasks.workunit.client.0.smithi093.stderr:159150K .......... .......... .......... .......... .......... 94% 1.09M 11s 2020-11-20T12:18:58.235 INFO:tasks.workunit.client.0.smithi093.stderr:159200K .......... .......... .......... .......... .......... 94% 837K 11s 2020-11-20T12:18:58.308 INFO:tasks.workunit.client.0.smithi093.stderr:159250K .......... .......... .......... .......... .......... 94% 715K 11s 2020-11-20T12:18:58.355 INFO:tasks.workunit.client.0.smithi093.stderr:159300K .......... .......... .......... .......... .......... 94% 996K 11s 2020-11-20T12:18:58.405 INFO:tasks.workunit.client.0.smithi093.stderr:159350K .......... .......... .......... .......... .......... 94% 1012K 11s 2020-11-20T12:18:58.465 INFO:tasks.workunit.client.0.smithi093.stderr:159400K .......... .......... .......... .......... .......... 94% 828K 11s 2020-11-20T12:18:58.521 INFO:tasks.workunit.client.0.smithi093.stderr:159450K .......... .......... .......... .......... .......... 94% 897K 11s 2020-11-20T12:18:58.586 INFO:tasks.workunit.client.0.smithi093.stderr:159500K .......... .......... .......... .......... .......... 94% 764K 11s 2020-11-20T12:18:58.641 INFO:tasks.workunit.client.0.smithi093.stderr:159550K .......... .......... .......... .......... .......... 94% 923K 11s 2020-11-20T12:18:58.688 INFO:tasks.workunit.client.0.smithi093.stderr:159600K .......... .......... .......... .......... .......... 94% 1.04M 11s 2020-11-20T12:18:58.751 INFO:tasks.workunit.client.0.smithi093.stderr:159650K .......... .......... .......... .......... .......... 94% 780K 11s 2020-11-20T12:18:58.821 INFO:tasks.workunit.client.0.smithi093.stderr:159700K .......... .......... .......... .......... .......... 94% 716K 11s 2020-11-20T12:18:58.866 INFO:tasks.workunit.client.0.smithi093.stderr:159750K .......... .......... .......... .......... .......... 94% 1.09M 11s 2020-11-20T12:18:58.906 INFO:tasks.workunit.client.0.smithi093.stderr:159800K .......... .......... .......... .......... .......... 94% 1.25M 11s 2020-11-20T12:18:58.967 INFO:tasks.workunit.client.0.smithi093.stderr:159850K .......... .......... .......... .......... .......... 94% 808K 10s 2020-11-20T12:18:59.004 INFO:tasks.workunit.client.0.smithi093.stderr:159900K .......... .......... .......... .......... .......... 94% 1.31M 10s 2020-11-20T12:18:59.047 INFO:tasks.workunit.client.0.smithi093.stderr:159950K .......... .......... .......... .......... .......... 94% 1.15M 10s 2020-11-20T12:18:59.109 INFO:tasks.workunit.client.0.smithi093.stderr:160000K .......... .......... .......... .......... .......... 94% 817K 10s 2020-11-20T12:18:59.146 INFO:tasks.workunit.client.0.smithi093.stderr:160050K .......... .......... .......... .......... .......... 94% 1.28M 10s 2020-11-20T12:18:59.189 INFO:tasks.workunit.client.0.smithi093.stderr:160100K .......... .......... .......... .......... .......... 95% 1.12M 10s 2020-11-20T12:18:59.255 INFO:tasks.workunit.client.0.smithi093.stderr:160150K .......... .......... .......... .......... .......... 95% 760K 10s 2020-11-20T12:18:59.297 INFO:tasks.workunit.client.0.smithi093.stderr:160200K .......... .......... .......... .......... .......... 95% 1.17M 10s 2020-11-20T12:18:59.355 INFO:tasks.workunit.client.0.smithi093.stderr:160250K .......... .......... .......... .......... .......... 95% 1.03M 10s 2020-11-20T12:18:59.407 INFO:tasks.workunit.client.0.smithi093.stderr:160300K .......... .......... .......... .......... .......... 95% 794K 10s 2020-11-20T12:18:59.451 INFO:tasks.workunit.client.0.smithi093.stderr:160350K .......... .......... .......... .......... .......... 95% 1.13M 10s 2020-11-20T12:18:59.493 INFO:tasks.workunit.client.0.smithi093.stderr:160400K .......... .......... .......... .......... .......... 95% 1.13M 10s 2020-11-20T12:18:59.563 INFO:tasks.workunit.client.0.smithi093.stderr:160450K .......... .......... .......... .......... .......... 95% 719K 10s 2020-11-20T12:18:59.651 INFO:tasks.workunit.client.0.smithi093.stderr:160500K .......... .......... .......... .......... .......... 95% 573K 10s 2020-11-20T12:18:59.653 INFO:tasks.workunit.client.0.smithi093.stderr:160550K .......... .......... .......... .......... .......... 95% 17.5M 10s 2020-11-20T12:18:59.725 INFO:tasks.workunit.client.0.smithi093.stderr:160600K .......... .......... .......... .......... .......... 95% 693K 10s 2020-11-20T12:18:59.799 INFO:tasks.workunit.client.0.smithi093.stderr:160650K .......... .......... .......... .......... .......... 95% 696K 9s 2020-11-20T12:18:59.866 INFO:tasks.workunit.client.0.smithi093.stderr:160700K .......... .......... .......... .......... .......... 95% 730K 9s 2020-11-20T12:18:59.935 INFO:tasks.workunit.client.0.smithi093.stderr:160750K .......... .......... .......... .......... .......... 95% 721K 9s 2020-11-20T12:19:00.007 INFO:tasks.workunit.client.0.smithi093.stderr:160800K .......... .......... .......... .......... .......... 95% 697K 9s 2020-11-20T12:19:00.042 INFO:tasks.workunit.client.0.smithi093.stderr:160850K .......... .......... .......... .......... .......... 95% 1.38M 9s 2020-11-20T12:19:00.106 INFO:tasks.workunit.client.0.smithi093.stderr:160900K .......... .......... .......... .......... .......... 95% 775K 9s 2020-11-20T12:19:00.163 INFO:tasks.workunit.client.0.smithi093.stderr:160950K .......... .......... .......... .......... .......... 95% 886K 9s 2020-11-20T12:19:00.237 INFO:tasks.workunit.client.0.smithi093.stderr:161000K .......... .......... .......... .......... .......... 95% 673K 9s 2020-11-20T12:19:00.310 INFO:tasks.workunit.client.0.smithi093.stderr:161050K .......... .......... .......... .......... .......... 95% 686K 9s 2020-11-20T12:19:00.343 INFO:tasks.workunit.client.0.smithi093.stderr:161100K .......... .......... .......... .......... .......... 95% 1.49M 9s 2020-11-20T12:19:00.402 INFO:tasks.workunit.client.0.smithi093.stderr:161150K .......... .......... .......... .......... .......... 95% 850K 9s 2020-11-20T12:19:00.470 INFO:tasks.workunit.client.0.smithi093.stderr:161200K .......... .......... .......... .......... .......... 95% 733K 9s 2020-11-20T12:19:00.592 INFO:tasks.workunit.client.0.smithi093.stderr:161250K .......... .......... .......... .......... .......... 95% 411K 9s 2020-11-20T12:19:00.593 INFO:tasks.workunit.client.0.smithi093.stderr:161300K .......... .......... .......... .......... .......... 95% 355M 9s 2020-11-20T12:19:00.665 INFO:tasks.workunit.client.0.smithi093.stderr:161350K .......... .......... .......... .......... .......... 95% 682K 9s 2020-11-20T12:19:00.768 INFO:tasks.workunit.client.0.smithi093.stderr:161400K .......... .......... .......... .......... .......... 95% 486K 9s 2020-11-20T12:19:00.841 INFO:tasks.workunit.client.0.smithi093.stderr:161450K .......... .......... .......... .......... .......... 95% 684K 9s 2020-11-20T12:19:00.912 INFO:tasks.workunit.client.0.smithi093.stderr:161500K .......... .......... .......... .......... .......... 95% 706K 8s 2020-11-20T12:19:00.985 INFO:tasks.workunit.client.0.smithi093.stderr:161550K .......... .......... .......... .......... .......... 95% 689K 8s 2020-11-20T12:19:01.059 INFO:tasks.workunit.client.0.smithi093.stderr:161600K .......... .......... .......... .......... .......... 95% 673K 8s 2020-11-20T12:19:01.135 INFO:tasks.workunit.client.0.smithi093.stderr:161650K .......... .......... .......... .......... .......... 95% 665K 8s 2020-11-20T12:19:01.209 INFO:tasks.workunit.client.0.smithi093.stderr:161700K .......... .......... .......... .......... .......... 95% 668K 8s 2020-11-20T12:19:01.289 INFO:tasks.workunit.client.0.smithi093.stderr:161750K .......... .......... .......... .......... .......... 95% 625K 8s 2020-11-20T12:19:01.372 INFO:tasks.workunit.client.0.smithi093.stderr:161800K .......... .......... .......... .......... .......... 96% 607K 8s 2020-11-20T12:19:01.395 INFO:tasks.workunit.client.0.smithi093.stderr:161850K .......... .......... .......... .......... .......... 96% 2.01M 8s 2020-11-20T12:19:01.470 INFO:tasks.workunit.client.0.smithi093.stderr:161900K .......... .......... .......... .......... .......... 96% 673K 8s 2020-11-20T12:19:01.548 INFO:tasks.workunit.client.0.smithi093.stderr:161950K .......... .......... .......... .......... .......... 96% 643K 8s 2020-11-20T12:19:01.622 INFO:tasks.workunit.client.0.smithi093.stderr:162000K .......... .......... .......... .......... .......... 96% 668K 8s 2020-11-20T12:19:01.696 INFO:tasks.workunit.client.0.smithi093.stderr:162050K .......... .......... .......... .......... .......... 96% 726K 8s 2020-11-20T12:19:01.765 INFO:tasks.workunit.client.0.smithi093.stderr:162100K .......... .......... .......... .......... .......... 96% 685K 8s 2020-11-20T12:19:01.829 INFO:tasks.workunit.client.0.smithi093.stderr:162150K .......... .......... .......... .......... .......... 96% 773K 8s 2020-11-20T12:19:01.897 INFO:tasks.workunit.client.0.smithi093.stderr:162200K .......... .......... .......... .......... .......... 96% 737K 8s 2020-11-20T12:19:01.956 INFO:tasks.workunit.client.0.smithi093.stderr:162250K .......... .......... .......... .......... .......... 96% 845K 8s 2020-11-20T12:19:01.990 INFO:tasks.workunit.client.0.smithi093.stderr:162300K .......... .......... .......... .......... .......... 96% 1.45M 8s 2020-11-20T12:19:02.054 INFO:tasks.workunit.client.0.smithi093.stderr:162350K .......... .......... .......... .......... .......... 96% 778K 7s 2020-11-20T12:19:02.122 INFO:tasks.workunit.client.0.smithi093.stderr:162400K .......... .......... .......... .......... .......... 96% 737K 7s 2020-11-20T12:19:02.179 INFO:tasks.workunit.client.0.smithi093.stderr:162450K .......... .......... .......... .......... .......... 96% 881K 7s 2020-11-20T12:19:02.246 INFO:tasks.workunit.client.0.smithi093.stderr:162500K .......... .......... .......... .......... .......... 96% 746K 7s 2020-11-20T12:19:02.273 INFO:tasks.workunit.client.0.smithi093.stderr:162550K .......... .......... .......... .......... .......... 96% 1.79M 7s 2020-11-20T12:19:02.346 INFO:tasks.workunit.client.0.smithi093.stderr:162600K .......... .......... .......... .......... .......... 96% 691K 7s 2020-11-20T12:19:02.416 INFO:tasks.workunit.client.0.smithi093.stderr:162650K .......... .......... .......... .......... .......... 96% 710K 7s 2020-11-20T12:19:02.477 INFO:tasks.workunit.client.0.smithi093.stderr:162700K .......... .......... .......... .......... .......... 96% 813K 7s 2020-11-20T12:19:02.543 INFO:tasks.workunit.client.0.smithi093.stderr:162750K .......... .......... .......... .......... .......... 96% 765K 7s 2020-11-20T12:19:02.571 INFO:tasks.workunit.client.0.smithi093.stderr:162800K .......... .......... .......... .......... .......... 96% 1.72M 7s 2020-11-20T12:19:02.643 INFO:tasks.workunit.client.0.smithi093.stderr:162850K .......... .......... .......... .......... .......... 96% 696K 7s 2020-11-20T12:19:02.716 INFO:tasks.workunit.client.0.smithi093.stderr:162900K .......... .......... .......... .......... .......... 96% 719K 7s 2020-11-20T12:19:02.779 INFO:tasks.workunit.client.0.smithi093.stderr:162950K .......... .......... .......... .......... .......... 96% 751K 7s 2020-11-20T12:19:02.810 INFO:tasks.workunit.client.0.smithi093.stderr:163000K .......... .......... .......... .......... .......... 96% 1.57M 7s 2020-11-20T12:19:02.882 INFO:tasks.workunit.client.0.smithi093.stderr:163050K .......... .......... .......... .......... .......... 96% 704K 7s 2020-11-20T12:19:03.028 INFO:tasks.workunit.client.0.smithi093.stderr:163100K .......... .......... .......... .......... .......... 96% 343K 7s 2020-11-20T12:19:03.028 INFO:tasks.workunit.client.0.smithi093.stderr:163150K .......... .......... .......... .......... .......... 96% 598M 6s 2020-11-20T12:19:03.094 INFO:tasks.workunit.client.0.smithi093.stderr:163200K .......... .......... .......... .......... .......... 96% 752K 6s 2020-11-20T12:19:03.159 INFO:tasks.workunit.client.0.smithi093.stderr:163250K .......... .......... .......... .......... .......... 96% 757K 6s 2020-11-20T12:19:03.221 INFO:tasks.workunit.client.0.smithi093.stderr:163300K .......... .......... .......... .......... .......... 96% 819K 6s 2020-11-20T12:19:03.289 INFO:tasks.workunit.client.0.smithi093.stderr:163350K .......... .......... .......... .......... .......... 96% 737K 6s 2020-11-20T12:19:03.349 INFO:tasks.workunit.client.0.smithi093.stderr:163400K .......... .......... .......... .......... .......... 96% 886K 6s 2020-11-20T12:19:03.400 INFO:tasks.workunit.client.0.smithi093.stderr:163450K .......... .......... .......... .......... .......... 96% 910K 6s 2020-11-20T12:19:03.460 INFO:tasks.workunit.client.0.smithi093.stderr:163500K .......... .......... .......... .......... .......... 97% 844K 6s 2020-11-20T12:19:03.521 INFO:tasks.workunit.client.0.smithi093.stderr:163550K .......... .......... .......... .......... .......... 97% 813K 6s 2020-11-20T12:19:03.586 INFO:tasks.workunit.client.0.smithi093.stderr:163600K .......... .......... .......... .......... .......... 97% 1.27M 6s 2020-11-20T12:19:03.626 INFO:tasks.workunit.client.0.smithi093.stderr:163650K .......... .......... .......... .......... .......... 97% 739K 6s 2020-11-20T12:19:03.694 INFO:tasks.workunit.client.0.smithi093.stderr:163700K .......... .......... .......... .......... .......... 97% 743K 6s 2020-11-20T12:19:03.763 INFO:tasks.workunit.client.0.smithi093.stderr:163750K .......... .......... .......... .......... .......... 97% 727K 6s 2020-11-20T12:19:03.815 INFO:tasks.workunit.client.0.smithi093.stderr:163800K .......... .......... .......... .......... .......... 97% 957K 6s 2020-11-20T12:19:03.881 INFO:tasks.workunit.client.0.smithi093.stderr:163850K .......... .......... .......... .......... .......... 97% 929K 6s 2020-11-20T12:19:03.935 INFO:tasks.workunit.client.0.smithi093.stderr:163900K .......... .......... .......... .......... .......... 97% 769K 6s 2020-11-20T12:19:03.983 INFO:tasks.workunit.client.0.smithi093.stderr:163950K .......... .......... .......... .......... .......... 97% 1020K 6s 2020-11-20T12:19:04.047 INFO:tasks.workunit.client.0.smithi093.stderr:164000K .......... .......... .......... .......... .......... 97% 774K 5s 2020-11-20T12:19:04.114 INFO:tasks.workunit.client.0.smithi093.stderr:164050K .......... .......... .......... .......... .......... 97% 815K 5s 2020-11-20T12:19:04.176 INFO:tasks.workunit.client.0.smithi093.stderr:164100K .......... .......... .......... .......... .......... 97% 745K 5s 2020-11-20T12:19:04.228 INFO:tasks.workunit.client.0.smithi093.stderr:164150K .......... .......... .......... .......... .......... 97% 958K 5s 2020-11-20T12:19:04.273 INFO:tasks.workunit.client.0.smithi093.stderr:164200K .......... .......... .......... .......... .......... 97% 1.10M 5s 2020-11-20T12:19:04.344 INFO:tasks.workunit.client.0.smithi093.stderr:164250K .......... .......... .......... .......... .......... 97% 703K 5s 2020-11-20T12:19:04.414 INFO:tasks.workunit.client.0.smithi093.stderr:164300K .......... .......... .......... .......... .......... 97% 725K 5s 2020-11-20T12:19:04.474 INFO:tasks.workunit.client.0.smithi093.stderr:164350K .......... .......... .......... .......... .......... 97% 809K 5s 2020-11-20T12:19:04.536 INFO:tasks.workunit.client.0.smithi093.stderr:164400K .......... .......... .......... .......... .......... 97% 821K 5s 2020-11-20T12:19:04.593 INFO:tasks.workunit.client.0.smithi093.stderr:164450K .......... .......... .......... .......... .......... 97% 869K 5s 2020-11-20T12:19:04.729 INFO:tasks.workunit.client.0.smithi093.stderr:164500K .......... .......... .......... .......... .......... 97% 368K 5s 2020-11-20T12:19:04.730 INFO:tasks.workunit.client.0.smithi093.stderr:164550K .......... .......... .......... .......... .......... 97% 30.5M 5s 2020-11-20T12:19:04.809 INFO:tasks.workunit.client.0.smithi093.stderr:164600K .......... .......... .......... .......... .......... 97% 635K 5s 2020-11-20T12:19:04.883 INFO:tasks.workunit.client.0.smithi093.stderr:164650K .......... .......... .......... .......... .......... 97% 731K 5s 2020-11-20T12:19:04.949 INFO:tasks.workunit.client.0.smithi093.stderr:164700K .......... .......... .......... .......... .......... 97% 703K 5s 2020-11-20T12:19:05.008 INFO:tasks.workunit.client.0.smithi093.stderr:164750K .......... .......... .......... .......... .......... 97% 851K 5s 2020-11-20T12:19:05.067 INFO:tasks.workunit.client.0.smithi093.stderr:164800K .......... .......... .......... .......... .......... 97% 838K 4s 2020-11-20T12:19:05.131 INFO:tasks.workunit.client.0.smithi093.stderr:164850K .......... .......... .......... .......... .......... 97% 789K 4s 2020-11-20T12:19:05.193 INFO:tasks.workunit.client.0.smithi093.stderr:164900K .......... .......... .......... .......... .......... 97% 803K 4s 2020-11-20T12:19:05.254 INFO:tasks.workunit.client.0.smithi093.stderr:164950K .......... .......... .......... .......... .......... 97% 826K 4s 2020-11-20T12:19:05.317 INFO:tasks.workunit.client.0.smithi093.stderr:165000K .......... .......... .......... .......... .......... 97% 790K 4s 2020-11-20T12:19:05.383 INFO:tasks.workunit.client.0.smithi093.stderr:165050K .......... .......... .......... .......... .......... 97% 751K 4s 2020-11-20T12:19:05.450 INFO:tasks.workunit.client.0.smithi093.stderr:165100K .......... .......... .......... .......... .......... 97% 857K 4s 2020-11-20T12:19:05.508 INFO:tasks.workunit.client.0.smithi093.stderr:165150K .......... .......... .......... .......... .......... 98% 747K 4s 2020-11-20T12:19:05.574 INFO:tasks.workunit.client.0.smithi093.stderr:165200K .......... .......... .......... .......... .......... 98% 779K 4s 2020-11-20T12:19:05.630 INFO:tasks.workunit.client.0.smithi093.stderr:165250K .......... .......... .......... .......... .......... 98% 858K 4s 2020-11-20T12:19:05.703 INFO:tasks.workunit.client.0.smithi093.stderr:165300K .......... .......... .......... .......... .......... 98% 693K 4s 2020-11-20T12:19:05.763 INFO:tasks.workunit.client.0.smithi093.stderr:165350K .......... .......... .......... .......... .......... 98% 828K 4s 2020-11-20T12:19:05.831 INFO:tasks.workunit.client.0.smithi093.stderr:165400K .......... .......... .......... .......... .......... 98% 735K 4s 2020-11-20T12:19:05.881 INFO:tasks.workunit.client.0.smithi093.stderr:165450K .......... .......... .......... .......... .......... 98% 1013K 4s 2020-11-20T12:19:05.946 INFO:tasks.workunit.client.0.smithi093.stderr:165500K .......... .......... .......... .......... .......... 98% 766K 4s 2020-11-20T12:19:06.015 INFO:tasks.workunit.client.0.smithi093.stderr:165550K .......... .......... .......... .......... .......... 98% 775K 4s 2020-11-20T12:19:06.088 INFO:tasks.workunit.client.0.smithi093.stderr:165600K .......... .......... .......... .......... .......... 98% 643K 4s 2020-11-20T12:19:06.159 INFO:tasks.workunit.client.0.smithi093.stderr:165650K .......... .......... .......... .......... .......... 98% 705K 3s 2020-11-20T12:19:06.219 INFO:tasks.workunit.client.0.smithi093.stderr:165700K .......... .......... .......... .......... .......... 98% 838K 3s 2020-11-20T12:19:06.294 INFO:tasks.workunit.client.0.smithi093.stderr:165750K .......... .......... .......... .......... .......... 98% 661K 3s 2020-11-20T12:19:06.343 INFO:tasks.workunit.client.0.smithi093.stderr:165800K .......... .......... .......... .......... .......... 98% 1022K 3s 2020-11-20T12:19:06.414 INFO:tasks.workunit.client.0.smithi093.stderr:165850K .......... .......... .......... .......... .......... 98% 706K 3s 2020-11-20T12:19:06.482 INFO:tasks.workunit.client.0.smithi093.stderr:165900K .......... .......... .......... .......... .......... 98% 732K 3s 2020-11-20T12:19:06.612 INFO:tasks.workunit.client.0.smithi093.stderr:165950K .......... .......... .......... .......... .......... 98% 387K 3s 2020-11-20T12:19:06.612 INFO:tasks.workunit.client.0.smithi093.stderr:166000K .......... .......... .......... .......... .......... 98% 596M 3s 2020-11-20T12:19:06.678 INFO:tasks.workunit.client.0.smithi093.stderr:166050K .......... .......... .......... .......... .......... 98% 758K 3s 2020-11-20T12:19:06.745 INFO:tasks.workunit.client.0.smithi093.stderr:166100K .......... .......... .......... .......... .......... 98% 749K 3s 2020-11-20T12:19:06.806 INFO:tasks.workunit.client.0.smithi093.stderr:166150K .......... .......... .......... .......... .......... 98% 812K 3s 2020-11-20T12:19:06.874 INFO:tasks.workunit.client.0.smithi093.stderr:166200K .......... .......... .......... .......... .......... 98% 875K 3s 2020-11-20T12:19:06.935 INFO:tasks.workunit.client.0.smithi093.stderr:166250K .......... .......... .......... .......... .......... 98% 690K 3s 2020-11-20T12:19:06.999 INFO:tasks.workunit.client.0.smithi093.stderr:166300K .......... .......... .......... .......... .......... 98% 934K 3s 2020-11-20T12:19:07.052 INFO:tasks.workunit.client.0.smithi093.stderr:166350K .......... .......... .......... .......... .......... 98% 793K 3s 2020-11-20T12:19:07.113 INFO:tasks.workunit.client.0.smithi093.stderr:166400K .......... .......... .......... .......... .......... 98% 811K 3s 2020-11-20T12:19:07.181 INFO:tasks.workunit.client.0.smithi093.stderr:166450K .......... .......... .......... .......... .......... 98% 772K 2s 2020-11-20T12:19:07.248 INFO:tasks.workunit.client.0.smithi093.stderr:166500K .......... .......... .......... .......... .......... 98% 717K 2s 2020-11-20T12:19:07.316 INFO:tasks.workunit.client.0.smithi093.stderr:166550K .......... .......... .......... .......... .......... 98% 741K 2s 2020-11-20T12:19:07.386 INFO:tasks.workunit.client.0.smithi093.stderr:166600K .......... .......... .......... .......... .......... 98% 712K 2s 2020-11-20T12:19:07.423 INFO:tasks.workunit.client.0.smithi093.stderr:166650K .......... .......... .......... .......... .......... 98% 1.32M 2s 2020-11-20T12:19:07.482 INFO:tasks.workunit.client.0.smithi093.stderr:166700K .......... .......... .......... .......... .......... 98% 845K 2s 2020-11-20T12:19:07.549 INFO:tasks.workunit.client.0.smithi093.stderr:166750K .......... .......... .......... .......... .......... 98% 739K 2s 2020-11-20T12:19:07.620 INFO:tasks.workunit.client.0.smithi093.stderr:166800K .......... .......... .......... .......... .......... 98% 706K 2s 2020-11-20T12:19:07.683 INFO:tasks.workunit.client.0.smithi093.stderr:166850K .......... .......... .......... .......... .......... 99% 796K 2s 2020-11-20T12:19:07.754 INFO:tasks.workunit.client.0.smithi093.stderr:166900K .......... .......... .......... .......... .......... 99% 708K 2s 2020-11-20T12:19:07.827 INFO:tasks.workunit.client.0.smithi093.stderr:166950K .......... .......... .......... .......... .......... 99% 683K 2s 2020-11-20T12:19:07.865 INFO:tasks.workunit.client.0.smithi093.stderr:167000K .......... .......... .......... .......... .......... 99% 1.32M 2s 2020-11-20T12:19:07.930 INFO:tasks.workunit.client.0.smithi093.stderr:167050K .......... .......... .......... .......... .......... 99% 750K 2s 2020-11-20T12:19:08.008 INFO:tasks.workunit.client.0.smithi093.stderr:167100K .......... .......... .......... .......... .......... 99% 653K 2s 2020-11-20T12:19:08.067 INFO:tasks.workunit.client.0.smithi093.stderr:167150K .......... .......... .......... .......... .......... 99% 827K 2s 2020-11-20T12:19:08.140 INFO:tasks.workunit.client.0.smithi093.stderr:167200K .......... .......... .......... .......... .......... 99% 689K 2s 2020-11-20T12:19:08.216 INFO:tasks.workunit.client.0.smithi093.stderr:167250K .......... .......... .......... .......... .......... 99% 659K 2s 2020-11-20T12:19:08.243 INFO:tasks.workunit.client.0.smithi093.stderr:167300K .......... .......... .......... .......... .......... 99% 1.82M 1s 2020-11-20T12:19:08.308 INFO:tasks.workunit.client.0.smithi093.stderr:167350K .......... .......... .......... .......... .......... 99% 762K 1s 2020-11-20T12:19:08.361 INFO:tasks.workunit.client.0.smithi093.stderr:167400K .......... .......... .......... .......... .......... 99% 952K 1s 2020-11-20T12:19:08.426 INFO:tasks.workunit.client.0.smithi093.stderr:167450K .......... .......... .......... .......... .......... 99% 770K 1s 2020-11-20T12:19:08.499 INFO:tasks.workunit.client.0.smithi093.stderr:167500K .......... .......... .......... .......... .......... 99% 679K 1s 2020-11-20T12:19:08.532 INFO:tasks.workunit.client.0.smithi093.stderr:167550K .......... .......... .......... .......... .......... 99% 1.54M 1s 2020-11-20T12:19:08.927 INFO:tasks.workunit.client.0.smithi093.stderr:167600K .......... .......... .......... .......... .......... 99% 753K 1s 2020-11-20T12:19:08.928 INFO:tasks.workunit.client.0.smithi093.stderr:167650K .......... .......... .......... .......... .......... 99% 901K 1s 2020-11-20T12:19:08.928 INFO:tasks.workunit.client.0.smithi093.stderr:167700K .......... .......... .......... .......... .......... 99% 682K 1s 2020-11-20T12:19:08.928 INFO:tasks.workunit.client.0.smithi093.stderr:167750K .......... .......... .......... .......... .......... 99% 1.49M 1s 2020-11-20T12:19:08.928 INFO:tasks.workunit.client.0.smithi093.stderr:167800K .......... .......... .......... .......... .......... 99% 748K 1s 2020-11-20T12:19:08.929 INFO:tasks.workunit.client.0.smithi093.stderr:167850K .......... .......... .......... .......... .......... 99% 769K 1s 2020-11-20T12:19:09.006 INFO:tasks.workunit.client.0.smithi093.stderr:167900K .......... .......... .......... .......... .......... 99% 435K 1s 2020-11-20T12:19:09.039 INFO:tasks.workunit.client.0.smithi093.stderr:167950K .......... .......... .......... .......... .......... 99% 612M 1s 2020-11-20T12:19:09.118 INFO:tasks.workunit.client.0.smithi093.stderr:168000K .......... .......... .......... .......... .......... 99% 449K 1s 2020-11-20T12:19:09.190 INFO:tasks.workunit.client.0.smithi093.stderr:168050K .......... .......... .......... .......... .......... 99% 690K 1s 2020-11-20T12:19:09.265 INFO:tasks.workunit.client.0.smithi093.stderr:168100K .......... .......... .......... .......... .......... 99% 669K 1s 2020-11-20T12:19:09.335 INFO:tasks.workunit.client.0.smithi093.stderr:168150K .......... .......... .......... .......... .......... 99% 714K 0s 2020-11-20T12:19:09.385 INFO:tasks.workunit.client.0.smithi093.stderr:168200K .......... .......... .......... .......... .......... 99% 994K 0s 2020-11-20T12:19:09.445 INFO:tasks.workunit.client.0.smithi093.stderr:168250K .......... .......... .......... .......... .......... 99% 857K 0s 2020-11-20T12:19:09.525 INFO:tasks.workunit.client.0.smithi093.stderr:168300K .......... .......... .......... .......... .......... 99% 612K 0s 2020-11-20T12:19:09.603 INFO:tasks.workunit.client.0.smithi093.stderr:168350K .......... .......... .......... .......... .......... 99% 691K 0s 2020-11-20T12:19:09.669 INFO:tasks.workunit.client.0.smithi093.stderr:168400K .......... .......... .......... .......... .......... 99% 703K 0s 2020-11-20T12:19:09.728 INFO:tasks.workunit.client.0.smithi093.stderr:168450K .......... .......... .......... .......... .......... 99% 836K 0s 2020-11-20T12:19:09.802 INFO:tasks.workunit.client.0.smithi093.stderr:168500K .......... .......... .......... .......... .......... 99% 676K 0s 2020-11-20T12:19:09.832 INFO:tasks.workunit.client.0.smithi093.stderr:168550K .......... .......... . 100% 722K=3m24s 2020-11-20T12:19:09.833 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:19:09.833 INFO:tasks.workunit.client.0.smithi093.stderr:2020-11-20 12:19:09 (828 KB/s) - ‘linux.tar.gz’ saved [172616875/172616875] 2020-11-20T12:19:09.834 INFO:tasks.workunit.client.0.smithi093.stderr: 2020-11-20T12:19:20.933 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:20.943 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:20.958 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:51.017 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:51.036 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:19:51.039 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:21.144 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:21.147 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:21.150 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:51.523 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:51.558 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:20:51.561 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:21:21.837 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:21:21.851 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:21:21.876 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:21:52.034 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:21:52.093 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:21:52.095 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:22:22.448 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:22:22.461 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:22:22.466 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:22:52.854 INFO:teuthology.orchestra.run.smithi066:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:22:52.862 INFO:teuthology.orchestra.run.smithi093:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:22:52.867 INFO:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-11-20T12:22:59.896 INFO:tasks.workunit.client.0.smithi093.stdout: HOSTCC scripts/basic/fixdep