2020-02-12T14:40:13.136 INFO:root:teuthology version: 1.0.0-ee19bca 2020-02-12T14:40:13.136 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.yvrSme.tmp -- --verbose --lock --description fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_trivial_sync.yaml} --name pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi --block --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755732 2020-02-12T14:40:13.174 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-12T14:40:13.248 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755732 branch: wip-pdonnell-testing-20200211.222321 description: fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_trivial_sync.yaml} email: pdonnell@redhat.com first_in_suite: false job_id: '4755732' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 30 - machine: disk: 200 os_type: centos os_version: '8.1' overrides: admin_socket: branch: wip-pdonnell-testing-20200211.222321 ceph: cephfs_ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 mds: debug mds: 20 debug ms: 1 mds bal frag: true mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd_max_omap_entries_per_request: 10000 fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 install: ceph: sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-pdonnell-testing-20200211.222321 sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 owner: scheduled_pdonnell@teuthology priority: 75 repo: git://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - osd.4 - osd.5 - osd.6 - osd.7 sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 suite: fs suite_branch: wip-pdonnell-testing-20200211.222321 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell rpm: - python3-cephfs extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - dump - indent rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - ceph: null - exec: client.0: - sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it - ceph-fuse: null - workunit: clients: all: - fs/misc/trivial_sync.sh teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.2510 2020-02-12T14:40:13.248 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa; will attempt to use it 2020-02-12T14:40:13.249 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa/tasks 2020-02-12T14:40:13.249 INFO:teuthology.run_tasks:Running task internal.check_packages... 2020-02-12T14:40:13.251 INFO:teuthology.task.internal:Checking packages... 2020-02-12T14:40:13.271 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'basic' and ceph hash '7df2194963eaa185d198b9c90e899c7e7ae9eb30' 2020-02-12T14:40:13.271 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2020-02-12T14:40:13.271 INFO:teuthology.packaging:ref: None 2020-02-12T14:40:13.272 INFO:teuthology.packaging:tag: None 2020-02-12T14:40:13.272 INFO:teuthology.packaging:branch: wip-pdonnell-testing-20200211.222321 2020-02-12T14:40:13.272 INFO:teuthology.packaging:sha1: 7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T14:40:13.273 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-pdonnell-testing-20200211.222321 2020-02-12T14:40:13.438 INFO:teuthology.task.internal:Found packages for ceph version 15.1.0-567.g7df2194 2020-02-12T14:40:13.438 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2020-02-12T14:40:13.449 INFO:teuthology.task.internal:no buildpackages task found 2020-02-12T14:40:13.449 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2020-02-12T14:40:13.508 INFO:teuthology.task.internal.lock_machines:Locking machines... 2020-02-12T14:40:13.509 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-12T14:40:13.573 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:40:23.589 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:40:33.609 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:40:43.626 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:40:53.643 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:41:03.658 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:41:13.671 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:41:23.687 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:41:33.706 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:41:43.722 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:41:53.740 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:42:03.754 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:42:13.771 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:42:23.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:42:33.807 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:42:43.823 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:42:53.839 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:43:03.850 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:43:13.869 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:43:23.897 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:43:33.908 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:43:43.937 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:43:53.960 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:44:03.976 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:44:13.991 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:44:24.008 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:44:34.027 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:44:44.043 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:44:54.060 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:45:04.075 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:45:14.092 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:45:24.110 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:45:34.128 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:45:44.172 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:45:54.190 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:46:04.206 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:46:14.223 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:46:24.240 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:46:34.258 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:46:44.275 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:46:54.291 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:47:04.309 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:47:14.328 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:47:24.340 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:47:34.359 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:47:44.371 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:47:54.391 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:48:04.411 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:48:14.427 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:48:24.445 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:48:34.458 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:48:44.472 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:48:54.489 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:49:04.506 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:49:14.523 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:49:24.542 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:49:34.561 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:49:44.579 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:49:54.596 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:50:04.612 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:50:14.631 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:50:24.651 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:50:34.664 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:50:44.680 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:50:54.695 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:51:04.711 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:51:14.727 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:51:24.744 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:51:34.759 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:51:44.769 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 0)... 2020-02-12T14:51:54.786 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:52:04.803 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:52:14.819 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:52:24.836 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:52:34.856 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:52:44.875 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:52:54.894 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:53:04.910 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:53:14.929 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:53:24.942 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:53:34.961 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:53:44.983 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:53:54.995 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:54:06.002 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2020-02-12T14:54:16.018 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:54:26.035 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:54:36.052 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:54:46.071 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:54:56.080 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:55:06.093 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:55:16.104 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:55:26.130 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:55:36.148 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:55:46.158 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:55:56.173 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:56:06.191 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:56:16.208 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:56:26.227 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:56:36.245 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:56:46.255 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:56:56.265 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2020-02-12T14:57:06.284 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_pdonnell@teuthology', 'description': '/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755732', 'machine_type': 'smithi'} 2020-02-12T14:57:06.303 DEBUG:teuthology.lock.ops:locked ubuntu@smithi180.front.sepia.ceph.com, ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T14:57:06.360 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-12T14:57:06.577 INFO:teuthology.provision.fog.smithi180:Scheduling deploy of centos 8.1 2020-02-12T14:57:06.579 INFO:teuthology.provision.fog.smithi105:Scheduling deploy of centos 8.1 2020-02-12T14:57:06.876 INFO:teuthology.orchestra.console:Power off smithi180 2020-02-12T14:57:06.876 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-12T14:57:06.889 INFO:teuthology.orchestra.console:Power off smithi105 2020-02-12T14:57:06.890 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2020-02-12T14:57:06.897 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:57:06.908 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:57:07.018 INFO:teuthology.orchestra.console:Power off for smithi180 completed 2020-02-12T14:57:07.028 INFO:teuthology.orchestra.console:Power off for smithi105 completed 2020-02-12T14:57:07.119 INFO:teuthology.orchestra.console:Power on smithi180 2020-02-12T14:57:07.120 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-12T14:57:07.129 INFO:teuthology.orchestra.console:Power on smithi105 2020-02-12T14:57:07.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2020-02-12T14:57:07.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:57:07.151 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:57:11.165 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:57:11.172 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi105.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:57:11.381 INFO:teuthology.orchestra.console:Power on for smithi105 completed 2020-02-12T14:57:11.481 INFO:teuthology.provision.fog.smithi105:Waiting for deploy to finish 2020-02-12T14:57:15.277 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi180.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2020-02-12T14:57:15.528 INFO:teuthology.orchestra.console:Power on for smithi180 completed 2020-02-12T14:57:15.629 INFO:teuthology.provision.fog.smithi180:Waiting for deploy to finish 2020-02-12T14:59:57.450 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:01.532 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:06.518 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:10.615 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:15.575 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:19.678 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:24.636 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:28.758 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:33.719 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:37.822 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:42.775 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:46.903 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:51.831 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:00:55.963 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:01:00.888 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:01:05.015 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:01:09.946 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:11.043 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:11.366 INFO:teuthology.orchestra.run.smithi180:> hostname 2020-02-12T15:02:11.633 INFO:teuthology.orchestra.run.smithi180.stdout:smithi180.front.sepia.ceph.com 2020-02-12T15:02:11.634 INFO:teuthology.orchestra.run.smithi180:> grep smithi180.front.sepia.ceph.com /etc/hosts 2020-02-12T15:02:11.647 INFO:teuthology.orchestra.run.smithi180.stdout:172.21.15.180 smithi180.front.sepia.ceph.com smithi180 2020-02-12T15:02:11.647 INFO:teuthology.orchestra.run.smithi180:> sudo hostname smithi180 2020-02-12T15:02:11.758 INFO:teuthology.orchestra.run.smithi180:> sudo sed -i -e 's/smithi180.front.sepia.ceph.com/smithi180/g' /etc/hosts 2020-02-12T15:02:11.786 INFO:teuthology.orchestra.run.smithi180:> sudo sed -i -e 's/172.21.15.180/172.21.15.180/g' /etc/hosts 2020-02-12T15:02:11.853 INFO:teuthology.orchestra.run.smithi180:> sudo sed -i -e 's/smithi180.front.sepia.ceph.com/smithi180/g' /etc/hostname 2020-02-12T15:02:11.920 INFO:teuthology.orchestra.run.smithi180:> sudo hostname smithi180 2020-02-12T15:02:11.987 INFO:teuthology.provision.fog.smithi180:Deploy complete! 2020-02-12T15:02:11.988 DEBUG:teuthology.parallel:result is None 2020-02-12T15:02:15.953 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:16.271 INFO:teuthology.orchestra.run.smithi105:> hostname 2020-02-12T15:02:16.561 INFO:teuthology.orchestra.run.smithi105.stdout:smithi105.front.sepia.ceph.com 2020-02-12T15:02:16.562 INFO:teuthology.orchestra.run.smithi105:> grep smithi105.front.sepia.ceph.com /etc/hosts 2020-02-12T15:02:16.576 INFO:teuthology.orchestra.run.smithi105.stdout:172.21.15.105 smithi105.front.sepia.ceph.com smithi105 2020-02-12T15:02:16.577 INFO:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2020-02-12T15:02:16.692 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hosts 2020-02-12T15:02:16.720 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/172.21.15.105/172.21.15.105/g' /etc/hosts 2020-02-12T15:02:16.786 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i -e 's/smithi105.front.sepia.ceph.com/smithi105/g' /etc/hostname 2020-02-12T15:02:16.854 INFO:teuthology.orchestra.run.smithi105:> sudo hostname smithi105 2020-02-12T15:02:16.922 INFO:teuthology.provision.fog.smithi105:Deploy complete! 2020-02-12T15:02:16.924 DEBUG:teuthology.parallel:result is None 2020-02-12T15:02:17.041 INFO:teuthology.lock.ops:Checking smithi180.front.sepia.ceph.com 2020-02-12T15:02:17.041 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-12T15:02:17.059 INFO:teuthology.lock.ops:Checking smithi105.front.sepia.ceph.com 2020-02-12T15:02:17.059 INFO:teuthology.lock.ops:New key found. Updating... 2020-02-12T15:02:17.073 INFO:teuthology.lock.ops:Updating [smithi180.front.sepia.ceph.com]: set os type and version on server 2020-02-12T15:02:17.074 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:02:17.074 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:17.142 INFO:teuthology.orchestra.run.smithi180:> true 2020-02-12T15:02:17.315 INFO:teuthology.orchestra.run.smithi180:> uname -m 2020-02-12T15:02:17.370 INFO:teuthology.orchestra.run.smithi180.stdout:x86_64 2020-02-12T15:02:17.370 INFO:teuthology.orchestra.run.smithi180:> cat /etc/os-release 2020-02-12T15:02:17.423 INFO:teuthology.orchestra.run.smithi180.stdout:NAME="CentOS Linux" 2020-02-12T15:02:17.423 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION="8 (Core)" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:ID="centos" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:ID_LIKE="rhel fedora" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_ID="8" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:PLATFORM_ID="platform:el8" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:ANSI_COLOR="0;31" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T15:02:17.424 INFO:teuthology.orchestra.run.smithi180.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T15:02:17.425 INFO:teuthology.orchestra.run.smithi180.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T15:02:17.425 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:17.425 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T15:02:17.425 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T15:02:17.425 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T15:02:17.425 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T15:02:17.425 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:17.426 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server 2020-02-12T15:02:17.440 INFO:teuthology.lock.ops:Updating [smithi105.front.sepia.ceph.com]: set os type and version on server 2020-02-12T15:02:17.440 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:02:17.441 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:17.506 INFO:teuthology.orchestra.run.smithi105:> true 2020-02-12T15:02:17.672 INFO:teuthology.orchestra.run.smithi105:> uname -m 2020-02-12T15:02:17.725 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2020-02-12T15:02:17.725 INFO:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2020-02-12T15:02:17.778 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2020-02-12T15:02:17.778 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)" 2020-02-12T15:02:17.779 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2020-02-12T15:02:17.779 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2020-02-12T15:02:17.779 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2020-02-12T15:02:17.779 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2020-02-12T15:02:17.779 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T15:02:17.779 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2020-02-12T15:02:17.779 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T15:02:17.780 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:17.781 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2020-02-12T15:02:17.794 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2020-02-12T15:02:17.828 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi105.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGWm+CuGOlwlg/4n3cZDEHqIXErpq2JC1q7Ew92Ft9+1YdqCcloPse1w2Af0XvCFvWxSsehcZXSJdBZ+9ESw7skbR6sB/5igEUMJNRhwxa9WfiyGoN5nkuGyDskHIjhOaBal0Q0drPIC+lax/glKEG4TPzge9PxWSJUwUmWZGDIcQ9uifpPFPQp54haBFfDBPIIIBce8PgvM3nXx/NLIVpXYAs9U+TnXUWoYQBEi+QLDNlV1jIu3jVx8qWHjPj0YUVXfx3JdfhSWHAUuWPBr7FknKcgHq0PS39YQMp04MKdvoLgef2SfXaRi3rr6rqivhOKdloBUdwZuxt7PHuirdqu0qvW4UcU6xD/u/AEr4IS4s7bzQRuHsYfiSFQuEdcEVGb4Q4iw7HlaSNGfbt1XkCuPq/hGSB7KDSod2/0DV0BCBa+PUve1YO5lXFGVa0EJj6DxrXV7lCPCGqmD1iNPtbz6tPsbElfUYfSUalnynqze+swojqB76NS8LSYohh1G8= smithi180.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8O5rBCIl/GN7WtRNJnG594kWaZ9QrMRG3j9MGW1ZrEJxu3JMokeCsRZ0vUQlSVu8T4r4BueI64HcMkbtR6ENE5xaoDlLIDX3IT+R07yVC4MPQPVM4aW6eynSUlDpOoeBAqLCI+YExiXSI68S0sBPILnIJoiIO7FwjDkWF9zMlXpaHVHwj3e3Zz5U+VrzdZ3NYac54/u9Wu1G03Z32oKZS7JTIaLUeLcSIVGDuFjQvawqCzB85a1o8xfSC5UV7nyvEJMJGBWBD3Vh+K0Wg+uHngYC9i4zKBpEC3qRI3IpV37XDTZ2gqjOJo9AGcZdJOy5BhCxNOxBiDSrFqy89Q8mg9MWpEzH/EXpTO4S9LLQE9TO8syzVvSk4NYFbIcEmQnVbPFUh1K29l7BJAkEowkL9pIYb7pkMVjWpJLvHuRfxgI7G6vs2qQeorb0xtmtmSHRQO+u/GWOUOQGhle9bcpHU6Alk9LTIc0eMglFuYOp0ItYFgkSez721MsodmWCVMf0= 2020-02-12T15:02:17.828 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2020-02-12T15:02:17.878 INFO:teuthology.run_tasks:Running task internal.save_config... 2020-02-12T15:02:17.887 INFO:teuthology.task.internal:Saving configuration 2020-02-12T15:02:17.905 INFO:teuthology.run_tasks:Running task internal.check_lock... 2020-02-12T15:02:17.915 INFO:teuthology.task.internal.check_lock:Checking locks... 2020-02-12T15:02:17.932 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-12 14:57:06.291829', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi180.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBEXJLb9wlRrehpufTNGwFHBckWSUTtw4IdQhxxEQobRoHZGO1efLIm4hYAMnMAkwj9jEUZtniEEi9qVuupzZBlo=', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755732'} 2020-02-12T15:02:17.946 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2020-02-12 14:57:06.291863', u'locked_by': u'scheduled_pdonnell@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi105.front.sepia.ceph.com', u'os_version': u'8', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA+6LBfmkTH1Zg9s/3SngJMJY4XT8fvOdrpZ8Tv6UNWJYYEpmiXGXa1tenTJj5OMdV2VUsvsyMUf41jeEAfABWc=', u'description': u'/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755732'} 2020-02-12T15:02:17.946 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2020-02-12T15:02:17.956 INFO:teuthology.task.internal:roles: ubuntu@smithi180.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2020-02-12T15:02:17.956 INFO:teuthology.task.internal:roles: ubuntu@smithi105.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2020-02-12T15:02:17.956 INFO:teuthology.run_tasks:Running task console_log... 2020-02-12T15:02:18.029 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2020-02-12T15:02:18.030 INFO:teuthology.run_tasks:Running task internal.connect... 2020-02-12T15:02:18.041 INFO:teuthology.task.internal:Opening connections... 2020-02-12T15:02:18.041 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:02:18.043 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:18.113 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:02:18.114 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:18.181 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2020-02-12T15:02:18.189 INFO:teuthology.orchestra.run.smithi180:> uname -m 2020-02-12T15:02:18.235 INFO:teuthology.orchestra.run.smithi180.stdout:x86_64 2020-02-12T15:02:18.235 INFO:teuthology.orchestra.run.smithi180:> cat /etc/os-release 2020-02-12T15:02:18.289 INFO:teuthology.orchestra.run.smithi180.stdout:NAME="CentOS Linux" 2020-02-12T15:02:18.289 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION="8 (Core)" 2020-02-12T15:02:18.289 INFO:teuthology.orchestra.run.smithi180.stdout:ID="centos" 2020-02-12T15:02:18.289 INFO:teuthology.orchestra.run.smithi180.stdout:ID_LIKE="rhel fedora" 2020-02-12T15:02:18.289 INFO:teuthology.orchestra.run.smithi180.stdout:VERSION_ID="8" 2020-02-12T15:02:18.290 INFO:teuthology.orchestra.run.smithi180.stdout:PLATFORM_ID="platform:el8" 2020-02-12T15:02:18.290 INFO:teuthology.orchestra.run.smithi180.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T15:02:18.291 INFO:teuthology.orchestra.run.smithi180.stdout:ANSI_COLOR="0;31" 2020-02-12T15:02:18.291 INFO:teuthology.orchestra.run.smithi180.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T15:02:18.291 INFO:teuthology.orchestra.run.smithi180.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T15:02:18.291 INFO:teuthology.orchestra.run.smithi180.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T15:02:18.291 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:18.291 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T15:02:18.292 INFO:teuthology.orchestra.run.smithi180.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T15:02:18.292 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T15:02:18.292 INFO:teuthology.orchestra.run.smithi180.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T15:02:18.292 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:18.292 INFO:teuthology.lock.ops:Updating smithi180.front.sepia.ceph.com on lock server 2020-02-12T15:02:18.307 INFO:teuthology.orchestra.run.smithi105:> uname -m 2020-02-12T15:02:18.322 INFO:teuthology.orchestra.run.smithi105.stdout:x86_64 2020-02-12T15:02:18.322 INFO:teuthology.orchestra.run.smithi105:> cat /etc/os-release 2020-02-12T15:02:18.375 INFO:teuthology.orchestra.run.smithi105.stdout:NAME="CentOS Linux" 2020-02-12T15:02:18.375 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION="8 (Core)" 2020-02-12T15:02:18.375 INFO:teuthology.orchestra.run.smithi105.stdout:ID="centos" 2020-02-12T15:02:18.376 INFO:teuthology.orchestra.run.smithi105.stdout:ID_LIKE="rhel fedora" 2020-02-12T15:02:18.376 INFO:teuthology.orchestra.run.smithi105.stdout:VERSION_ID="8" 2020-02-12T15:02:18.376 INFO:teuthology.orchestra.run.smithi105.stdout:PLATFORM_ID="platform:el8" 2020-02-12T15:02:18.376 INFO:teuthology.orchestra.run.smithi105.stdout:PRETTY_NAME="CentOS Linux 8 (Core)" 2020-02-12T15:02:18.376 INFO:teuthology.orchestra.run.smithi105.stdout:ANSI_COLOR="0;31" 2020-02-12T15:02:18.376 INFO:teuthology.orchestra.run.smithi105.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2020-02-12T15:02:18.377 INFO:teuthology.orchestra.run.smithi105.stdout:HOME_URL="https://www.centos.org/" 2020-02-12T15:02:18.377 INFO:teuthology.orchestra.run.smithi105.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2020-02-12T15:02:18.377 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:18.377 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT="CentOS-8" 2020-02-12T15:02:18.377 INFO:teuthology.orchestra.run.smithi105.stdout:CENTOS_MANTISBT_PROJECT_VERSION="8" 2020-02-12T15:02:18.377 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2020-02-12T15:02:18.377 INFO:teuthology.orchestra.run.smithi105.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8" 2020-02-12T15:02:18.378 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:18.378 INFO:teuthology.lock.ops:Updating smithi105.front.sepia.ceph.com on lock server 2020-02-12T15:02:18.390 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2020-02-12T15:02:18.405 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2020-02-12T15:02:18.415 INFO:teuthology.task.internal:Checking for old test directory... 2020-02-12T15:02:18.416 INFO:teuthology.orchestra.run.smithi105:> test '!' -e /home/ubuntu/cephtest 2020-02-12T15:02:18.418 INFO:teuthology.orchestra.run.smithi180:> test '!' -e /home/ubuntu/cephtest 2020-02-12T15:02:18.431 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2020-02-12T15:02:18.441 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2020-02-12T15:02:18.441 INFO:teuthology.orchestra.run.smithi105:> test -z $(ls -A /var/lib/ceph) 2020-02-12T15:02:18.471 INFO:teuthology.orchestra.run.smithi180:> test -z $(ls -A /var/lib/ceph) 2020-02-12T15:02:18.485 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2020-02-12T15:02:18.531 INFO:teuthology.run_tasks:Running task kernel... 2020-02-12T15:02:18.548 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}, 'mds.a': {'sha1': 'distro', 'kdb': True}, 'mds.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}} 2020-02-12T15:02:18.548 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2020-02-12T15:02:18.549 INFO:teuthology.orchestra.run.smithi180:> uname -r 2020-02-12T15:02:18.562 INFO:teuthology.orchestra.run.smithi180.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-12T15:02:18.562 INFO:teuthology.task.kernel:Running kernel on smithi180: 4.18.0-147.5.1.el8_1.x86_64 2020-02-12T15:02:18.563 INFO:teuthology.orchestra.run.smithi180:> sudo yum install -y kernel 2020-02-12T15:02:21.094 INFO:teuthology.orchestra.run.smithi180.stdout:Last metadata expiration check: 23:13:21 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T15:02:21.473 INFO:teuthology.orchestra.run.smithi180.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-12T15:02:21.473 INFO:teuthology.orchestra.run.smithi180.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-02-12T15:02:21.617 INFO:teuthology.orchestra.run.smithi180.stdout:Dependencies resolved. 2020-02-12T15:02:21.618 INFO:teuthology.orchestra.run.smithi180.stdout:Nothing to do. 2020-02-12T15:02:21.618 INFO:teuthology.orchestra.run.smithi180.stdout:Complete! 2020-02-12T15:02:21.754 INFO:teuthology.orchestra.run.smithi180:> echo no | sudo yum reinstall kernel || true 2020-02-12T15:02:22.177 INFO:teuthology.orchestra.run.smithi180.stdout:Last metadata expiration check: 23:13:23 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T15:02:22.530 INFO:teuthology.orchestra.run.smithi180.stdout:Dependencies resolved. 2020-02-12T15:02:22.530 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:02:22.530 INFO:teuthology.orchestra.run.smithi180.stdout: Package Architecture Version Repository Size 2020-02-12T15:02:22.530 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:02:22.531 INFO:teuthology.orchestra.run.smithi180.stdout:Reinstalling: 2020-02-12T15:02:22.531 INFO:teuthology.orchestra.run.smithi180.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T15:02:22.531 INFO:teuthology.orchestra.run.smithi180.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T15:02:22.531 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:22.531 INFO:teuthology.orchestra.run.smithi180.stdout:Transaction Summary 2020-02-12T15:02:22.531 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:02:22.531 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:22.532 INFO:teuthology.orchestra.run.smithi180.stdout:Total download size: 3.1 M 2020-02-12T15:02:22.532 INFO:teuthology.orchestra.run.smithi180.stdout:Installed size: 0 2020-02-12T15:02:22.532 INFO:teuthology.orchestra.run.smithi180.stderr:Operation aborted. 2020-02-12T15:02:22.617 INFO:teuthology.orchestra.run.smithi180.stdout:Is this ok [y/N]: 2020-02-12T15:02:22.617 INFO:teuthology.orchestra.run.smithi180:> sudo yum reinstall -y kernel || true 2020-02-12T15:02:22.999 INFO:teuthology.orchestra.run.smithi180.stdout:Last metadata expiration check: 23:13:23 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T15:02:23.341 INFO:teuthology.orchestra.run.smithi180.stdout:Dependencies resolved. 2020-02-12T15:02:23.342 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:02:23.342 INFO:teuthology.orchestra.run.smithi180.stdout: Package Architecture Version Repository Size 2020-02-12T15:02:23.342 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:02:23.342 INFO:teuthology.orchestra.run.smithi180.stdout:Reinstalling: 2020-02-12T15:02:23.342 INFO:teuthology.orchestra.run.smithi180.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T15:02:23.342 INFO:teuthology.orchestra.run.smithi180.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T15:02:23.343 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:23.343 INFO:teuthology.orchestra.run.smithi180.stdout:Transaction Summary 2020-02-12T15:02:23.343 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:02:23.343 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:23.343 INFO:teuthology.orchestra.run.smithi180.stdout:Total download size: 3.1 M 2020-02-12T15:02:23.344 INFO:teuthology.orchestra.run.smithi180.stdout:Installed size: 0 2020-02-12T15:02:23.344 INFO:teuthology.orchestra.run.smithi180.stdout:Downloading Packages: 2020-02-12T15:02:23.650 INFO:teuthology.orchestra.run.smithi180.stdout:(1/2): kernel-4.18.0-147.el8.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2020-02-12T15:02:23.674 INFO:teuthology.orchestra.run.smithi180.stdout:(2/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 6.2 MB/s | 1.5 MB 00:00 2020-02-12T15:02:23.674 INFO:teuthology.orchestra.run.smithi180.stdout:-------------------------------------------------------------------------------- 2020-02-12T15:02:23.674 INFO:teuthology.orchestra.run.smithi180.stdout:Total 9.2 MB/s | 3.1 MB 00:00 2020-02-12T15:02:23.697 INFO:teuthology.orchestra.run.smithi180.stdout:Running transaction check 2020-02-12T15:02:23.877 INFO:teuthology.orchestra.run.smithi180.stdout:Transaction check succeeded. 2020-02-12T15:02:23.877 INFO:teuthology.orchestra.run.smithi180.stdout:Running transaction test 2020-02-12T15:02:23.940 INFO:teuthology.orchestra.run.smithi180.stdout:Transaction test succeeded. 2020-02-12T15:02:23.940 INFO:teuthology.orchestra.run.smithi180.stdout:Running transaction 2020-02-12T15:02:24.082 INFO:teuthology.orchestra.run.smithi180.stdout: Preparing : 1/1 2020-02-12T15:02:24.272 INFO:teuthology.orchestra.run.smithi180.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-02-12T15:02:24.398 INFO:teuthology.orchestra.run.smithi180.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T15:02:24.398 INFO:teuthology.orchestra.run.smithi180.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T15:02:24.499 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T15:02:24.499 INFO:teuthology.orchestra.run.smithi180.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T15:02:24.723 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T15:02:24.723 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-02-12T15:02:24.723 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T15:02:24.724 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T15:02:24.952 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-02-12T15:02:24.952 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:24.952 INFO:teuthology.orchestra.run.smithi180.stdout:Reinstalled: 2020-02-12T15:02:24.952 INFO:teuthology.orchestra.run.smithi180.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-02-12T15:02:24.952 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:24.952 INFO:teuthology.orchestra.run.smithi180.stdout:Complete! 2020-02-12T15:02:25.071 INFO:teuthology.orchestra.run.smithi180:> rpm -q kernel --last | head -n 1 2020-02-12T15:02:25.180 INFO:teuthology.orchestra.run.smithi180.stdout:kernel-4.18.0-147.el8.x86_64 Wed 12 Feb 2020 03:02:24 PM UTC 2020-02-12T15:02:25.181 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-12T15:02:25.181 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-147.5.1.el8_1.x86_64 Expected: 4.18.0-147.el8.x86_64 2020-02-12T15:02:25.182 INFO:teuthology.orchestra.run.smithi105:> uname -r 2020-02-12T15:02:25.199 INFO:teuthology.orchestra.run.smithi105.stdout:4.18.0-147.5.1.el8_1.x86_64 2020-02-12T15:02:25.199 INFO:teuthology.task.kernel:Running kernel on smithi105: 4.18.0-147.5.1.el8_1.x86_64 2020-02-12T15:02:25.199 INFO:teuthology.orchestra.run.smithi105:> sudo yum install -y kernel 2020-02-12T15:02:27.663 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 23:13:28 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T15:02:28.043 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-4.18.0-147.el8.x86_64 is already installed. 2020-02-12T15:02:28.043 INFO:teuthology.orchestra.run.smithi105.stdout:Package kernel-4.18.0-147.5.1.el8_1.x86_64 is already installed. 2020-02-12T15:02:28.189 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-02-12T15:02:28.190 INFO:teuthology.orchestra.run.smithi105.stdout:Nothing to do. 2020-02-12T15:02:28.191 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2020-02-12T15:02:28.337 INFO:teuthology.orchestra.run.smithi105:> echo no | sudo yum reinstall kernel || true 2020-02-12T15:02:28.719 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 23:13:29 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T15:02:29.085 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-02-12T15:02:29.085 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:02:29.085 INFO:teuthology.orchestra.run.smithi105.stdout: Package Architecture Version Repository Size 2020-02-12T15:02:29.086 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:02:29.086 INFO:teuthology.orchestra.run.smithi105.stdout:Reinstalling: 2020-02-12T15:02:29.086 INFO:teuthology.orchestra.run.smithi105.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T15:02:29.086 INFO:teuthology.orchestra.run.smithi105.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T15:02:29.086 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:29.086 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2020-02-12T15:02:29.086 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:02:29.087 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:29.087 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 3.1 M 2020-02-12T15:02:29.087 INFO:teuthology.orchestra.run.smithi105.stdout:Installed size: 0 2020-02-12T15:02:29.088 INFO:teuthology.orchestra.run.smithi105.stderr:Operation aborted. 2020-02-12T15:02:29.204 INFO:teuthology.orchestra.run.smithi105.stdout:Is this ok [y/N]: 2020-02-12T15:02:29.205 INFO:teuthology.orchestra.run.smithi105:> sudo yum reinstall -y kernel || true 2020-02-12T15:02:29.586 INFO:teuthology.orchestra.run.smithi105.stdout:Last metadata expiration check: 23:13:30 ago on Tue 11 Feb 2020 03:48:59 PM UTC. 2020-02-12T15:02:29.933 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-02-12T15:02:29.933 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout: Package Architecture Version Repository Size 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout:Reinstalling: 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout: kernel x86_64 4.18.0-147.5.1.el8_1 BaseOS 1.5 M 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout: kernel x86_64 4.18.0-147.el8 BaseOS 1.5 M 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2020-02-12T15:02:29.934 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:02:29.935 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:29.935 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 3.1 M 2020-02-12T15:02:29.935 INFO:teuthology.orchestra.run.smithi105.stdout:Installed size: 0 2020-02-12T15:02:29.935 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2020-02-12T15:02:30.487 INFO:teuthology.orchestra.run.smithi105.stdout:(1/2): kernel-4.18.0-147.el8.x86_64.rpm 6.8 MB/s | 1.5 MB 00:00 2020-02-12T15:02:30.512 INFO:teuthology.orchestra.run.smithi105.stdout:(2/2): kernel-4.18.0-147.5.1.el8_1.x86_64.rpm 6.2 MB/s | 1.5 MB 00:00 2020-02-12T15:02:30.512 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2020-02-12T15:02:30.512 INFO:teuthology.orchestra.run.smithi105.stdout:Total 5.3 MB/s | 3.1 MB 00:00 2020-02-12T15:02:30.534 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2020-02-12T15:02:30.709 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2020-02-12T15:02:30.709 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2020-02-12T15:02:30.788 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2020-02-12T15:02:30.788 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2020-02-12T15:02:30.919 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2020-02-12T15:02:31.074 INFO:teuthology.orchestra.run.smithi105.stdout: Reinstalling : kernel-4.18.0-147.el8.x86_64 1/4 2020-02-12T15:02:31.183 INFO:teuthology.orchestra.run.smithi105.stdout: Reinstalling : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T15:02:31.184 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T15:02:31.284 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T15:02:31.284 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T15:02:31.515 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: kernel-4.18.0-147.5.1.el8_1.x86_64 4/4 2020-02-12T15:02:31.516 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 1/4 2020-02-12T15:02:31.516 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-4.18.0-147.5.1.el8_1.x86_64 2/4 2020-02-12T15:02:31.516 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 3/4 2020-02-12T15:02:31.746 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : kernel-4.18.0-147.el8.x86_64 4/4 2020-02-12T15:02:31.747 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:31.747 INFO:teuthology.orchestra.run.smithi105.stdout:Reinstalled: 2020-02-12T15:02:31.747 INFO:teuthology.orchestra.run.smithi105.stdout: kernel-4.18.0-147.5.1.el8_1.x86_64 kernel-4.18.0-147.el8.x86_64 2020-02-12T15:02:31.747 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:02:31.747 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2020-02-12T15:02:31.848 INFO:teuthology.orchestra.run.smithi105:> rpm -q kernel --last | head -n 1 2020-02-12T15:02:31.907 INFO:teuthology.orchestra.run.smithi105.stdout:kernel-4.18.0-147.5.1.el8_1.x86_64 Wed 12 Feb 2020 03:02:31 PM UTC 2020-02-12T15:02:31.908 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.5.1.el8_1.x86_64 2020-02-12T15:02:31.908 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2020-02-12T15:02:31.908 DEBUG:teuthology.task.kernel:src is distro, skipping download 2020-02-12T15:02:31.909 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2020-02-12T15:02:31.909 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi180.front.sepia.ceph.com, path=None, version=distro) 2020-02-12T15:02:31.909 INFO:teuthology.orchestra.run.smithi180:> rpm -q kernel --last | head -n 1 2020-02-12T15:02:31.956 INFO:teuthology.orchestra.run.smithi180.stdout:kernel-4.18.0-147.el8.x86_64 Wed 12 Feb 2020 03:02:24 PM UTC 2020-02-12T15:02:31.958 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-147.el8.x86_64 2020-02-12T15:02:31.958 INFO:teuthology.orchestra.run.smithi180:> sudo rpm -qi grub2-tools 2020-02-12T15:02:31.992 INFO:teuthology.orchestra.run.smithi180.stdout:Name : grub2-tools 2020-02-12T15:02:31.992 INFO:teuthology.orchestra.run.smithi180.stdout:Epoch : 1 2020-02-12T15:02:31.992 INFO:teuthology.orchestra.run.smithi180.stdout:Version : 2.02 2020-02-12T15:02:31.993 INFO:teuthology.orchestra.run.smithi180.stdout:Release : 78.el8 2020-02-12T15:02:31.993 INFO:teuthology.orchestra.run.smithi180.stdout:Architecture: x86_64 2020-02-12T15:02:31.993 INFO:teuthology.orchestra.run.smithi180.stdout:Install Date: Tue 11 Feb 2020 03:32:52 PM UTC 2020-02-12T15:02:31.993 INFO:teuthology.orchestra.run.smithi180.stdout:Group : System Environment/Base 2020-02-12T15:02:31.993 INFO:teuthology.orchestra.run.smithi180.stdout:Size : 9192691 2020-02-12T15:02:31.993 INFO:teuthology.orchestra.run.smithi180.stdout:License : GPLv3+ 2020-02-12T15:02:31.994 INFO:teuthology.orchestra.run.smithi180.stdout:Signature : RSA/SHA256, Wed 04 Dec 2019 11:50:58 PM UTC, Key ID 05b555b38483c65d 2020-02-12T15:02:31.994 INFO:teuthology.orchestra.run.smithi180.stdout:Source RPM : grub2-2.02-78.el8.src.rpm 2020-02-12T15:02:31.994 INFO:teuthology.orchestra.run.smithi180.stdout:Build Date : Mon 25 Nov 2019 04:08:30 PM UTC 2020-02-12T15:02:31.994 INFO:teuthology.orchestra.run.smithi180.stdout:Build Host : kbuilder.bsys.centos.org 2020-02-12T15:02:31.994 INFO:teuthology.orchestra.run.smithi180.stdout:Relocations : (not relocatable) 2020-02-12T15:02:31.994 INFO:teuthology.orchestra.run.smithi180.stdout:Packager : CentOS BuildSystem 2020-02-12T15:02:31.995 INFO:teuthology.orchestra.run.smithi180.stdout:Vendor : CentOS 2020-02-12T15:02:31.995 INFO:teuthology.orchestra.run.smithi180.stdout:URL : http://www.gnu.org/software/grub/ 2020-02-12T15:02:31.995 INFO:teuthology.orchestra.run.smithi180.stdout:Summary : Support tools for GRUB. 2020-02-12T15:02:31.995 INFO:teuthology.orchestra.run.smithi180.stdout:Description : 2020-02-12T15:02:31.995 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:31.995 INFO:teuthology.orchestra.run.smithi180.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2020-02-12T15:02:31.996 INFO:teuthology.orchestra.run.smithi180.stdout:customizable bootloader with modular architecture. It supports a rich 2020-02-12T15:02:31.996 INFO:teuthology.orchestra.run.smithi180.stdout:variety of kernel formats, file systems, computer architectures and 2020-02-12T15:02:31.996 INFO:teuthology.orchestra.run.smithi180.stdout:hardware devices. 2020-02-12T15:02:31.996 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:02:31.996 INFO:teuthology.orchestra.run.smithi180.stdout:This subpackage provides tools for support of all platforms. 2020-02-12T15:02:31.997 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2020-02-12T15:02:31.997 INFO:teuthology.task.kernel:Updating grub on smithi180 to boot 4.18.0-147.el8.x86_64 2020-02-12T15:02:31.998 INFO:teuthology.orchestra.run.smithi180:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2020-02-12T15:02:32.978 INFO:teuthology.orchestra.run.smithi180.stderr:Generating grub configuration file ... 2020-02-12T15:02:35.303 INFO:teuthology.orchestra.run.smithi180.stderr:done 2020-02-12T15:02:35.304 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:02:35.343 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.yTsJduZoYT 2020-02-12T15:02:35.344 INFO:teuthology.orchestra.run.smithi180:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.yTsJduZoYT 2020-02-12T15:02:35.416 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.yTsJduZoYT 2020-02-12T15:02:35.563 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.yTsJduZoYT is 4KB 2020-02-12T15:02:35.611 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.yTsJduZoYT 2020-02-12T15:02:35.625 INFO:teuthology.orchestra.run.smithi180:> sudo /bin/ls /boot/loader/entries || true 2020-02-12T15:02:35.690 INFO:teuthology.orchestra.run.smithi180.stdout:64c9091786944d63a01cf35d7b3c4063-0-rescue.conf 2020-02-12T15:02:35.691 INFO:teuthology.orchestra.run.smithi180.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.5.1.el8_1.x86_64.conf 2020-02-12T15:02:35.691 INFO:teuthology.orchestra.run.smithi180.stdout:64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64.conf 2020-02-12T15:02:35.692 INFO:teuthology.orchestra.run.smithi180:> sudo grub2-set-default 64c9091786944d63a01cf35d7b3c4063-4.18.0-147.el8.x86_64 2020-02-12T15:02:35.860 INFO:teuthology.orchestra.run.smithi180:> sudo shutdown -r now 2020-02-12T15:02:35.862 INFO:teuthology.misc:Re-opening connections... 2020-02-12T15:02:35.863 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:02:35.864 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:02:35.865 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:35.953 INFO:teuthology.orchestra.run.smithi180:> true 2020-02-12T15:02:36.193 DEBUG:teuthology.misc:waited 0.329997062683 2020-02-12T15:02:37.193 INFO:teuthology.misc:trying to connect to ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:02:37.195 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:02:37.196 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:02:37.265 INFO:teuthology.orchestra.run.smithi105:> true 2020-02-12T15:02:37.432 DEBUG:teuthology.misc:waited 1.56888890266 2020-02-12T15:02:38.432 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-02-12T15:02:38.432 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.el8.x86_64"... 2020-02-12T15:02:38.433 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:02:38.433 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:13.126 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:13.126 ERROR:teuthology.task.kernel:Saw exception Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 696, in wait_for_reboot assert not need_to_install(ctx, client, need_install[client]), \ File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/kernel.py", line 184, in need_to_install stdout=uname_fp, File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/cluster.py", line 64, in run return [remote.run(**kwargs) for remote in remotes] File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 198, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 416, in run raise ConnectionLostError(command=quote(args), node=name) ConnectionLostError: SSH connection to smithi180 was lost: 'uname -r' 2020-02-12T15:03:14.128 INFO:teuthology.misc:Re-opening connections... 2020-02-12T15:03:14.128 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:14.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:14.128 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:17.194 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:17.194 INFO:teuthology.misc:trying to connect to ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:03:17.196 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:17.196 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:17.266 INFO:teuthology.orchestra.run.smithi105:> true 2020-02-12T15:03:17.431 DEBUG:teuthology.misc:waited 3.30338692665 2020-02-12T15:03:18.431 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:18.432 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:18.433 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:20.262 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:20.262 DEBUG:teuthology.misc:waited 6.13427591324 2020-02-12T15:03:21.262 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:21.263 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:21.263 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:23.334 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:23.334 DEBUG:teuthology.misc:waited 9.20631480217 2020-02-12T15:03:24.334 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:24.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:24.335 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:26.410 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:26.410 DEBUG:teuthology.misc:waited 12.2821838856 2020-02-12T15:03:27.411 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:27.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:27.412 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:29.478 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:29.478 DEBUG:teuthology.misc:waited 15.350317955 2020-02-12T15:03:30.479 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:30.479 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:30.480 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:32.554 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:32.554 DEBUG:teuthology.misc:waited 18.4265058041 2020-02-12T15:03:33.555 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:33.555 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:33.556 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:35.622 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:35.622 DEBUG:teuthology.misc:waited 21.4941678047 2020-02-12T15:03:36.623 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:36.623 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:36.624 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:38.698 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:38.698 DEBUG:teuthology.misc:waited 24.5701448917 2020-02-12T15:03:39.699 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:39.699 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:39.700 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:41.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:41.766 DEBUG:teuthology.misc:waited 27.6381559372 2020-02-12T15:03:42.767 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:42.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:42.767 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:44.838 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:44.838 DEBUG:teuthology.misc:waited 30.7101500034 2020-02-12T15:03:45.838 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:45.838 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:45.839 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:03:47.910 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.180 2020-02-12T15:03:47.910 DEBUG:teuthology.misc:waited 33.782255888 2020-02-12T15:03:48.911 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:03:48.911 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:03:48.911 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:04:48.913 DEBUG:teuthology.orchestra.remote:timed out 2020-02-12T15:04:48.914 DEBUG:teuthology.misc:waited 94.7858309746 2020-02-12T15:04:49.915 INFO:teuthology.misc:trying to connect to ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:04:49.915 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:04:49.915 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:04:50.255 INFO:teuthology.orchestra.run.smithi180:> true 2020-02-12T15:04:50.548 DEBUG:teuthology.misc:waited 96.4203848839 2020-02-12T15:04:51.549 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2020-02-12T15:04:51.550 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-147.el8.x86_64"... 2020-02-12T15:04:51.550 INFO:teuthology.orchestra.run.smithi180:> uname -r 2020-02-12T15:04:51.566 INFO:teuthology.orchestra.run.smithi180.stdout:4.18.0-147.el8.x86_64 2020-02-12T15:04:51.566 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-147.el8.x86_64 vs 4.18.0-147.el8.x86_64 2020-02-12T15:04:51.566 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2020-02-12T15:04:52.567 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2020-02-12T15:04:52.567 INFO:teuthology.orchestra.run.smithi180:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-02-12T15:04:52.674 INFO:teuthology.orchestra.run.smithi180.stdout:ttyS1 2020-02-12T15:04:52.686 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2020-02-12T15:04:52.687 INFO:teuthology.orchestra.run.smithi105:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2020-02-12T15:04:52.735 INFO:teuthology.orchestra.run.smithi105.stdout:ttyS1 2020-02-12T15:04:52.747 INFO:teuthology.run_tasks:Running task internal.base... 2020-02-12T15:04:52.760 INFO:teuthology.task.internal:Creating test directory... 2020-02-12T15:04:52.760 INFO:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-02-12T15:04:52.763 INFO:teuthology.orchestra.run.smithi180:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2020-02-12T15:04:52.779 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2020-02-12T15:04:52.790 INFO:teuthology.run_tasks:Running task internal.archive... 2020-02-12T15:04:52.805 INFO:teuthology.task.internal:Creating archive directory... 2020-02-12T15:04:52.805 INFO:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-02-12T15:04:52.819 INFO:teuthology.orchestra.run.smithi180:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2020-02-12T15:04:52.846 INFO:teuthology.run_tasks:Running task internal.coredump... 2020-02-12T15:04:52.860 INFO:teuthology.task.internal:Enabling coredump saving... 2020-02-12T15:04:52.860 INFO:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-02-12T15:04:52.884 INFO:teuthology.orchestra.run.smithi180:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2020-02-12T15:04:52.917 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T15:04:52.917 INFO:teuthology.orchestra.run.smithi180.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T15:04:52.931 INFO:teuthology.orchestra.run.smithi105.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T15:04:52.932 INFO:teuthology.orchestra.run.smithi180.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2020-02-12T15:04:52.934 INFO:teuthology.run_tasks:Running task internal.sudo... 2020-02-12T15:04:52.945 INFO:teuthology.task.internal:Configuring sudo... 2020-02-12T15:04:52.945 INFO:teuthology.orchestra.run.smithi105:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-02-12T15:04:52.976 INFO:teuthology.orchestra.run.smithi180:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2020-02-12T15:04:53.006 INFO:teuthology.run_tasks:Running task internal.syslog... 2020-02-12T15:04:53.049 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2020-02-12T15:04:53.050 INFO:teuthology.orchestra.run.smithi105:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-02-12T15:04:53.052 INFO:teuthology.orchestra.run.smithi180:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2020-02-12T15:04:53.067 INFO:teuthology.orchestra.run.smithi180:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T15:04:53.140 INFO:teuthology.orchestra.run.smithi180:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T15:04:53.194 INFO:teuthology.orchestra.run.smithi180:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T15:04:53.269 INFO:teuthology.orchestra.run.smithi180:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T15:04:53.318 INFO:teuthology.orchestra.run.smithi180:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-02-12T15:04:53.403 INFO:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T15:04:53.438 INFO:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2020-02-12T15:04:53.497 INFO:teuthology.orchestra.run.smithi105:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T15:04:53.572 INFO:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2020-02-12T15:04:53.622 INFO:teuthology.orchestra.run.smithi105:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2020-02-12T15:04:53.707 INFO:teuthology.orchestra.run.smithi105:> sudo service rsyslog restart 2020-02-12T15:04:53.750 INFO:teuthology.orchestra.run.smithi180:> sudo service rsyslog restart 2020-02-12T15:04:53.813 INFO:teuthology.orchestra.run.smithi180.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-02-12T15:04:53.819 INFO:teuthology.orchestra.run.smithi105.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2020-02-12T15:04:54.176 INFO:teuthology.run_tasks:Running task internal.timer... 2020-02-12T15:04:54.189 INFO:teuthology.task.internal:Starting timer... 2020-02-12T15:04:54.189 INFO:teuthology.run_tasks:Running task pcp... 2020-02-12T15:04:54.251 INFO:teuthology.run_tasks:Running task selinux... 2020-02-12T15:04:54.264 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2020-02-12T15:04:54.265 INFO:teuthology.orchestra.run.smithi105:> sudo service auditd rotate 2020-02-12T15:04:54.355 INFO:teuthology.orchestra.run.smithi105.stdout:Rotating logs: [ OK ] 2020-02-12T15:04:54.356 INFO:teuthology.orchestra.run.smithi180:> sudo service auditd rotate 2020-02-12T15:04:54.430 INFO:teuthology.orchestra.run.smithi180.stdout:Rotating logs: [ OK ] 2020-02-12T15:04:54.431 DEBUG:teuthology.task.selinux:Getting current SELinux state 2020-02-12T15:04:54.432 INFO:teuthology.orchestra.run.smithi180:> /usr/sbin/getenforce 2020-02-12T15:04:54.453 INFO:teuthology.orchestra.run.smithi180.stdout:Permissive 2020-02-12T15:04:54.453 INFO:teuthology.orchestra.run.smithi105:> /usr/sbin/getenforce 2020-02-12T15:04:54.475 INFO:teuthology.orchestra.run.smithi105.stdout:Permissive 2020-02-12T15:04:54.476 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi180.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi105.front.sepia.ceph.com': 'permissive'} 2020-02-12T15:04:54.476 INFO:teuthology.orchestra.run.smithi180:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-02-12T15:04:54.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-12T15:04:54.521 INFO:teuthology.orchestra.run.smithi105:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\|comm="rhsmcertd-worke"\|comm="setroubleshootd"\|comm="rpm"\|tcontext=system_u:object_r:container_runtime_exec_t:s0\|scontext=system_u:system_r:logrotate_t:s0\)' 2020-02-12T15:04:54.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2020-02-12T15:04:54.548 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2020-02-12T15:04:54.549 INFO:teuthology.orchestra.run.smithi180:> sudo /usr/sbin/setenforce permissive 2020-02-12T15:04:54.588 INFO:teuthology.orchestra.run.smithi105:> sudo /usr/sbin/setenforce permissive 2020-02-12T15:04:54.624 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2020-02-12T15:04:54.636 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2020-02-12T15:04:54.636 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2020-02-12T15:04:54.652 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2020-02-12T15:04:54.655 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi180.front.sepia.ceph.com,smithi105.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2020-02-12T15:04:55.022 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2020-02-12T15:04:56.167 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2020-02-12T15:04:58.896 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2020-02-12T15:04:58.918 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:04:58 +0000 (0:00:00.065) 0:00:00.065 **** 2020-02-12T15:04:58.930 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:04:58 +0000 (0:00:00.010) 0:00:00.076 **** 2020-02-12T15:05:01.356 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-02-12T15:05:01.357 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] 2020-02-12T15:05:01.440 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:01 +0000 (0:00:02.510) 0:00:02.586 **** 2020-02-12T15:05:01.764 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-02-12T15:05:01.766 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T15:05:01.801 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:01 +0000 (0:00:00.361) 0:00:02.948 **** 2020-02-12T15:05:02.231 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-02-12T15:05:02.232 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-02-12T15:05:02.269 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:02 +0000 (0:00:00.468) 0:00:03.416 **** 2020-02-12T15:05:02.296 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-02-12T15:05:02.298 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:02.331 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:02 +0000 (0:00:00.062) 0:00:03.478 **** 2020-02-12T15:05:02.433 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-02-12T15:05:02.435 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] 2020-02-12T15:05:02.510 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:02 +0000 (0:00:00.178) 0:00:03.656 **** 2020-02-12T15:05:02.648 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-02-12T15:05:02.648 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:05:02.686 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:02 +0000 (0:00:00.176) 0:00:03.833 **** 2020-02-12T15:05:02.701 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2020-02-12T15:05:02.702 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T15:05:02.741 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:02 +0000 (0:00:00.054) 0:00:03.888 **** 2020-02-12T15:05:02.972 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2020-02-12T15:05:02.973 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2020-02-12T15:05:03.011 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:03 +0000 (0:00:00.270) 0:00:04.158 **** 2020-02-12T15:05:03.037 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2020-02-12T15:05:03.038 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:03.076 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:03 +0000 (0:00:00.064) 0:00:04.223 **** 2020-02-12T15:05:03.278 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2020-02-12T15:05:03.279 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:05:03.333 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:03 +0000 (0:00:00.257) 0:00:04.480 **** 2020-02-12T15:05:03.630 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2020-02-12T15:05:03.630 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581519902.7-253405426629702/source", "state": "file", "uid": 0} 2020-02-12T15:05:03.673 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:03 +0000 (0:00:00.339) 0:00:04.820 **** 2020-02-12T15:05:03.979 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1581519903.35-192587994455187/source", "state": "file", "uid": 0} 2020-02-12T15:05:04.017 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:04 +0000 (0:00:00.344) 0:00:05.164 **** 2020-02-12T15:05:04.137 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2020-02-12T15:05:04.137 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-02-12T15:05:04.139 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-02-12T15:05:04.293 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "comment": null, "exclusive": true, "follow": false, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv 2020-02-12T15:05:04.295 INFO:teuthology.task.ansible.out:4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2020-02-12T15:05:04.387 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2020-02-12T15:05:04.393 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2020-02-12T15:05:04.587 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:04 +0000 (0:00:00.569) 0:00:05.734 **** 2020-02-12T15:05:04.620 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:04 +0000 (0:00:00.032) 0:00:05.766 **** 2020-02-12T15:05:05.226 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* 2020-02-12T15:05:05.228 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] 2020-02-12T15:05:05.275 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] 2020-02-12T15:05:05.319 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. 2020-02-12T15:05:05.320 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:05 +0000 (0:00:00.699) 0:00:06.466 **** 2020-02-12T15:05:05.395 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:05 +0000 (0:00:00.075) 0:00:06.542 **** 2020-02-12T15:05:05.397 INFO:teuthology.task.ansible.out: 2020-02-12T15:05:05.794 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** changed: [smithi105.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.219004", "end": "2020-02-12 15:05:05.777372", "rc": 0, "start": "2020-02-12 15:05:05.558368", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T15:05:05.834 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:05 +0000 (0:00:00.438) 0:00:06.981 **** 2020-02-12T15:05:05.901 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.320909", "end": "2020-02-12 15:05:05.879670", "rc": 0, "start": "2020-02-12 15:05:05.558761", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T15:05:05.938 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:05 +0000 (0:00:00.103) 0:00:07.085 **** 2020-02-12T15:05:06.036 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-02-12T15:05:06.036 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.008158", "end": "2020-02-12 15:05:06.013141", "failed_when_result": false, "rc": 0, "start": "2020-02-12 15:05:06.004983", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T15:05:06.079 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.141) 0:00:07.226 **** 2020-02-12T15:05:06.105 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-02-12T15:05:06.107 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-02-12T15:05:06.142 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.062) 0:00:07.288 **** 2020-02-12T15:05:06.158 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** 2020-02-12T15:05:06.160 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.012440", "end": "2020-02-12 15:05:06.128150", "failed_when_result": false, "rc": 0, "start": "2020-02-12 15:05:06.115710", "stderr": "", "stderr_lines": [], "stdout": "966e9a6bfb22958c64d4123b47ddee87a2318d5a", "stdout_lines": ["966e9a6bfb22958c64d4123b47ddee87a2318d5a"]} 2020-02-12T15:05:06.195 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.053) 0:00:07.342 **** 2020-02-12T15:05:06.200 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-02-12T15:05:06.201 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.239 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.043) 0:00:07.386 **** 2020-02-12T15:05:06.244 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2020-02-12T15:05:06.245 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"perform_users_role": false}, "changed": false} 2020-02-12T15:05:06.281 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.042) 0:00:07.428 **** 2020-02-12T15:05:06.287 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.323 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.042) 0:00:07.470 **** 2020-02-12T15:05:06.328 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2020-02-12T15:05:06.329 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.365 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.041) 0:00:07.512 **** 2020-02-12T15:05:06.376 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-02-12T15:05:06.378 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.412 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.046) 0:00:07.559 **** 2020-02-12T15:05:06.418 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2020-02-12T15:05:06.419 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.457 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.044) 0:00:07.604 **** 2020-02-12T15:05:06.462 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-02-12T15:05:06.464 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.501 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.044) 0:00:07.648 **** 2020-02-12T15:05:06.507 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2020-02-12T15:05:06.509 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.547 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.045) 0:00:07.693 **** 2020-02-12T15:05:06.553 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.591 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.043) 0:00:07.737 **** 2020-02-12T15:05:06.598 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2020-02-12T15:05:06.600 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.639 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.047) 0:00:07.785 **** 2020-02-12T15:05:06.645 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2020-02-12T15:05:06.647 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.648 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.650 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.650 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.663 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.665 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Create all admin users with sudo access.] ************************ skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.704 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:06 +0000 (0:00:00.065) 0:00:07.851 **** 2020-02-12T15:05:06.709 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.710 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.712 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.713 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0 2020-02-12T15:05:06.714 INFO:teuthology.task.ansible.out:pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp 2020-02-12T15:05:06.716 INFO:teuthology.task.ansible.out:6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.726 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.727 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.738 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.739 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.750 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.750 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.752 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.778 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepi 2020-02-12T15:05:06.780 INFO:teuthology.task.ansible.out:a.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c 2020-02-12T15:05:06.781 INFO:teuthology.task.ansible.out:8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 2020-02-12T15:05:06.782 INFO:teuthology.task.ansible.out: 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.789 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.790 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.791 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.792 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.794 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.805 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.805 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.806 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.818 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.819 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.820 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.822 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c7 2020-02-12T15:05:06.823 INFO:teuthology.task.ansible.out:0f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.833 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.839 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f 2020-02-12T15:05:06.841 INFO:teuthology.task.ansible.out:88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.846 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.846 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.848 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.849 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.859 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.860 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.861 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.878 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.883 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.884 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.900 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com 2020-02-12T15:05:06.902 INFO:teuthology.task.ansible.out:] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item= 2020-02-12T15:05:06.903 INFO:teuthology.task.ansible.out:{u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.912 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.914 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.915 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.916 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.927 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.928 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.929 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.940 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.942 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.953 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.954 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.955 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.966 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.967 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.968 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.979 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.979 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.981 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.991 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.992 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:06.993 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.004 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.005 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.007 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.008 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.020 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.021 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.022 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.033 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.034 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.035 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.036 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.053 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.054 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.056 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.057 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.071 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.073 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.074 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.076 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.077 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.078 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.089 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.089 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.091 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.102 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.102 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.104 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.114 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.114 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.115 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.116 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.126 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.127 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.129 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.130 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.141 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.142 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.143 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.143 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.154 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.165 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.166 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.167 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.168 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.169 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.180 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.180 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.192 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.192 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.194 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.204 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.205 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.206 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.218 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.220 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.221 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.222 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.223 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.234 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.235 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.236 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.238 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.249 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.250 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.252 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.253 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.254 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.265 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.266 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.267 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.269 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.269 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.273 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.281 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.282 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.292 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.293 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.294 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.296 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.306 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.309 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.310 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.312 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.335 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.337 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.338 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.339 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.339 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.341 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.352 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.352 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.354 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.367 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ov 2020-02-12T15:05:07.368 INFO:teuthology.task.ansible.out:pn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.391 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.392 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.394 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat Y8asVyh6Qu+EEmWlRd1zXA d4923cf7be8e59728ea290aaec7670903b39b6444e5d303016338ddf5ab7837f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.442 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.738) 0:00:08.589 **** 2020-02-12T15:05:07.450 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.452 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.453 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.455 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f', u'name': u'toabctl'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "toabctl", "ovpn": "toabctl@minze a3I/7JakMEEANsNXCYM5XA b9715003902937328801993a359da43c61ab0be8d17f92371a48dca0821fb13f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.456 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39', u'name': u'mgfritch'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mgfritch", "ovpn": "mgfritch@laptop 94prpsaAkBwTzMmF9JR4WA 3adb8aad97b1f78c74d3ae91f21f4b165749843dacabad74f0039212c5a5db39"}, "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435', u'name': u'xiubli'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiubli", "ovpn": "xiubli@fedora1 RYbu6kdXmsBtrtAkph0lIg b4a266ab604d320ab175070a427f4ce486f65cde25c5ac248e8316e3fd2f2435"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.458 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f', u'name': u'jafaj'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jafaj", "ovpn": "jan@jfsuselaptop ddAKCkWSc1rEhQadU15jkA 90ddc588ca94ab776b539a1c5246a216dfbebabba3709ae803d386f978b65c6f"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.458 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef', u'name': u'jschmid'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jschmid", "ovpn": "jschmid@zulu BqyepNoWzZbbsslJbvCuYg 4ce9b431fdd8a06856cfe00b88665da11dde1cacd72d40bf3dbe54ff633066ef"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.459 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'ovpn': u'kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518', u'name': u'kachau'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kachau", "ovpn": "kachau@thinkpad GsZIGCdLojpvOZDxwcWSlg 0638220db65953e0cd1f134c499e4a713b32a882c8a92458afcb495dbd087518"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.477 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-02-12T15:05:07.512 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.069) 0:00:08.659 **** 2020-02-12T15:05:07.548 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.035) 0:00:08.694 **** 2020-02-12T15:05:07.553 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-02-12T15:05:07.556 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.599 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.050) 0:00:08.745 **** 2020-02-12T15:05:07.604 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2020-02-12T15:05:07.644 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.045) 0:00:08.791 **** 2020-02-12T15:05:07.650 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.692 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.048) 0:00:08.839 **** 2020-02-12T15:05:07.699 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2020-02-12T15:05:07.701 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.743 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.050) 0:00:08.890 **** 2020-02-12T15:05:07.748 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-12T15:05:07.748 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.790 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.046) 0:00:08.936 **** 2020-02-12T15:05:07.798 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2020-02-12T15:05:07.799 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.851 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.061) 0:00:08.998 **** 2020-02-12T15:05:07.856 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-12T15:05:07.857 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.895 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.043) 0:00:09.042 **** 2020-02-12T15:05:07.899 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2020-02-12T15:05:07.901 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.940 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.044) 0:00:09.086 **** 2020-02-12T15:05:07.945 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-02-12T15:05:07.946 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:07.988 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:07 +0000 (0:00:00.048) 0:00:09.135 **** 2020-02-12T15:05:07.993 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2020-02-12T15:05:07.995 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.040 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:08 +0000 (0:00:00.052) 0:00:09.187 **** 2020-02-12T15:05:08.041 INFO:teuthology.task.ansible.out: 2020-02-12T15:05:08.046 INFO:teuthology.task.ansible.out: 2020-02-12T15:05:08.047 INFO:teuthology.task.ansible.out:TASK [users : Remove revoked users] ******************************************** skipping: [smithi105.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.049 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.050 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.051 INFO:teuthology.task.ansible.out: skipping: [smithi105.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.053 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.064 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.065 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2020-02-12T15:05:08.066 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** skipping: [smithi105.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.117 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:08 +0000 (0:00:00.077) 0:00:09.264 **** 2020-02-12T15:05:08.126 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.126 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.128 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.128 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.139 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.140 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.156 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.167 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.167 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.169 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.169 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.180 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.182 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.184 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.194 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.195 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.215 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.217 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.217 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.219 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.219 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.230 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.231 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.233 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.234 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.244 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.245 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.256 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.256 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.258 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.259 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.270 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.270 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": false, "item": "jj", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.272 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": false, "item": "amarangone", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.283 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": false, "item": "oprypin", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.283 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.283 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": false, "item": "adamyanova", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.294 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.299 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": false, "item": "sbillah", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.299 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": false, "item": "onyb", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.300 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": false, "item": "jwilliamson", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": false, "item": "kmroz", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.340 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:08 +0000 (0:00:00.222) 0:00:09.487 **** 2020-02-12T15:05:08.348 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": false, "item": "shehbazj", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.349 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": false, "item": "abhishekvrshny", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.350 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": false, "item": "asheplyakov", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": false, "item": "liupan", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.352 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=adeza) => {"ansible_loop_var": "item", "changed": false, "item": "adeza", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.353 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.364 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.365 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.375 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.376 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": false, "item": "fche", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:08.416 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:08 +0000 (0:00:00.076) 0:00:09.563 **** 2020-02-12T15:05:09.072 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2020-02-12T15:05:09.073 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "5b601f2fa82999d906840a797df62d8ddf28ca4b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-02-12T15:05:09.074 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "5b601f2fa82999d906840a797df62d8ddf28ca4b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/keys-repo-sha1", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "state": "file", "uid": 0} 2020-02-12T15:05:09.111 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.695) 0:00:10.258 **** 2020-02-12T15:05:09.150 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.038) 0:00:10.297 **** 2020-02-12T15:05:09.154 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2020-02-12T15:05:09.155 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => { "msg": "Host smithi105.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-02-12T15:05:09.195 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.044) 0:00:10.342 **** 2020-02-12T15:05:09.202 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => { "msg": "Host smithi180.front.sepia.ceph.com is running CentOS 8.1 (Core)" } 2020-02-12T15:05:09.243 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.048) 0:00:10.390 **** 2020-02-12T15:05:09.250 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2020-02-12T15:05:09.251 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-02-12T15:05:09.293 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.049) 0:00:10.440 **** 2020-02-12T15:05:09.300 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml) => {"ansible_facts": {"nrpe_selinux_packages": ["python3-libsemanage", "python3-policycoreutils"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/centos_8.yml"} 2020-02-12T15:05:09.343 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.049) 0:00:10.489 **** 2020-02-12T15:05:09.347 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2020-02-12T15:05:09.349 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:09.386 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.043) 0:00:10.533 **** 2020-02-12T15:05:09.391 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:09.429 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.042) 0:00:10.575 **** 2020-02-12T15:05:09.654 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2020-02-12T15:05:09.655 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.067306", "end": "2020-02-12 15:05:09.626333", "rc": 0, "start": "2020-02-12 15:05:09.559027", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-02-12T15:05:09.696 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.267) 0:00:10.843 **** 2020-02-12T15:05:09.723 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-02-12T15:05:09.725 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.095630", "end": "2020-02-12 15:05:09.701511", "rc": 0, "start": "2020-02-12 15:05:09.605881", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2020-02-12T15:05:09.765 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.069) 0:00:10.912 **** 2020-02-12T15:05:09.802 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.036) 0:00:10.948 **** 2020-02-12T15:05:09.807 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-02-12T15:05:09.808 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:09.854 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.052) 0:00:11.001 **** 2020-02-12T15:05:09.859 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2020-02-12T15:05:09.860 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:09.899 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.045) 0:00:11.046 **** 2020-02-12T15:05:09.905 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-02-12T15:05:09.906 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:09.942 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.043) 0:00:11.089 **** 2020-02-12T15:05:09.948 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2020-02-12T15:05:09.948 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:09.990 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:09 +0000 (0:00:00.047) 0:00:11.137 **** 2020-02-12T15:05:09.994 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-02-12T15:05:09.996 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.033 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.043) 0:00:11.180 **** 2020-02-12T15:05:10.038 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2020-02-12T15:05:10.040 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.080 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.046) 0:00:11.226 **** 2020-02-12T15:05:10.084 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-02-12T15:05:10.086 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.123 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.043) 0:00:11.270 **** 2020-02-12T15:05:10.131 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2020-02-12T15:05:10.132 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.170 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.047) 0:00:11.317 **** 2020-02-12T15:05:10.176 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-02-12T15:05:10.177 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.216 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.045) 0:00:11.363 **** 2020-02-12T15:05:10.220 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2020-02-12T15:05:10.222 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.259 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.042) 0:00:11.406 **** 2020-02-12T15:05:10.263 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-02-12T15:05:10.263 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.264 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.301 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.042) 0:00:11.448 **** 2020-02-12T15:05:10.305 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2020-02-12T15:05:10.307 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.343 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.042) 0:00:11.490 **** 2020-02-12T15:05:10.348 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-02-12T15:05:10.350 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.390 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.046) 0:00:11.536 **** 2020-02-12T15:05:10.395 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2020-02-12T15:05:10.395 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.396 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.434 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.044) 0:00:11.581 **** 2020-02-12T15:05:10.439 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-02-12T15:05:10.440 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.481 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.047) 0:00:11.628 **** 2020-02-12T15:05:10.488 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2020-02-12T15:05:10.488 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.529 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.047) 0:00:11.676 **** 2020-02-12T15:05:10.534 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-02-12T15:05:10.535 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.575 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.045) 0:00:11.722 **** 2020-02-12T15:05:10.580 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2020-02-12T15:05:10.581 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.619 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.043) 0:00:11.765 **** 2020-02-12T15:05:10.623 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2020-02-12T15:05:10.624 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.661 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.042) 0:00:11.808 **** 2020-02-12T15:05:10.673 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2020-02-12T15:05:10.674 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.712 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.050) 0:00:11.859 **** 2020-02-12T15:05:10.717 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2020-02-12T15:05:10.717 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.757 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.045) 0:00:11.904 **** 2020-02-12T15:05:10.767 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.804 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.046) 0:00:11.951 **** 2020-02-12T15:05:10.809 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-02-12T15:05:10.810 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.848 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.043) 0:00:11.994 **** 2020-02-12T15:05:10.854 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:10.891 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.043) 0:00:12.038 **** 2020-02-12T15:05:10.896 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-02-12T15:05:10.897 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.935 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.043) 0:00:12.082 **** 2020-02-12T15:05:10.941 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2020-02-12T15:05:10.942 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:10.981 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:10 +0000 (0:00:00.045) 0:00:12.128 **** 2020-02-12T15:05:10.988 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-02-12T15:05:10.989 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.026 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.045) 0:00:12.173 **** 2020-02-12T15:05:11.032 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2020-02-12T15:05:11.033 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.072 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.045) 0:00:12.219 **** 2020-02-12T15:05:11.077 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-02-12T15:05:11.078 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.118 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.045) 0:00:12.264 **** 2020-02-12T15:05:11.123 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2020-02-12T15:05:11.125 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.162 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.044) 0:00:12.309 **** 2020-02-12T15:05:11.167 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-02-12T15:05:11.167 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:11.207 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.045) 0:00:12.354 **** 2020-02-12T15:05:11.212 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2020-02-12T15:05:11.214 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.250 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.042) 0:00:12.397 **** 2020-02-12T15:05:11.254 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-12T15:05:11.256 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.297 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.046) 0:00:12.443 **** 2020-02-12T15:05:11.302 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2020-02-12T15:05:11.304 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:11.340 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.043) 0:00:12.487 **** 2020-02-12T15:05:11.345 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-02-12T15:05:11.347 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.388 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.047) 0:00:12.535 **** 2020-02-12T15:05:11.396 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-12T15:05:11.398 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.440 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.052) 0:00:12.587 **** 2020-02-12T15:05:11.445 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-02-12T15:05:11.446 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.485 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.044) 0:00:12.632 **** 2020-02-12T15:05:11.489 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* 2020-02-12T15:05:11.491 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.533 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.048) 0:00:12.680 **** 2020-02-12T15:05:11.538 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-02-12T15:05:11.540 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.578 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.044) 0:00:12.724 **** 2020-02-12T15:05:11.582 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2020-02-12T15:05:11.583 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.629 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.050) 0:00:12.775 **** 2020-02-12T15:05:11.634 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2020-02-12T15:05:11.635 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.675 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.045) 0:00:12.821 **** 2020-02-12T15:05:11.679 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2020-02-12T15:05:11.681 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.718 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.043) 0:00:12.865 **** 2020-02-12T15:05:11.724 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-02-12T15:05:11.726 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.761 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.042) 0:00:12.907 **** 2020-02-12T15:05:11.767 INFO:teuthology.task.ansible.out: 2020-02-12T15:05:11.768 INFO:teuthology.task.ansible.out:TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.806 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.045) 0:00:12.953 **** 2020-02-12T15:05:11.812 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-02-12T15:05:11.812 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:11.850 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.043) 0:00:12.997 **** 2020-02-12T15:05:11.856 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2020-02-12T15:05:11.857 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:11.893 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.042) 0:00:13.040 **** 2020-02-12T15:05:11.898 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-02-12T15:05:11.942 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.048) 0:00:13.088 **** 2020-02-12T15:05:11.947 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2020-02-12T15:05:11.955 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2020-02-12T15:05:11.997 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:11 +0000 (0:00:00.054) 0:00:13.143 **** 2020-02-12T15:05:12.012 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:12.040 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:12 +0000 (0:00:00.043) 0:00:13.187 **** 2020-02-12T15:05:12.045 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2020-02-12T15:05:12.085 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:12 +0000 (0:00:00.044) 0:00:13.232 **** 2020-02-12T15:05:12.121 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2020-02-12T15:05:12.122 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:12.159 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:12 +0000 (0:00:00.073) 0:00:13.305 **** 2020-02-12T15:05:12.248 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2020-02-12T15:05:12.248 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:05:12.288 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:12 +0000 (0:00:00.129) 0:00:13.435 **** 2020-02-12T15:05:12.389 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:05:12.427 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:12 +0000 (0:00:00.138) 0:00:13.574 **** 2020-02-12T15:05:12.798 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2020-02-12T15:05:12.799 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2da7f101e29cfe8f3b630dbd6da82b4f9a749fee", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 304, "state": "file", "uid": 0} 2020-02-12T15:05:12.926 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "2da7f101e29cfe8f3b630dbd6da82b4f9a749fee", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/8/Everything/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 304, "state": "file", "uid": 0} 2020-02-12T15:05:13.242 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "ddfaa38799b2dd4c23933a375aa4c3ff61bf7625", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 338, "state": "file", "uid": 0} 2020-02-12T15:05:13.296 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:13 +0000 (0:00:00.869) 0:00:14.443 **** 2020-02-12T15:05:13.376 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "ddfaa38799b2dd4c23933a375aa4c3ff61bf7625", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/8/Everything/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 338, "state": "file", "uid": 0} 2020-02-12T15:05:13.415 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:13 +0000 (0:00:00.118) 0:00:14.562 **** 2020-02-12T15:05:13.793 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-12T15:05:13.794 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-02-12T15:05:13.910 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "3c9ba7bacd1e30bed014cefd1fb4eab0f0f8fa10", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 484, "state": "file", "uid": 0} 2020-02-12T15:05:14.275 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-02-12T15:05:14.323 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.907) 0:00:15.469 **** 2020-02-12T15:05:14.351 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-12T15:05:14.352 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.391 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.068) 0:00:15.538 **** 2020-02-12T15:05:14.398 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* 2020-02-12T15:05:14.399 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": false, "checksum": "d542c3e2c30a0d3eb7d454775342c302c0ded15b", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing-mirrorlist", "secontext": "system_u:object_r:system_conf_t:s0", "size": 540, "state": "file", "uid": 0} 2020-02-12T15:05:14.444 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.052) 0:00:15.590 **** 2020-02-12T15:05:14.449 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T15:05:14.451 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.493 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.049) 0:00:15.640 **** 2020-02-12T15:05:14.499 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2020-02-12T15:05:14.501 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.540 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.046) 0:00:15.687 **** 2020-02-12T15:05:14.545 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-02-12T15:05:14.545 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.598 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.057) 0:00:15.744 **** 2020-02-12T15:05:14.605 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T15:05:14.606 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.645 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.047) 0:00:15.792 **** 2020-02-12T15:05:14.650 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-02-12T15:05:14.652 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.700 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.054) 0:00:15.847 **** 2020-02-12T15:05:14.708 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2020-02-12T15:05:14.709 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.746 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.045) 0:00:15.892 **** 2020-02-12T15:05:14.750 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T15:05:14.752 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.812 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.066) 0:00:15.959 **** 2020-02-12T15:05:14.819 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2020-02-12T15:05:14.820 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.858 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.045) 0:00:16.005 **** 2020-02-12T15:05:14.862 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-02-12T15:05:14.864 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.902 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.043) 0:00:16.048 **** 2020-02-12T15:05:14.909 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2020-02-12T15:05:14.910 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.947 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.045) 0:00:16.094 **** 2020-02-12T15:05:14.952 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-02-12T15:05:14.952 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:14.991 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:14 +0000 (0:00:00.043) 0:00:16.138 **** 2020-02-12T15:05:14.996 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2020-02-12T15:05:14.997 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:15.035 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.043) 0:00:16.181 **** 2020-02-12T15:05:15.039 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-02-12T15:05:15.041 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:15.080 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.045) 0:00:16.227 **** 2020-02-12T15:05:15.085 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2020-02-12T15:05:15.085 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:15.123 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.042) 0:00:16.269 **** 2020-02-12T15:05:15.129 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-02-12T15:05:15.131 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:15.166 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.043) 0:00:16.313 **** 2020-02-12T15:05:15.171 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2020-02-12T15:05:15.173 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:15.209 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.042) 0:00:16.356 **** 2020-02-12T15:05:15.245 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2020-02-12T15:05:15.247 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:15.291 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.082) 0:00:16.438 **** 2020-02-12T15:05:15.525 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2020-02-12T15:05:15.527 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.162745", "end": "2020-02-12 15:05:15.500353", "rc": 0, "start": "2020-02-12 15:05:15.337608", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:05:15.528 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.035958", "end": "2020-02-12 15:05:15.500404", "rc": 0, "start": "2020-02-12 15:05:15.464446", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:05:15.565 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.273) 0:00:16.712 **** 2020-02-12T15:05:15.599 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:15 +0000 (0:00:00.034) 0:00:16.746 **** 2020-02-12T15:05:16.752 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-02-12T15:05:16.754 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-02-12T15:05:16.790 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:16 +0000 (0:00:01.191) 0:00:17.937 **** 2020-02-12T15:05:16.816 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-02-12T15:05:16.818 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:16.853 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:16 +0000 (0:00:00.063) 0:00:18.000 **** 2020-02-12T15:05:16.879 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-02-12T15:05:16.880 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:16.920 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:16 +0000 (0:00:00.067) 0:00:18.067 **** 2020-02-12T15:05:16.946 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-02-12T15:05:16.948 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:16.984 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:16 +0000 (0:00:00.063) 0:00:18.131 **** 2020-02-12T15:05:17.010 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-02-12T15:05:17.012 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:17.047 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:17 +0000 (0:00:00.063) 0:00:18.194 **** 2020-02-12T15:05:17.500 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-02-12T15:05:17.501 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-02-12T15:05:17.538 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:17 +0000 (0:00:00.490) 0:00:18.685 **** 2020-02-12T15:05:18.422 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-02-12T15:05:18.424 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-02-12T15:05:18.470 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:18 +0000 (0:00:00.931) 0:00:19.617 **** 2020-02-12T15:05:18.870 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2020-02-12T15:05:18.870 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: krb5-workstation"]} 2020-02-12T15:05:18.906 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:18 +0000 (0:00:00.436) 0:00:20.053 **** 2020-02-12T15:05:18.935 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2020-02-12T15:05:18.936 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:18.977 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:18 +0000 (0:00:00.070) 0:00:20.124 **** 2020-02-12T15:05:18.982 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T15:05:18.982 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-02-12T15:05:19.005 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2020-02-12T15:05:19.006 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:19.042 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:19 +0000 (0:00:00.064) 0:00:20.188 **** 2020-02-12T15:05:19.066 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2020-02-12T15:05:19.068 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:19.104 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:19 +0000 (0:00:00.061) 0:00:20.250 **** 2020-02-12T15:05:19.129 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2020-02-12T15:05:19.130 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:19.166 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:19 +0000 (0:00:00.062) 0:00:20.313 **** 2020-02-12T15:05:19.432 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T15:05:19.432 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-02-12T15:05:19.627 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2020-02-12T15:05:19.628 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2020-02-12T15:05:19.665 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:19 +0000 (0:00:00.499) 0:00:20.812 **** 2020-02-12T15:05:19.863 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T15:05:19.864 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-02-12T15:05:19.903 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:19 +0000 (0:00:00.238) 0:00:21.050 **** 2020-02-12T15:05:20.096 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-02-12T15:05:20.097 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T15:05:20.133 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:20 +0000 (0:00:00.230) 0:00:21.280 **** 2020-02-12T15:05:20.560 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2020-02-12T15:05:20.562 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: smartmontools"]} 2020-02-12T15:05:20.599 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:20 +0000 (0:00:00.465) 0:00:21.746 **** 2020-02-12T15:05:20.604 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T15:05:20.605 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-02-12T15:05:21.026 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-02-12T15:05:21.089 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T15:05:21.091 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2020-02-12T15:05:21.457 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T15:05:21.458 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-02-12T15:05:21.497 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:21 +0000 (0:00:00.897) 0:00:22.644 **** 2020-02-12T15:05:21.524 INFO:teuthology.task.ansible.out: 2020-02-12T15:05:21.525 INFO:teuthology.task.ansible.out:TASK [common : Include apt_system vars] **************************************** 2020-02-12T15:05:21.526 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:21.562 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:21 +0000 (0:00:00.065) 0:00:22.709 **** 2020-02-12T15:05:21.568 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T15:05:21.569 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2020-02-12T15:05:21.601 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-02-12T15:05:21.603 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-02-12T15:05:21.638 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:21 +0000 (0:00:00.075) 0:00:22.785 **** 2020-02-12T15:05:21.832 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2020-02-12T15:05:21.833 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-12T15:05:21.870 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:21 +0000 (0:00:00.231) 0:00:23.017 **** 2020-02-12T15:05:21.907 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-02-12T15:05:21.908 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:21.919 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:21.930 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:21.940 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:21.980 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:21 +0000 (0:00:00.109) 0:00:23.126 **** 2020-02-12T15:05:21.987 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2020-02-12T15:05:21.987 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2020-02-12T15:05:22.032 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:22 +0000 (0:00:00.052) 0:00:23.179 **** 2020-02-12T15:05:22.226 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2020-02-12T15:05:22.228 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T15:05:22.274 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:22 +0000 (0:00:00.241) 0:00:23.420 **** 2020-02-12T15:05:22.749 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T15:05:22.750 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2020-02-12T15:05:22.896 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-02-12T15:05:22.897 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-02-12T15:05:22.934 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:22 +0000 (0:00:00.660) 0:00:24.081 **** 2020-02-12T15:05:22.971 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-02-12T15:05:22.972 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:23.011 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:23 +0000 (0:00:00.076) 0:00:24.157 **** 2020-02-12T15:05:23.163 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T15:05:23.163 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2020-02-12T15:05:23.489 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2020-02-12T15:05:23.489 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-02-12T15:05:23.528 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:23 +0000 (0:00:00.517) 0:00:24.675 **** 2020-02-12T15:05:23.603 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2020-02-12T15:05:23.604 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2020-02-12T15:05:23.658 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:23 +0000 (0:00:00.129) 0:00:24.805 **** 2020-02-12T15:05:23.695 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2020-02-12T15:05:23.697 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:23.750 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:23 +0000 (0:00:00.092) 0:00:24.897 **** 2020-02-12T15:05:23.789 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2020-02-12T15:05:23.790 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2020-02-12T15:05:23.833 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:23 +0000 (0:00:00.082) 0:00:24.980 **** 2020-02-12T15:05:23.987 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-02-12T15:05:23.989 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-02-12T15:05:24.040 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:24 +0000 (0:00:00.206) 0:00:25.186 **** 2020-02-12T15:05:24.050 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi180.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2020-02-12T15:05:24.095 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:24 +0000 (0:00:00.054) 0:00:25.241 **** 2020-02-12T15:05:24.102 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-02-12T15:05:24.104 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:24.148 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:24 +0000 (0:00:00.053) 0:00:25.295 **** 2020-02-12T15:05:24.155 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2020-02-12T15:05:24.156 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:24.157 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:24.168 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2020-02-12T15:05:24.219 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:24 +0000 (0:00:00.070) 0:00:25.365 **** 2020-02-12T15:05:24.363 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-02-12T15:05:24.363 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:05:24.400 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:24 +0000 (0:00:00.181) 0:00:25.547 **** 2020-02-12T15:05:24.648 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-02-12T15:05:24.650 INFO:teuthology.task.ansible.out:fatal: [smithi105.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-02-12T15:05:24.689 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:24 +0000 (0:00:00.288) 0:00:25.835 **** 2020-02-12T15:05:24.717 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-02-12T15:05:24.719 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:24.754 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:24 +0000 (0:00:00.065) 0:00:25.901 **** 2020-02-12T15:05:25.128 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2020-02-12T15:05:25.130 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: nagios-common", "Installed: nrpe", "Installed: nagios-plugins", "Installed: nagios-plugins-load"]} 2020-02-12T15:05:25.173 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:25 +0000 (0:00:00.418) 0:00:26.320 **** 2020-02-12T15:05:25.198 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2020-02-12T15:05:25.200 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:25.236 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:25 +0000 (0:00:00.063) 0:00:26.383 **** 2020-02-12T15:05:25.241 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-02-12T15:05:25.242 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-02-12T15:05:25.281 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:25 +0000 (0:00:00.045) 0:00:26.428 **** 2020-02-12T15:05:25.722 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2020-02-12T15:05:25.768 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:25 +0000 (0:00:00.487) 0:00:26.915 **** 2020-02-12T15:05:26.063 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-02-12T15:05:26.065 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 15:01:38 UTC", "ActiveEnterTimestampMonotonic": "14137130", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "local-fs.target systemd-journald.socket systemd-tmpfiles-setup.service time-sync.target tmp.mount network.target var-run.mount basic.target nss-lookup.target system.slice sysinit.target -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 15:01:38 UTC", "AssertTimestampMonotonic": "14136326", "Before": "plymouth-quit.service multi-user.target shutdown.target getty@tty1.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 15:01:38 UTC", "ConditionTimestampMonotonic": "14136326", "ConfigurationDirectoryMode": "0755", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-02-12T15:05:26.072 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2418", "ExecMainStartTimestamp": "Wed 2020-02-12 15:01:38 UTC", "ExecMainStartTimestampMonotonic": "14137093", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Wed 2020-02-12 15:01:38 UTC] ; stop_time=[n/a] ; pid=2418 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 15:01:38 UTC", "InactiveExitTimestampMonotonic": "14137130", "InvocationID": "b20377717e9c43c8a2a7e3324a6eab19", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-02-12T15:05:26.073 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2418", "MemoryAccounting": "yes", "MemoryCurrent": "1073152", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice -.mount", "RequiresMountsFor": "/run/nrpe /var/tmp", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "n 2020-02-12T15:05:26.075 INFO:teuthology.task.ansible.out:rpe", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 15:01:38 UTC", "StateChangeTimestampMonotonic": "14137130", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 15:01:38 UTC", "WatchdogTimestampMonotonic": "14137129", "WatchdogUSec": "0"}} 2020-02-12T15:05:26.102 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:26 +0000 (0:00:00.333) 0:00:27.249 **** 2020-02-12T15:05:26.253 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2020-02-12T15:05:26.254 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2020-02-12T15:05:26.293 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:26 +0000 (0:00:00.190) 0:00:27.440 **** 2020-02-12T15:05:26.297 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-02-12T15:05:26.300 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001726", "end": "2020-02-12 15:05:26.271415", "rc": 0, "start": "2020-02-12 15:05:26.269689", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-02-12T15:05:26.354 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:26 +0000 (0:00:00.061) 0:00:27.501 **** 2020-02-12T15:05:26.361 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2020-02-12T15:05:26.361 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:26.407 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:26 +0000 (0:00:00.052) 0:00:27.554 **** 2020-02-12T15:05:26.611 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2020-02-12T15:05:26.613 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:05:26.652 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:26 +0000 (0:00:00.245) 0:00:27.799 **** 2020-02-12T15:05:26.899 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2020-02-12T15:05:26.901 INFO:teuthology.task.ansible.out:fatal: [smithi180.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2020-02-12T15:05:26.952 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:26 +0000 (0:00:00.299) 0:00:28.099 **** 2020-02-12T15:05:26.977 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2020-02-12T15:05:26.979 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:05:27.023 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:27 +0000 (0:00:00.070) 0:00:28.170 **** 2020-02-12T15:05:27.240 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-02-12T15:05:27.240 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-02-12T15:05:27.293 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:27 +0000 (0:00:00.270) 0:00:28.440 **** 2020-02-12T15:05:27.509 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2020-02-12T15:05:27.510 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2020-02-12T15:05:27.549 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:27 +0000 (0:00:00.255) 0:00:28.696 **** 2020-02-12T15:05:27.857 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2020-02-12T15:05:27.859 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 15:04:18 UTC", "ActiveEnterTimestampMonotonic": "12373607", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "tmp.mount var-run.mount time-sync.target system.slice basic.target network.target systemd-tmpfiles-setup.service sysinit.target nss-lookup.target local-fs.target systemd-journald.socket -.mount", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 15:04:18 UTC", "AssertTimestampMonotonic": "12372617", "Before": "getty@tty1.service multi-user.target shutdown.target plymouth-quit.service xdm.service", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 15:04:18 UTC", "ConditionTimestampMonotonic": "12372617", "ConfigurationDirectoryMode": "0755", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "D 2020-02-12T15:05:27.861 INFO:teuthology.task.ansible.out:efaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Plugin Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "DynamicUser": "no", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1615", "ExecMainStartTimestamp": "Wed 2020-02-12 15:04:18 UTC", "ExecMainStartTimestampMonotonic": "12373578", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f ; ignore_errors=no ; start_time=[Wed 2020-02-12 15:04:18 UTC] ; stop_time=[n/a] ; pid=1615 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "GID": "986", "Group": "nrpe", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 15:04:18 UTC", "InactiveExitTimestampMonotonic": "12373607", "InvocationID": "a44065761c644af18c2448f21e03c945", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "Limi 2020-02-12T15:05:27.862 INFO:teuthology.task.ansible.out:tDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "62925", "LimitNPROCSoft": "62925", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62925", "LimitSIGPENDINGSoft": "62925", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1615", "MemoryAccounting": "yes", "MemoryCurrent": "1298432", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "-500", "OnFailureJobMode": "replace", "PIDFile": "/var/run/nrpe/nrpe.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp /run/nrpe", "Restart": "on-abort", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectory": "nrpe" 2020-02-12T15:05:27.863 INFO:teuthology.task.ansible.out:, "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 15:04:18 UTC", "StateChangeTimestampMonotonic": "12373607", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UID": "990", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 15:04:18 UTC", "WatchdogTimestampMonotonic": "12373606", "WatchdogUSec": "0"}} 2020-02-12T15:05:27.898 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:27 +0000 (0:00:00.349) 0:00:29.045 **** 2020-02-12T15:05:28.091 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2020-02-12T15:05:28.093 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.001697", "end": "2020-02-12 15:05:28.069103", "rc": 0, "start": "2020-02-12 15:05:28.067406", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2020-02-12T15:05:28.127 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:28 +0000 (0:00:00.229) 0:00:29.274 **** 2020-02-12T15:05:28.197 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2020-02-12T15:05:28.198 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-02-12T15:05:28.237 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:28 +0000 (0:00:00.109) 0:00:29.384 **** 2020-02-12T15:05:29.031 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2020-02-12T15:05:29.033 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: python3-libsemanage", "Installed: python3-policycoreutils"]} 2020-02-12T15:05:29.068 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:29 +0000 (0:00:00.830) 0:00:30.215 **** 2020-02-12T15:05:29.629 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-02-12T15:05:29.631 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-02-12T15:05:29.672 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:29 +0000 (0:00:00.604) 0:00:30.819 **** 2020-02-12T15:05:30.017 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: selinux-policy-targeted"]} 2020-02-12T15:05:30.055 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:30 +0000 (0:00:00.382) 0:00:31.201 **** 2020-02-12T15:05:31.161 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2020-02-12T15:05:31.163 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2020-02-12T15:05:31.199 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:31 +0000 (0:00:01.144) 0:00:32.346 **** 2020-02-12T15:05:46.100 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.223661", "end": "2020-02-12 15:05:46.071326", "failed_when_result": false, "rc": 0, "start": "2020-02-12 15:05:29.847665", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-02-12T15:05:46.137 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:46 +0000 (0:00:14.937) 0:00:47.284 **** 2020-02-12T15:05:46.598 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-02-12T15:05:46.599 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-02-12T15:05:46.636 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:46 +0000 (0:00:00.498) 0:00:47.783 **** 2020-02-12T15:05:46.849 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-02-12T15:05:46.850 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.018011", "end": "2020-02-12 15:05:46.820931", "rc": 0, "start": "2020-02-12 15:05:46.802920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:05:46.887 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:46 +0000 (0:00:00.250) 0:00:48.033 **** 2020-02-12T15:05:47.078 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-02-12T15:05:47.079 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002186", "end": "2020-02-12 15:05:47.055897", "rc": 0, "start": "2020-02-12 15:05:47.053711", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:05:47.115 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:47 +0000 (0:00:00.228) 0:00:48.262 **** 2020-02-12T15:05:47.817 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2020-02-12T15:05:47.818 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:16.421861", "end": "2020-02-12 15:05:47.789959", "failed_when_result": false, "rc": 0, "start": "2020-02-12 15:05:31.368098", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2020-02-12T15:05:47.855 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:47 +0000 (0:00:00.739) 0:00:49.002 **** 2020-02-12T15:05:48.324 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2020-02-12T15:05:48.325 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2020-02-12T15:05:48.361 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:48 +0000 (0:00:00.505) 0:00:49.507 **** 2020-02-12T15:05:48.574 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2020-02-12T15:05:48.576 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.013050", "end": "2020-02-12 15:05:48.556479", "rc": 0, "start": "2020-02-12 15:05:48.543429", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:05:48.624 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:48 +0000 (0:00:00.252) 0:00:49.760 **** 2020-02-12T15:05:48.815 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2020-02-12T15:05:48.817 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.002190", "end": "2020-02-12 15:05:48.793349", "rc": 0, "start": "2020-02-12 15:05:48.791159", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:05:48.854 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:05:48 +0000 (0:00:00.240) 0:00:50.000 **** 2020-02-12T15:06:03.208 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:15.903547", "end": "2020-02-12 15:06:03.185748", "rc": 0, "start": "2020-02-12 15:05:47.282201", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:03.254 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:03 +0000 (0:00:14.393) 0:01:04.394 **** 2020-02-12T15:06:03.463 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-02-12T15:06:03.465 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-02-12T15:06:03.510 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:03 +0000 (0:00:00.263) 0:01:04.657 **** 2020-02-12T15:06:03.547 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-02-12T15:06:03.548 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-02-12T15:06:03.599 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:03 +0000 (0:00:00.088) 0:01:04.745 **** 2020-02-12T15:06:03.647 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-02-12T15:06:03.649 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T15:06:03.687 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:03 +0000 (0:00:00.088) 0:01:04.834 **** 2020-02-12T15:06:03.734 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-02-12T15:06:03.736 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-02-12T15:06:03.780 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:03 +0000 (0:00:00.092) 0:01:04.927 **** 2020-02-12T15:06:03.828 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-02-12T15:06:03.828 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T15:06:03.871 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:03 +0000 (0:00:00.090) 0:01:05.017 **** 2020-02-12T15:06:04.064 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-02-12T15:06:04.066 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T15:06:04.104 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:04 +0000 (0:00:00.234) 0:01:05.251 **** 2020-02-12T15:06:04.308 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-02-12T15:06:04.309 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2020-02-12T15:06:04.352 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:04 +0000 (0:00:00.247) 0:01:05.499 **** 2020-02-12T15:06:04.384 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-02-12T15:06:04.385 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:04.423 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:04 +0000 (0:00:00.070) 0:01:05.569 **** 2020-02-12T15:06:04.450 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-02-12T15:06:04.452 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:04.498 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:04 +0000 (0:00:00.074) 0:01:05.644 **** 2020-02-12T15:06:04.714 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-02-12T15:06:04.714 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-02-12T15:06:04.753 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:04 +0000 (0:00:00.255) 0:01:05.900 **** 2020-02-12T15:06:05.278 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2020-02-12T15:06:05.279 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:16.224686", "end": "2020-02-12 15:06:05.245876", "rc": 0, "start": "2020-02-12 15:05:49.021190", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:05.325 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.571) 0:01:06.472 **** 2020-02-12T15:06:05.330 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-02-12T15:06:05.331 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-02-12T15:06:05.374 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.049) 0:01:06.521 **** 2020-02-12T15:06:05.411 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-02-12T15:06:05.412 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi105"}, "changed": false} 2020-02-12T15:06:05.449 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.075) 0:01:06.596 **** 2020-02-12T15:06:05.451 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:05.524 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2020-02-12T15:06:05.526 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2020-02-12T15:06:05.563 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.113) 0:01:06.710 **** 2020-02-12T15:06:05.590 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2020-02-12T15:06:05.591 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/dnf_systems.yml"], "changed": false} 2020-02-12T15:06:05.653 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.090) 0:01:06.800 **** 2020-02-12T15:06:05.692 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2020-02-12T15:06:05.694 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T15:06:05.735 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.081) 0:01:06.882 **** 2020-02-12T15:06:05.782 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2020-02-12T15:06:05.783 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml) => {"ansible_facts": {"common_yum_repos": {"lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "copr_repos": ["ktdreyer/ceph-el8"], "epel_packages": [], "nfs_service": "nfs-server", "ntp_service_name": "chronyd", "packages": ["@core", "@base", "dnf-utils", "sysstat", "libedit", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse-libs", "openssl", "libuuid", "podman", "podman-docker", "attr", "ant", "lsof", "gettext", "bc", "xfsdump", "blktrace", "usbredir", "libev-devel", "valgrind", "nfs-utils", "ncurses-devel", "gcc", "git", "python3-nose", "python3-virtualenv", "genisoimage", "qemu-img", "qemu-kvm-core", "qemu-kvm-block-rbd", "libacl-devel", "dbench", "autoconf", "gdb"]}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_8.yml"} 2020-02-12T15:06:05.824 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.088) 0:01:06.970 **** 2020-02-12T15:06:05.860 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ 2020-02-12T15:06:05.862 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2020-02-12T15:06:05.900 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:05 +0000 (0:00:00.076) 0:01:07.047 **** 2020-02-12T15:06:06.101 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2020-02-12T15:06:06.103 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2020-02-12T15:06:06.141 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:06 +0000 (0:00:00.241) 0:01:07.288 **** 2020-02-12T15:06:06.346 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2020-02-12T15:06:06.346 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "name": "ubuntu", "state": "present", "system": false} 2020-02-12T15:06:06.387 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:06 +0000 (0:00:00.245) 0:01:07.534 **** 2020-02-12T15:06:06.413 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2020-02-12T15:06:06.414 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:06.451 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:06 +0000 (0:00:00.064) 0:01:07.598 **** 2020-02-12T15:06:06.456 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-02-12T15:06:06.456 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "", "ansible_fqdn": "smithi105", "ansible_hostname": "smithi105", "ansible_nodename": "smithi105"}, "changed": false, "name": "smithi105"} 2020-02-12T15:06:06.498 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:06 +0000 (0:00:00.046) 0:01:07.644 **** 2020-02-12T15:06:06.503 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2020-02-12T15:06:06.505 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:06.543 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:06 +0000 (0:00:00.045) 0:01:07.690 **** 2020-02-12T15:06:06.755 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** 2020-02-12T15:06:06.757 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2020-02-12T15:06:06.793 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:06 +0000 (0:00:00.250) 0:01:07.940 **** 2020-02-12T15:06:06.957 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-02-12T15:06:06.958 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-02-12T15:06:06.998 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:06 +0000 (0:00:00.203) 0:01:08.144 **** 2020-02-12T15:06:07.457 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2020-02-12T15:06:07.458 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2020-02-12T15:06:07.496 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:07 +0000 (0:00:00.498) 0:01:08.642 **** 2020-02-12T15:06:07.501 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-02-12T15:06:07.501 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-02-12T15:06:07.552 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:07 +0000 (0:00:00.055) 0:01:08.698 **** 2020-02-12T15:06:07.558 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2020-02-12T15:06:07.558 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi180"}, "changed": false} 2020-02-12T15:06:07.603 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:07 +0000 (0:00:00.051) 0:01:08.750 **** 2020-02-12T15:06:08.143 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** ok: [smithi105.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-02-12T15:06:08.179 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:08 +0000 (0:00:00.576) 0:01:09.326 **** 2020-02-12T15:06:08.186 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2020-02-12T15:06:08.186 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi180.front.sepia.ceph.com", "ansible_hostname": "smithi180", "ansible_nodename": "smithi180"}, "changed": true, "name": "smithi180"} 2020-02-12T15:06:08.224 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:08 +0000 (0:00:00.045) 0:01:09.371 **** 2020-02-12T15:06:08.649 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2020-02-12T15:06:08.651 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-02-12T15:06:08.693 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:08 +0000 (0:00:00.468) 0:01:09.839 **** 2020-02-12T15:06:08.698 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2020-02-12T15:06:08.698 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "a5e550b2aa74f6355e926d70d73a50ad9ab4b4be", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1043, "state": "file", "uid": 0} 2020-02-12T15:06:08.738 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:08 +0000 (0:00:00.045) 0:01:09.885 **** 2020-02-12T15:06:08.899 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-12T15:06:08.900 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T15:06:08.938 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:08 +0000 (0:00:00.199) 0:01:10.085 **** 2020-02-12T15:06:09.142 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-02-12T15:06:09.178 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:09 +0000 (0:00:00.240) 0:01:10.325 **** 2020-02-12T15:06:09.205 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2020-02-12T15:06:09.205 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2020-02-12T15:06:09.245 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:09 +0000 (0:00:00.066) 0:01:10.391 **** 2020-02-12T15:06:09.397 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-12T15:06:09.397 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-02-12T15:06:09.437 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:09 +0000 (0:00:00.191) 0:01:10.583 **** 2020-02-12T15:06:09.872 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2020-02-12T15:06:09.874 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"attempts": 1, "changed": false, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2020-02-12T15:06:09.916 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:09 +0000 (0:00:00.479) 0:01:11.062 **** 2020-02-12T15:06:09.922 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-12T15:06:09.923 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-02-12T15:06:09.961 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:09 +0000 (0:00:00.045) 0:01:11.108 **** 2020-02-12T15:06:10.384 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:10.385 INFO:teuthology.task.ansible.out:TASK [testnode : Create remote.conf] ******************************************* ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2020-02-12T15:06:10.426 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:10 +0000 (0:00:00.465) 0:01:11.573 **** 2020-02-12T15:06:10.442 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-12T15:06:10.443 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-02-12T15:06:10.484 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:10 +0000 (0:00:00.057) 0:01:11.630 **** 2020-02-12T15:06:10.640 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-12T15:06:10.641 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T15:06:10.688 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:10 +0000 (0:00:00.204) 0:01:11.835 **** 2020-02-12T15:06:10.894 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-12T15:06:10.895 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 36, "name": "kvm", "state": "present", "system": false} 2020-02-12T15:06:10.935 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:10 +0000 (0:00:00.246) 0:01:12.082 **** 2020-02-12T15:06:11.153 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi180.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1209, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2020-02-12T15:06:11.186 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:11 +0000 (0:00:00.251) 0:01:12.333 **** 2020-02-12T15:06:11.660 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2020-02-12T15:06:11.697 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:11 +0000 (0:00:00.510) 0:01:12.844 **** 2020-02-12T15:06:12.185 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2020-02-12T15:06:12.221 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:12 +0000 (0:00:00.523) 0:01:13.368 **** 2020-02-12T15:06:12.329 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.627181", "end": "2020-02-12 15:06:12.283951", "rc": 0, "start": "2020-02-12 15:06:10.656770", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:12.362 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:12 +0000 (0:00:00.141) 0:01:13.509 **** 2020-02-12T15:06:12.862 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-02-12T15:06:12.863 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-02-12T15:06:12.901 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:12 +0000 (0:00:00.538) 0:01:14.048 **** 2020-02-12T15:06:12.927 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-02-12T15:06:12.965 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:12 +0000 (0:00:00.063) 0:01:14.111 **** 2020-02-12T15:06:13.661 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-02-12T15:06:13.662 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.474928", "end": "2020-02-12 15:06:13.633920", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-02-12 15:06:13.158992", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-02-12T15:06:13.668 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2020-02-12T15:06:13.707 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:13 +0000 (0:00:00.742) 0:01:14.854 **** 2020-02-12T15:06:13.733 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-02-12T15:06:13.734 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:13.775 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:13 +0000 (0:00:00.068) 0:01:14.922 **** 2020-02-12T15:06:13.820 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:13.862 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:13 +0000 (0:00:00.086) 0:01:15.009 **** 2020-02-12T15:06:13.889 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2020-02-12T15:06:13.890 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:13.930 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:13 +0000 (0:00:00.067) 0:01:15.077 **** 2020-02-12T15:06:13.967 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:13.968 INFO:teuthology.task.ansible.out:TASK [testnode : set_fact] ***************************************************** ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-02-12T15:06:14.004 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:14 +0000 (0:00:00.073) 0:01:15.150 **** 2020-02-12T15:06:14.040 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-02-12T15:06:14.042 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:14.081 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:14 +0000 (0:00:00.077) 0:01:15.228 **** 2020-02-12T15:06:14.107 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-02-12T15:06:14.109 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:14.146 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:14 +0000 (0:00:00.065) 0:01:15.293 **** 2020-02-12T15:06:14.244 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-12T15:06:14.246 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:01.831021", "end": "2020-02-12 15:06:14.222515", "rc": 0, "start": "2020-02-12 15:06:12.391494", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:14.287 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:14 +0000 (0:00:00.141) 0:01:15.434 **** 2020-02-12T15:06:14.355 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-02-12T15:06:14.356 INFO:teuthology.task.ansible.out:fatal: [smithi105.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006222", "end": "2020-02-12 15:06:14.332286", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 15:06:14.326064", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-02-12T15:06:14.397 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:14 +0000 (0:00:00.109) 0:01:15.544 **** 2020-02-12T15:06:14.435 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-02-12T15:06:14.436 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:14.486 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:14 +0000 (0:00:00.089) 0:01:15.633 **** 2020-02-12T15:06:14.911 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2020-02-12T15:06:14.912 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/8/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "a0e2ac0628a264e14b96b1c57627a3aa344a6c52", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/8/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 203, "state": "file", "uid": 0} 2020-02-12T15:06:14.956 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:14 +0000 (0:00:00.470) 0:01:16.103 **** 2020-02-12T15:06:14.983 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2020-02-12T15:06:15.035 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:15 +0000 (0:00:00.078) 0:01:16.181 **** 2020-02-12T15:06:15.910 INFO:teuthology.task.ansible.out: TASK [testnode : Enable copr repos] ******************************************** 2020-02-12T15:06:15.912 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item=ktdreyer/ceph-el8) => {"ansible_loop_var": "item", "changed": true, "cmd": ["dnf", "-y", "copr", "enable", "ktdreyer/ceph-el8"], "delta": "0:00:00.529050", "end": "2020-02-12 15:06:15.885956", "item": "ktdreyer/ceph-el8", "rc": 0, "start": "2020-02-12 15:06:15.356906", "stderr": "", "stderr_lines": [], "stdout": "Repository successfully enabled.", "stdout_lines": ["Repository successfully enabled."], "warnings": ["Consider using the dnf module rather than running 'dnf'. If you need to use command because dnf is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message."]} 2020-02-12T15:06:16.080 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:01.045) 0:01:17.227 **** 2020-02-12T15:06:16.108 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2020-02-12T15:06:16.110 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:16.148 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.067) 0:01:17.294 **** 2020-02-12T15:06:16.198 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2020-02-12T15:06:16.200 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:16.240 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.092) 0:01:17.387 **** 2020-02-12T15:06:16.272 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:16.309 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.068) 0:01:17.456 **** 2020-02-12T15:06:16.346 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:06:16.347 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2020-02-12T15:06:16.388 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.079) 0:01:17.535 **** 2020-02-12T15:06:16.424 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2020-02-12T15:06:16.426 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:16.462 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.074) 0:01:17.609 **** 2020-02-12T15:06:16.510 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2020-02-12T15:06:16.511 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:16.560 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.097) 0:01:17.707 **** 2020-02-12T15:06:16.765 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2020-02-12T15:06:16.766 INFO:teuthology.task.ansible.out:fatal: [smithi180.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.006586", "end": "2020-02-12 15:06:16.744271", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 15:06:16.737685", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2020-02-12T15:06:16.822 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.250) 0:01:17.957 **** 2020-02-12T15:06:16.836 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2020-02-12T15:06:16.837 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:16.873 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:16 +0000 (0:00:00.063) 0:01:18.020 **** 2020-02-12T15:06:17.397 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-12T15:06:17.397 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-02-12T15:06:17.434 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:17 +0000 (0:00:00.560) 0:01:18.581 **** 2020-02-12T15:06:19.590 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Removed: librados2-1:12.2.7-9.el8.x86_64", "Removed: librbd1-1:12.2.7-9.el8.x86_64"]} 2020-02-12T15:06:19.637 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:19 +0000 (0:00:02.202) 0:01:20.784 **** 2020-02-12T15:06:20.359 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-12T15:06:20.360 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-02-12T15:06:20.407 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:20 +0000 (0:00:00.769) 0:01:21.554 **** 2020-02-12T15:06:22.836 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Removed: boost-program-options-1.66.0-6.el8.x86_64", "Removed: boost-random-1.66.0-6.el8.x86_64", "Removed: hdparm-9.54-2.el8.x86_64", "Removed: tuned-2.12.0-3.el8_1.1.noarch"]} 2020-02-12T15:06:22.874 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:22 +0000 (0:00:02.465) 0:01:24.019 **** 2020-02-12T15:06:26.801 INFO:teuthology.task.ansible.out: TASK [testnode : Base group workaround for BZ1782899] ************************** changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:06.181704", "end": "2020-02-12 15:06:26.778918", "rc": 0, "start": "2020-02-12 15:06:20.597214", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\""], "stdout": "CentOS-8 - AppStream 17 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 35 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 921 B/s | 1.5 kB 00:01 \nCopr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 165 kB/s | 5.3 kB 00:00 \nlab-extras 1.0 MB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Wed 12 Feb 2020 03:06:23 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Re 2020-02-12T15:06:26.802 INFO:teuthology.task.ansible.out:pository Size\n================================================================================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 17 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 35 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 921 B/s | 1.5 kB 00:01 ", "Copr repo for ceph-el8 owned by ktdreyer 16 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 165 kB/s | 5.3 kB 00:00 ", "lab-extras 1.0 MB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Wed 12 Feb 2020 03:06:23 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-02-12T15:06:26.838 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:26 +0000 (0:00:03.965) 0:01:27.985 **** 2020-02-12T15:06:28.580 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": "dnf -y groupinstall base --nobest && dnf -y group upgrade base", "delta": "0:00:05.481599", "end": "2020-02-12 15:06:28.554391", "rc": 0, "start": "2020-02-12 15:06:23.072792", "stderr": "No match for group package \"insights-client\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"centos-release-eula\"\nNo match for group package \"insights-client\"", "stderr_lines": ["No match for group package \"insights-client\"", "No match for group package \"centos-release-eula\"", "No match for group package \"centos-release-eula\"", "No match for group package \"insights-client\""], "stdout": "CentOS-8 - AppStream 18 kB/s | 4.3 kB 00:00 \nCentOS-8 - Base 25 kB/s | 3.8 kB 00:00 \nCentOS-8 - Extras 4.2 kB/s | 1.5 kB 00:00 \nCopr repo for ceph-el8 owned by ktdreyer 34 kB/s | 3.3 kB 00:00 \nExtra Packages for Enterprise Linux 138 kB/s | 5.3 kB 00:00 \nlab-extras 978 kB/s | 2.9 kB 00:00 \nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n================================================================================\nInstalling Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!\nLast metadata expiration check: 0:00:02 ago on Wed 12 Feb 2020 03:06:24 PM UTC.\nDependencies resolved.\n================================================================================\n Package Architecture Version Repository Size\n============================================================= 2020-02-12T15:06:28.581 INFO:teuthology.task.ansible.out:===================\nUpgrading Groups:\n Base \n\nTransaction Summary\n================================================================================\n\nComplete!", "stdout_lines": ["CentOS-8 - AppStream 18 kB/s | 4.3 kB 00:00 ", "CentOS-8 - Base 25 kB/s | 3.8 kB 00:00 ", "CentOS-8 - Extras 4.2 kB/s | 1.5 kB 00:00 ", "Copr repo for ceph-el8 owned by ktdreyer 34 kB/s | 3.3 kB 00:00 ", "Extra Packages for Enterprise Linux 138 kB/s | 5.3 kB 00:00 ", "lab-extras 978 kB/s | 2.9 kB 00:00 ", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Installing Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!", "Last metadata expiration check: 0:00:02 ago on Wed 12 Feb 2020 03:06:24 PM UTC.", "Dependencies resolved.", "================================================================================", " Package Architecture Version Repository Size", "================================================================================", "Upgrading Groups:", " Base ", "", "Transaction Summary", "================================================================================", "", "Complete!"]} 2020-02-12T15:06:28.618 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:28 +0000 (0:00:01.780) 0:01:29.765 **** 2020-02-12T15:06:34.340 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T15:06:34.341 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64"]} 2020-02-12T15:06:34.379 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:34 +0000 (0:00:05.760) 0:01:35.526 **** 2020-02-12T15:06:34.409 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-02-12T15:06:34.410 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:34.445 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:34 +0000 (0:00:00.066) 0:01:35.592 **** 2020-02-12T15:06:35.391 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-12T15:06:35.430 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:35 +0000 (0:00:00.981) 0:01:36.574 **** 2020-02-12T15:06:35.453 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T15:06:35.454 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:35.490 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:35 +0000 (0:00:00.063) 0:01:36.637 **** 2020-02-12T15:06:35.806 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-02-12T15:06:35.807 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "sysinit.target system.slice polkit.service dbus.socket dbus.service basic.target", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ip6tables.service ipset.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-02-12T15:06:35.809 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", 2020-02-12T15:06:35.818 INFO:teuthology.task.ansible.out:"LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice dbus.socket sysinit.target", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3 2020-02-12T15:06:35.820 INFO:teuthology.task.ansible.out:", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-02-12T15:06:35.844 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:35 +0000 (0:00:00.354) 0:01:36.991 **** 2020-02-12T15:06:36.142 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-02-12T15:06:36.180 INFO:teuthology.task.ansible.out:fatal: [smithi105.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring Wednesday 12 February 2020 15:06:36 +0000 (0:00:00.334) 0:01:37.325 **** 2020-02-12T15:06:36.587 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T15:06:36.588 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "msg": "", "rc": 0, "results": ["Group core installed.", "Group base installed.", "Installed: dnf-utils", "Installed: sysstat", "Installed: libedit", "Installed: boost-thread", "Installed: xfsprogs", "Installed: gdisk", "Installed: parted", "Installed: libgcrypt", "Installed: fuse-libs", "Installed: openssl", "Installed: libuuid", "Installed: podman", "Installed: podman-docker", "Installed: attr", "Installed: ant", "Installed: lsof", "Installed: gettext", "Installed: bc", "Installed: xfsdump", "Installed: blktrace", "Installed: usbredir", "Installed: libev-devel", "Installed: valgrind", "Installed: nfs-utils", "Installed: ncurses-devel", "Installed: gcc", "Installed: git", "Installed: python3-nose", "Installed: python3-virtualenv", "Installed: genisoimage", "Installed: qemu-img", "Installed: qemu-kvm-core", "Installed: qemu-kvm-block-rbd", "Installed: libacl-devel", "Installed: dbench", "Installed: autoconf", "Installed: gdb", "Installed: librados2-1:12.2.7-9.el8.x86_64", "Installed: qemu-kvm-block-rbd-15:2.12.0-88.module_el8.1.0+266+ba744077.2.x86_64", "Installed: librbd1-1:12.2.7-9.el8.x86_64", "Installed: tuned-2.12.0-3.el8_1.1.noarch", "Installed: hdparm-9.54-2.el8.x86_64", "Installed: boost-program-options-1.66.0-6.el8.x86_64", "Installed: boost-random-1.66.0-6.el8.x86_64"]} 2020-02-12T15:06:36.630 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:36 +0000 (0:00:00.446) 0:01:37.772 **** 2020-02-12T15:06:36.663 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2020-02-12T15:06:36.664 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:36.715 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:36 +0000 (0:00:00.090) 0:01:37.862 **** 2020-02-12T15:06:36.766 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-02-12T15:06:36.767 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-02-12T15:06:36.803 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:36 +0000 (0:00:00.087) 0:01:37.950 **** 2020-02-12T15:06:36.829 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-02-12T15:06:36.831 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:36.865 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:36 +0000 (0:00:00.062) 0:01:38.012 **** 2020-02-12T15:06:36.892 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-02-12T15:06:36.935 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:36 +0000 (0:00:00.068) 0:01:38.081 **** 2020-02-12T15:06:36.960 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-02-12T15:06:36.962 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:36.997 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:36 +0000 (0:00:00.062) 0:01:38.144 **** 2020-02-12T15:06:37.034 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-02-12T15:06:37.036 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.072 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.074) 0:01:38.219 **** 2020-02-12T15:06:37.112 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-02-12T15:06:37.114 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi105.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.150 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.077) 0:01:38.297 **** 2020-02-12T15:06:37.176 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2020-02-12T15:06:37.178 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.220 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.070) 0:01:38.367 **** 2020-02-12T15:06:37.247 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-02-12T15:06:37.284 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.063) 0:01:38.431 **** 2020-02-12T15:06:37.309 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2020-02-12T15:06:37.311 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.347 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.062) 0:01:38.493 **** 2020-02-12T15:06:37.384 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.420 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.072) 0:01:38.566 **** 2020-02-12T15:06:37.446 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.488 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.068) 0:01:38.635 **** 2020-02-12T15:06:37.514 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T15:06:37.515 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.550 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.062) 0:01:38.697 **** 2020-02-12T15:06:37.576 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-02-12T15:06:37.578 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.619 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.069) 0:01:38.766 **** 2020-02-12T15:06:37.636 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-02-12T15:06:37.637 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": []} 2020-02-12T15:06:37.675 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.055) 0:01:38.822 **** 2020-02-12T15:06:37.680 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T15:06:37.682 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.721 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.045) 0:01:38.867 **** 2020-02-12T15:06:37.725 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T15:06:37.727 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.768 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.047) 0:01:38.914 **** 2020-02-12T15:06:37.773 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-02-12T15:06:37.775 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.816 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.048) 0:01:38.963 **** 2020-02-12T15:06:37.853 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2020-02-12T15:06:37.855 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.891 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.075) 0:01:39.038 **** 2020-02-12T15:06:37.917 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-02-12T15:06:37.919 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:37.957 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:37 +0000 (0:00:00.065) 0:01:39.103 **** 2020-02-12T15:06:37.982 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-02-12T15:06:37.984 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.022 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.065) 0:01:39.169 **** 2020-02-12T15:06:38.048 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-02-12T15:06:38.049 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.086 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.063) 0:01:39.232 **** 2020-02-12T15:06:38.091 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2020-02-12T15:06:38.093 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "dbus.socket system.slice polkit.service sysinit.target basic.target dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConfigurationDirectoryMode": "0755", "Conflicts": "ebtables.service ip6tables.service iptables.service ipset.service shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTim 2020-02-12T15:06:38.095 INFO:teuthology.task.ansible.out:estampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "62925", "LimitNPROCSoft": "62925", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62925", "Li 2020-02-12T15:06:38.096 INFO:teuthology.task.ansible.out:mitSIGPENDINGSoft": "62925", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "0", "MemoryAccounting": "yes", "MemoryCurrent": "[not set]", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "no", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "sysinit.target system.slice dbus.socket", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestampMonotonic": "0", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SuccessAction": "none", "SyslogFacility": "3", " 2020-02-12T15:06:38.097 INFO:teuthology.task.ansible.out:SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "[not set]", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "UtmpMode": "init", "Wants": "network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2020-02-12T15:06:38.132 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.046) 0:01:39.279 **** 2020-02-12T15:06:38.137 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-02-12T15:06:38.138 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.175 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.043) 0:01:39.322 **** 2020-02-12T15:06:38.201 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-02-12T15:06:38.202 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.237 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.061) 0:01:39.384 **** 2020-02-12T15:06:38.262 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-02-12T15:06:38.264 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.297 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.060) 0:01:39.444 **** 2020-02-12T15:06:38.323 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2020-02-12T15:06:38.324 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.360 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.062) 0:01:39.506 **** 2020-02-12T15:06:38.385 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-12T15:06:38.387 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.423 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.063) 0:01:39.570 **** 2020-02-12T15:06:38.428 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2020-02-12T15:06:38.428 INFO:teuthology.task.ansible.out:fatal: [smithi180.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2020-02-12T15:06:38.471 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.047) 0:01:39.618 **** 2020-02-12T15:06:38.476 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-12T15:06:38.476 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.514 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.043) 0:01:39.661 **** 2020-02-12T15:06:38.540 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2020-02-12T15:06:38.542 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.578 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.063) 0:01:39.724 **** 2020-02-12T15:06:38.603 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-12T15:06:38.605 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.639 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.061) 0:01:39.786 **** 2020-02-12T15:06:38.665 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-12T15:06:38.666 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.701 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.062) 0:01:39.848 **** 2020-02-12T15:06:38.729 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-12T15:06:38.730 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.773 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.071) 0:01:39.920 **** 2020-02-12T15:06:38.779 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2020-02-12T15:06:38.779 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2020-02-12T15:06:38.825 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.052) 0:01:39.972 **** 2020-02-12T15:06:38.830 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-12T15:06:38.831 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.872 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.047) 0:01:40.019 **** 2020-02-12T15:06:38.878 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2020-02-12T15:06:38.878 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.921 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.048) 0:01:40.068 **** 2020-02-12T15:06:38.927 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:38.979 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:38 +0000 (0:00:00.057) 0:01:40.126 **** 2020-02-12T15:06:38.986 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2020-02-12T15:06:39.024 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.044) 0:01:40.171 **** 2020-02-12T15:06:39.029 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T15:06:39.030 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.076 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.052) 0:01:40.223 **** 2020-02-12T15:06:39.082 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2020-02-12T15:06:39.083 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.121 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.044) 0:01:40.267 **** 2020-02-12T15:06:39.126 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.165 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.043) 0:01:40.311 **** 2020-02-12T15:06:39.169 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2020-02-12T15:06:39.171 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.216 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.051) 0:01:40.363 **** 2020-02-12T15:06:39.221 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-12T15:06:39.222 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.275 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.058) 0:01:40.422 **** 2020-02-12T15:06:39.280 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2020-02-12T15:06:39.281 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.320 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.045) 0:01:40.467 **** 2020-02-12T15:06:39.352 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.383 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.063) 0:01:40.530 **** 2020-02-12T15:06:39.410 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2020-02-12T15:06:39.447 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.063) 0:01:40.594 **** 2020-02-12T15:06:39.486 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.528 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.079) 0:01:40.674 **** 2020-02-12T15:06:39.542 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-02-12T15:06:39.571 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.044) 0:01:40.718 **** 2020-02-12T15:06:39.578 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2020-02-12T15:06:39.579 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.629 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.051) 0:01:40.770 **** 2020-02-12T15:06:39.649 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2020-02-12T15:06:39.650 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.691 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.063) 0:01:40.833 **** 2020-02-12T15:06:39.712 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T15:06:39.713 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.751 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.064) 0:01:40.898 **** 2020-02-12T15:06:39.777 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2020-02-12T15:06:39.792 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.816 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.064) 0:01:40.962 **** 2020-02-12T15:06:39.821 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T15:06:39.822 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T15:06:39.861 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.045) 0:01:41.008 **** 2020-02-12T15:06:39.866 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T15:06:39.867 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.903 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.042) 0:01:41.050 **** 2020-02-12T15:06:39.935 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2020-02-12T15:06:39.936 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:39.978 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:39 +0000 (0:00:00.074) 0:01:41.124 **** 2020-02-12T15:06:40.007 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.067 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.089) 0:01:41.214 **** 2020-02-12T15:06:40.072 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T15:06:40.074 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-02-12T15:06:40.111 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.043) 0:01:41.257 **** 2020-02-12T15:06:40.115 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2020-02-12T15:06:40.117 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.153 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.042) 0:01:41.300 **** 2020-02-12T15:06:40.159 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-12T15:06:40.161 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.198 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.044) 0:01:41.344 **** 2020-02-12T15:06:40.203 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2020-02-12T15:06:40.204 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.242 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.044) 0:01:41.389 **** 2020-02-12T15:06:40.247 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-12T15:06:40.249 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.285 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.043) 0:01:41.432 **** 2020-02-12T15:06:40.290 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2020-02-12T15:06:40.291 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.328 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.042) 0:01:41.474 **** 2020-02-12T15:06:40.332 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-12T15:06:40.333 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.370 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.041) 0:01:41.516 **** 2020-02-12T15:06:40.376 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2020-02-12T15:06:40.377 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.411 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.042) 0:01:41.558 **** 2020-02-12T15:06:40.416 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T15:06:40.416 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.455 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.043) 0:01:41.602 **** 2020-02-12T15:06:40.460 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2020-02-12T15:06:40.462 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.498 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.043) 0:01:41.645 **** 2020-02-12T15:06:40.504 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T15:06:40.506 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.544 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.045) 0:01:41.691 **** 2020-02-12T15:06:40.549 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2020-02-12T15:06:40.550 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.590 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.045) 0:01:41.737 **** 2020-02-12T15:06:40.597 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T15:06:40.599 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.640 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.050) 0:01:41.787 **** 2020-02-12T15:06:40.659 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.700 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.059) 0:01:41.847 **** 2020-02-12T15:06:40.706 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T15:06:40.707 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.746 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.045) 0:01:41.893 **** 2020-02-12T15:06:40.751 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2020-02-12T15:06:40.754 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.791 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.045) 0:01:41.938 **** 2020-02-12T15:06:40.796 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T15:06:40.797 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.836 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.044) 0:01:41.982 **** 2020-02-12T15:06:40.845 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2020-02-12T15:06:40.846 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.883 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.046) 0:01:42.029 **** 2020-02-12T15:06:40.889 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T15:06:40.890 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.929 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.045) 0:01:42.075 **** 2020-02-12T15:06:40.935 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:40.978 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:40 +0000 (0:00:00.048) 0:01:42.124 **** 2020-02-12T15:06:40.983 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-02-12T15:06:40.984 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.028 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.050) 0:01:42.175 **** 2020-02-12T15:06:41.034 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2020-02-12T15:06:41.034 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.088 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.059) 0:01:42.235 **** 2020-02-12T15:06:41.095 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-02-12T15:06:41.096 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.133 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.044) 0:01:42.280 **** 2020-02-12T15:06:41.138 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2020-02-12T15:06:41.140 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.177 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.043) 0:01:42.324 **** 2020-02-12T15:06:41.181 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-12T15:06:41.183 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.221 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.043) 0:01:42.367 **** 2020-02-12T15:06:41.226 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2020-02-12T15:06:41.227 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.266 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.045) 0:01:42.413 **** 2020-02-12T15:06:41.274 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.321 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.054) 0:01:42.468 **** 2020-02-12T15:06:41.337 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2020-02-12T15:06:41.339 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.376 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.054) 0:01:42.522 **** 2020-02-12T15:06:41.382 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-02-12T15:06:41.383 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.423 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.047) 0:01:42.569 **** 2020-02-12T15:06:41.429 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2020-02-12T15:06:41.430 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.473 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.050) 0:01:42.620 **** 2020-02-12T15:06:41.480 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-02-12T15:06:41.481 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.521 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.047) 0:01:42.667 **** 2020-02-12T15:06:41.526 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2020-02-12T15:06:41.528 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.566 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.045) 0:01:42.713 **** 2020-02-12T15:06:41.574 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.611 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.044) 0:01:42.758 **** 2020-02-12T15:06:41.617 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2020-02-12T15:06:41.619 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.657 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.046) 0:01:42.804 **** 2020-02-12T15:06:41.662 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-02-12T15:06:41.664 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.703 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.045) 0:01:42.850 **** 2020-02-12T15:06:41.709 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-12T15:06:41.710 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.748 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.044) 0:01:42.894 **** 2020-02-12T15:06:41.754 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2020-02-12T15:06:41.755 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.793 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.045) 0:01:42.940 **** 2020-02-12T15:06:41.818 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-02-12T15:06:41.820 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.858 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.064) 0:01:43.005 **** 2020-02-12T15:06:41.884 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-02-12T15:06:41.886 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.921 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.063) 0:01:43.068 **** 2020-02-12T15:06:41.947 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-02-12T15:06:41.948 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:41.987 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:41 +0000 (0:00:00.064) 0:01:43.132 **** 2020-02-12T15:06:41.991 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T15:06:41.992 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2020-02-12T15:06:42.030 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.044) 0:01:43.177 **** 2020-02-12T15:06:42.035 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-02-12T15:06:42.037 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.077 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.046) 0:01:43.224 **** 2020-02-12T15:06:42.103 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:06:42.103 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-02-12T15:06:42.141 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.064) 0:01:43.288 **** 2020-02-12T15:06:42.178 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-02-12T15:06:42.180 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.190 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-02-12T15:06:42.201 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.212 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.223 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.234 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.235 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T15:06:42.237 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T15:06:42.239 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi105.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.281 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.139) 0:01:43.428 **** 2020-02-12T15:06:42.315 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.034) 0:01:43.462 **** 2020-02-12T15:06:42.418 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-02-12T15:06:42.418 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003666", "end": "2020-02-12 15:06:42.394676", "rc": 0, "start": "2020-02-12 15:06:42.391010", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-02-12T15:06:42.462 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.146) 0:01:43.609 **** 2020-02-12T15:06:42.488 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-02-12T15:06:42.490 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.535 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.072) 0:01:43.682 **** 2020-02-12T15:06:42.541 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T15:06:42.542 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2020-02-12T15:06:42.582 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.046) 0:01:43.729 **** 2020-02-12T15:06:42.588 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-02-12T15:06:42.589 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.628 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.046) 0:01:43.775 **** 2020-02-12T15:06:42.634 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-12T15:06:42.635 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.675 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.047) 0:01:43.822 **** 2020-02-12T15:06:42.681 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-02-12T15:06:42.685 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.720 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.044) 0:01:43.866 **** 2020-02-12T15:06:42.725 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-12T15:06:42.725 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.763 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.043) 0:01:43.910 **** 2020-02-12T15:06:42.765 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:42.768 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-02-12T15:06:42.768 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.806 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.042) 0:01:43.952 **** 2020-02-12T15:06:42.810 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2020-02-12T15:06:42.810 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.848 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.042) 0:01:43.995 **** 2020-02-12T15:06:42.879 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T15:06:42.880 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.915 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.066) 0:01:44.061 **** 2020-02-12T15:06:42.940 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T15:06:42.941 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:42.977 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:42 +0000 (0:00:00.062) 0:01:44.123 **** 2020-02-12T15:06:43.002 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T15:06:43.003 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.036 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.059) 0:01:44.183 **** 2020-02-12T15:06:43.060 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2020-02-12T15:06:43.062 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.096 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.060) 0:01:44.243 **** 2020-02-12T15:06:43.122 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2020-02-12T15:06:43.124 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.158 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.062) 0:01:44.305 **** 2020-02-12T15:06:43.184 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2020-02-12T15:06:43.185 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.221 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.062) 0:01:44.367 **** 2020-02-12T15:06:43.246 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2020-02-12T15:06:43.248 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.282 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.061) 0:01:44.429 **** 2020-02-12T15:06:43.308 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2020-02-12T15:06:43.310 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.345 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.063) 0:01:44.492 **** 2020-02-12T15:06:43.370 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2020-02-12T15:06:43.371 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.405 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.059) 0:01:44.552 **** 2020-02-12T15:06:43.430 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2020-02-12T15:06:43.431 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.467 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.061) 0:01:44.614 **** 2020-02-12T15:06:43.492 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2020-02-12T15:06:43.493 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.527 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.060) 0:01:44.674 **** 2020-02-12T15:06:43.552 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2020-02-12T15:06:43.553 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.588 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.060) 0:01:44.735 **** 2020-02-12T15:06:43.613 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2020-02-12T15:06:43.614 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.649 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.060) 0:01:44.796 **** 2020-02-12T15:06:43.674 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2020-02-12T15:06:43.676 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.712 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.062) 0:01:44.858 **** 2020-02-12T15:06:43.727 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-02-12T15:06:43.729 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-02-12T15:06:43.774 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.052) 0:01:44.911 **** TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.811 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.046) 0:01:44.958 **** 2020-02-12T15:06:43.817 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T15:06:43.818 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item={u'block_used': 12958745, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227136363, u'size_available': 930350542848, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989887, u'device': u'/dev/sda1', u'inode_used': 65089, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227136363, "block_size": 4096, "block_total": 240095108, "block_used": 12958745, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989887, "inode_total": 61054976, "inode_used": 65089, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930350542848, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}} 2020-02-12T15:06:43.858 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.047) 0:01:45.005 **** 2020-02-12T15:06:43.865 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2020-02-12T15:06:43.866 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.905 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.046) 0:01:45.052 **** 2020-02-12T15:06:43.933 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2020-02-12T15:06:43.934 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:43.975 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:43 +0000 (0:00:00.070) 0:01:45.122 **** 2020-02-12T15:06:44.001 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2020-02-12T15:06:44.006 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.040 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.064) 0:01:45.187 **** 2020-02-12T15:06:44.056 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2020-02-12T15:06:44.057 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005142", "end": "2020-02-12 15:06:44.036794", "rc": 0, "start": "2020-02-12 15:06:44.031652", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:44.097 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.056) 0:01:45.244 **** 2020-02-12T15:06:44.103 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2020-02-12T15:06:44.104 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.146 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.045) 0:01:45.290 **** 2020-02-12T15:06:44.148 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-02-12T15:06:44.148 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'block_used': 12958745, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227136363, u'size_available': 930350542848, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989887, u'device': u'/dev/sda1', u'inode_used': 65089, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227136363, "block_size": 4096, "block_total": 240095108, "block_used": 12958745, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989887, "inode_total": 61054976, "inode_used": 65089, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930350542848, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.189 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.045) 0:01:45.336 **** 2020-02-12T15:06:44.195 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:06:44.196 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2020-02-12T15:06:44.233 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.044) 0:01:45.380 **** 2020-02-12T15:06:44.238 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-02-12T15:06:44.277 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.043) 0:01:45.423 **** 2020-02-12T15:06:44.281 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** 2020-02-12T15:06:44.290 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.291 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2020-02-12T15:06:44.293 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.303 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.314 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.315 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-12T15:06:44.316 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QCTR', u'wwn-0x5000c50091e03324'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QCTR', u'wwn': u'0x5000c50091e03324', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1', u'wwn-0x5000c50091e03324-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR", "wwn-0x5000c50091e03324"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1", "wwn-0x5000c50091e03324-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QCTR", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-12T15:06:44.318 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e03324"}}, "skip_reason": "Conditional result was False"} TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi180.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.327 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.367 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.090) 0:01:45.513 **** 2020-02-12T15:06:44.495 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2020-02-12T15:06:44.497 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.003586", "end": "2020-02-12 15:06:44.477432", "rc": 0, "start": "2020-02-12 15:06:44.473846", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2020-02-12T15:06:44.535 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.168) 0:01:45.682 **** 2020-02-12T15:06:44.560 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2020-02-12T15:06:44.562 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.599 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.063) 0:01:45.746 **** 2020-02-12T15:06:44.623 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2020-02-12T15:06:44.625 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.659 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.060) 0:01:45.806 **** 2020-02-12T15:06:44.684 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2020-02-12T15:06:44.686 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.721 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.061) 0:01:45.867 **** 2020-02-12T15:06:44.745 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2020-02-12T15:06:44.749 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:44.782 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:44 +0000 (0:00:00.061) 0:01:45.929 **** 2020-02-12T15:06:45.692 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2020-02-12T15:06:45.692 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "msg": "Nothing to do", "rc": 0, "results": ["Installed: gdisk", "Installed: device-mapper"]} 2020-02-12T15:06:45.741 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:45 +0000 (0:00:00.948) 0:01:46.877 **** 2020-02-12T15:06:45.768 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T15:06:45.768 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item={u'block_used': 12962438, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132670, u'size_available': 930335416320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989889, u'device': u'/dev/sda1', u'inode_used': 65087, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132670, "block_size": 4096, "block_total": 240095108, "block_used": 12962438, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989889, "inode_total": 61054976, "inode_used": 65087, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335416320, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}} 2020-02-12T15:06:45.804 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:45 +0000 (0:00:00.073) 0:01:46.951 **** 2020-02-12T15:06:45.850 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-12T15:06:45.851 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-OKKXGY-39yQ-W5V0-nfhe-oD4w-Dk9u-EEin1l', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN', u'nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.345836", "end": "2020-02-12 15:06:45.821217", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-OKKXGY-39yQ-W5V0-nfhe-oD4w-Dk9u-EEin1l", "nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN", "nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:44.475381", "stderr": "", "stderr_lines": [], "stdout": "Creating new GP 2020-02-12T15:06:45.853 INFO:teuthology.task.ansible.out:T entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:46.016 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.005095", "end": "2020-02-12 15:06:45.980990", "rc": 0, "start": "2020-02-12 15:06:45.975895", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:46.046 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:46 +0000 (0:00:00.242) 0:01:47.193 **** 2020-02-12T15:06:46.082 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2020-02-12T15:06:46.083 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'block_used': 12962438, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132670, u'size_available': 930335416320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989889, u'device': u'/dev/sda1', u'inode_used': 65087, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132670, "block_size": 4096, "block_total": 240095108, "block_used": 12962438, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989889, "inode_total": 61054976, "inode_used": 65087, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335416320, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:46.120 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:46 +0000 (0:00:00.073) 0:01:47.267 **** 2020-02-12T15:06:46.146 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2020-02-12T15:06:46.183 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:46 +0000 (0:00:00.062) 0:01:47.330 **** 2020-02-12T15:06:46.221 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-12T15:06:46.222 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGGP', u'wwn-0x5000c50092930050'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XGGP', u'wwn': u'0x5000c50092930050', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1', u'wwn-0x5000c50092930050-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP", "wwn-0x5000c50092930050"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1", "wwn-0x5000c50092930050-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGGP", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-12T15:06:46.223 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50092930050"}}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:47.124 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUsIR27dEpIVeAc5JPdCv3kLpZy5wj68H3'], u'uuids': [u'4a77b910-5371-4cf0-b081-0bac74dff0c7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.060536", "end": "2020-02-12 15:06:47.087945", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUsIR27dEpIVeAc5JPdCv3kLpZy5wj68H3"], "labels": [], "masters": [], "uuids": ["4a77b910-5371-4cf0-b081-0bac74dff0c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:46.027409", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:47.789 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-MEMzNh-2Fvm-eCXA-WvIf-KzC4-0NHk-h66e1X', u'nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN', u'nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.377257", "end": "2020-02-12 15:06:47.758555", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-MEMzNh-2Fvm-eCXA-WvIf-KzC4-0NHk-h66e1X", "nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN", "nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:46.381298", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGP 2020-02-12T15:06:47.793 INFO:teuthology.task.ansible.out:T data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:48.362 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUAlBMRql9dOuoDYhiln2SYkJ1ppjTG5FG'], u'uuids': [u'65190ad1-da6b-40c3-9982-8721dd9a9a14']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.043850", "end": "2020-02-12 15:06:48.331784", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUAlBMRql9dOuoDYhiln2SYkJ1ppjTG5FG"], "labels": [], "masters": [], "uuids": ["65190ad1-da6b-40c3-9982-8721dd9a9a14"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:47.287934", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:49.040 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EvCpd7Ejcal8l0qN7BTh8nRokyNRK8HPW'], u'uuids': [u'0a67034e-64fb-4991-9868-4ee98e8363d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.053161", "end": "2020-02-12 15:06:49.003894", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EvCpd7Ejcal8l0qN7BTh8nRokyNRK8HPW"], "labels": [], "masters": [], "uuids": ["0a67034e-64fb-4991-9868-4ee98e8363d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:47.950733", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:49.603 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUL8FZeVdCUf637cDF1t2200vUMMSukkH6'], u'uuids': [u'b27d4564-ae3f-4682-8508-fc3fe5c59d8f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.048728", "end": "2020-02-12 15:06:49.574549", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUL8FZeVdCUf637cDF1t2200vUMMSukkH6"], "labels": [], "masters": [], "uuids": ["b27d4564-ae3f-4682-8508-fc3fe5c59d8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:48.525821", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:50.281 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Er7LpSqytQkYs60VguV0pcl4KaQLmPJ3k'], u'uuids': [u'244022cc-3b6a-40e9-93b9-16dbb33ee359']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.050192", "end": "2020-02-12 15:06:50.247482", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Er7LpSqytQkYs60VguV0pcl4KaQLmPJ3k"], "labels": [], "masters": [], "uuids": ["244022cc-3b6a-40e9-93b9-16dbb33ee359"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:49.197290", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:50.858 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUDgKx14QFTKbGyRf90hY79V5729adWjUn'], u'uuids': [u'0b67751f-15b1-4dde-8e88-ed2ecda5a3fa']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.055228", "end": "2020-02-12 15:06:50.823469", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUDgKx14QFTKbGyRf90hY79V5729adWjUn"], "labels": [], "masters": [], "uuids": ["0b67751f-15b1-4dde-8e88-ed2ecda5a3fa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:49.768241", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:51.526 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EBIIfOeOxgXqgNf8fh3UbesWlOaLB9nqz'], u'uuids': [u'8014201d-393e-4294-aa4e-5a7bcf9709cd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.055032", "end": "2020-02-12 15:06:51.495829", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EBIIfOeOxgXqgNf8fh3UbesWlOaLB9nqz"], "labels": [], "masters": [], "uuids": ["8014201d-393e-4294-aa4e-5a7bcf9709cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:50.440797", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:52.110 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUeRGI55n2V8nfZYw36LiLsui0Y3QtJA1z'], u'uuids': [u'1a5734e0-2444-4173-a5aa-f72bed839017']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.053533", "end": "2020-02-12 15:06:52.074625", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUeRGI55n2V8nfZYw36LiLsui0Y3QtJA1z"], "labels": [], "masters": [], "uuids": ["1a5734e0-2444-4173-a5aa-f72bed839017"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:51.021092", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:52.155 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:52 +0000 (0:00:05.971) 0:01:53.302 **** 2020-02-12T15:06:52.192 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:52.193 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QCTR', u'wwn-0x5000c50091e03324'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QCTR', u'wwn': u'0x5000c50091e03324', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1', u'wwn-0x5000c50091e03324-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR", "wwn-0x5000c50091e03324"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QCTR-part1", "wwn-0x5000c50091e03324-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QCTR", "size": "931.51 GB", "support_discard": "0", "vend 2020-02-12T15:06:52.194 INFO:teuthology.task.ansible.out:or": "ATA", "virtual": 1, "wwn": "0x5000c50091e03324"}}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:52.425 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-OKKXGY-39yQ-W5V0-nfhe-oD4w-Dk9u-EEin1l', u'nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN', u'nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'model': u'INTEL SSDPEDMD400G4', u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037351", "end": "2020-02-12 15:06:52.398503", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-OKKXGY-39yQ-W5V0-nfhe-oD4w-Dk9u-EEin1l", "nvme-INTEL_SSDPEDMD400G4_PHFT620400TR400BGN", "nvme-nvme.8086-50484654363230343030545234303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:52.361152", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 11 2020-02-12T15:06:52.427 INFO:teuthology.task.ansible.out:0 MiB) copied, 0.0347338 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0347338 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:52.772 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUsIR27dEpIVeAc5JPdCv3kLpZy5wj68H3'], u'uuids': [u'4a77b910-5371-4cf0-b081-0bac74dff0c7']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.148986", "end": "2020-02-12 15:06:52.738384", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUsIR27dEpIVeAc5JPdCv3kLpZy5wj68H3"], "labels": [], "masters": [], "uuids": ["4a77b910-5371-4cf0-b081-0bac74dff0c7"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:52.589398", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.146568 s, 787 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.146568 s, 787 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:52.783 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-12T15:06:52.784 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EOygEKuo7yuiZJ85MOzSuhcrWXxcv48Zw'], u'uuids': [u'05fdc595-57f7-458e-b8bd-3d76d7969a33']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.042819", "end": "2020-02-12 15:06:52.746756", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EOygEKuo7yuiZJ85MOzSuhcrWXxcv48Zw"], "labels": [], "masters": [], "uuids": ["05fdc595-57f7-458e-b8bd-3d76d7969a33"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:51.703937", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:53.137 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUAlBMRql9dOuoDYhiln2SYkJ1ppjTG5FG'], u'uuids': [u'65190ad1-da6b-40c3-9982-8721dd9a9a14']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.139166", "end": "2020-02-12 15:06:53.101428", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUAlBMRql9dOuoDYhiln2SYkJ1ppjTG5FG"], "labels": [], "masters": [], "uuids": ["65190ad1-da6b-40c3-9982-8721dd9a9a14"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:52.962262", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136612 s, 844 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136612 s, 844 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:53.463 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUL8FZeVdCUf637cDF1t2200vUMMSukkH6'], u'uuids': [u'b27d4564-ae3f-4682-8508-fc3fe5c59d8f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.146201", "end": "2020-02-12 15:06:53.435301", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUL8FZeVdCUf637cDF1t2200vUMMSukkH6"], "labels": [], "masters": [], "uuids": ["b27d4564-ae3f-4682-8508-fc3fe5c59d8f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:53.289100", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.143692 s, 803 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.143692 s, 803 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:53.465 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:53.794 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUDgKx14QFTKbGyRf90hY79V5729adWjUn'], u'uuids': [u'0b67751f-15b1-4dde-8e88-ed2ecda5a3fa']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.138899", "end": "2020-02-12 15:06:53.762418", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUDgKx14QFTKbGyRf90hY79V5729adWjUn"], "labels": [], "masters": [], "uuids": ["0b67751f-15b1-4dde-8e88-ed2ecda5a3fa"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:53.623519", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.136286 s, 846 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.136286 s, 846 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:54.068 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2020-02-12T15:06:54.071 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Em4fhxjhfguqcmYQh4JsePn8vZUziuXkq'], u'uuids': [u'68979a14-3dd4-406a-9fde-0784e8ddb32f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.064688", "end": "2020-02-12 15:06:54.038153", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Em4fhxjhfguqcmYQh4JsePn8vZUziuXkq"], "labels": [], "masters": [], "uuids": ["68979a14-3dd4-406a-9fde-0784e8ddb32f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:52.973465", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot or after you\nrun partprobe(8) or kpartx(8)\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot or after you", "run partprobe(8) or kpartx(8)", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2020-02-12T15:06:54.073 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.133 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:54 +0000 (0:00:01.978) 0:01:55.280 **** 2020-02-12T15:06:54.134 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.141 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.143 INFO:teuthology.task.ansible.out:TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:54.144 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUeRGI55n2V8nfZYw36LiLsui0Y3QtJA1z'], u'uuids': [u'1a5734e0-2444-4173-a5aa-f72bed839017']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.138214", "end": "2020-02-12 15:06:54.081820", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-yAvQjNj1K5b2bVn8mGZhG0NApAAqXLoUeRGI55n2V8nfZYw36LiLsui0Y3QtJA1z"], "labels": [], "masters": [], "uuids": ["1a5734e0-2444-4173-a5aa-f72bed839017"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:53.943606", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.135625 s, 850 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.135625 s, 850 MB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:54.204 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:54 +0000 (0:00:00.070) 0:01:55.351 **** 2020-02-12T15:06:54.205 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.212 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGGP', u'wwn-0x5000c50092930050'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5XGGP', u'wwn': u'0x5000c50092930050', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'mq-deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1', u'wwn-0x5000c50092930050-part1'], u'uuids': [u'66e056a8-b246-4f81-96dd-96b23573000c']}, u'size': u'93 2020-02-12T15:06:54.214 INFO:teuthology.task.ansible.out:1.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP", "wwn-0x5000c50092930050"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5XGGP-part1", "wwn-0x5000c50092930050-part1"], "labels": [], "masters": [], "uuids": ["66e056a8-b246-4f81-96dd-96b23573000c"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "mq-deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5XGGP", "size": "931.51 GB", "support_discard": "0", "vendor": "ATA", "virtual": 1, "wwn": "0x5000c50092930050"}}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:54.396 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-MEMzNh-2Fvm-eCXA-WvIf-KzC4-0NHk-h66e1X', u'nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN', u'nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series', u'support_discard': u'512', u'model': u'INTEL SSDPED1D480GA', u'size': u'447.13 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'937703088', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [u'vg_nvme-lv_4', u'vg_nvme-lv_1', u'vg_nvme-lv_3', u'vg_nvme-lv_5', u'vg_nvme-lv_2'], u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.037610", "end": "2020-02-12 15:06:54.371421", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_4", "vg_nvme-lv_1", "vg_nvme-lv_3", "vg_nvme-lv_5", "vg_nvme-lv_2"], "host": "Non-Volatile memory controller: Intel Corporation Optane SSD 900P Series", "links": {"ids": ["lvm-pv-uuid-MEMzNh-2Fvm-eCXA-WvIf-KzC4-0NHk-h66e1X", "nvme-INTEL_SSDPED1D480GA_PHMB747600M7480DGN", "nvme-nvme.8086-50484d423734373630304d3734383044474e-494e54454c2053534450454431443438304741-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPED1D480GA", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "937703088", "sectorsize": "512", "size": "447.13 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:54.333811", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 2020-02-12T15:06:54.397 INFO:teuthology.task.ansible.out: 0.0349616 s, 3.3 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0349616 s, 3.3 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:54.450 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-02-12T15:06:54.450 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.053609", "end": "2020-02-12 15:06:54.422857", "rc": 0, "start": "2020-02-12 15:06:54.369248", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:54.492 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:54 +0000 (0:00:00.288) 0:01:55.639 **** 2020-02-12T15:06:54.493 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.687 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:54.689 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EvCpd7Ejcal8l0qN7BTh8nRokyNRK8HPW'], u'uuids': [u'0a67034e-64fb-4991-9868-4ee98e8363d6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.101818", "end": "2020-02-12 15:06:54.656003", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EvCpd7Ejcal8l0qN7BTh8nRokyNRK8HPW"], "labels": [], "masters": [], "uuids": ["0a67034e-64fb-4991-9868-4ee98e8363d6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:54.554185", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0992168 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0992168 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:54.732 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-02-12T15:06:54.733 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.045970", "end": "2020-02-12 15:06:54.705731", "rc": 0, "start": "2020-02-12 15:06:54.659761", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:54.774 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:54 +0000 (0:00:00.278) 0:01:55.917 **** 2020-02-12T15:06:54.799 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-02-12T15:06:54.845 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:54 +0000 (0:00:00.074) 0:01:55.992 **** 2020-02-12T15:06:54.846 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.875 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.876 INFO:teuthology.task.ansible.out:TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:54.917 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:54 +0000 (0:00:00.071) 0:01:56.064 **** 2020-02-12T15:06:54.918 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.954 INFO:teuthology.task.ansible.out: 2020-02-12T15:06:54.956 INFO:teuthology.task.ansible.out:TASK [testnode : Write partition entries to {{ item.0.device }}] *************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.011 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.093) 0:01:56.158 **** 2020-02-12T15:06:55.019 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:55.021 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Er7LpSqytQkYs60VguV0pcl4KaQLmPJ3k'], u'uuids': [u'244022cc-3b6a-40e9-93b9-16dbb33ee359']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.101935", "end": "2020-02-12 15:06:54.945419", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Er7LpSqytQkYs60VguV0pcl4KaQLmPJ3k"], "labels": [], "masters": [], "uuids": ["244022cc-3b6a-40e9-93b9-16dbb33ee359"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:54.843484", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0992326 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0992326 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:55.034 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-12T15:06:55.035 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.081 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.065) 0:01:56.224 **** 2020-02-12T15:06:55.115 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-02-12T15:06:55.116 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.162 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.084) 0:01:56.308 **** 2020-02-12T15:06:55.261 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:55.262 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EBIIfOeOxgXqgNf8fh3UbesWlOaLB9nqz'], u'uuids': [u'8014201d-393e-4294-aa4e-5a7bcf9709cd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.100334", "end": "2020-02-12 15:06:55.234132", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EBIIfOeOxgXqgNf8fh3UbesWlOaLB9nqz"], "labels": [], "masters": [], "uuids": ["8014201d-393e-4294-aa4e-5a7bcf9709cd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:55.133798", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0977123 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0977123 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:55.346 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-02-12T15:06:55.348 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:06:55.387 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.225) 0:01:56.534 **** 2020-02-12T15:06:55.423 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T15:06:55.425 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={u'block_used': 12958745, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227136363, u'size_available': 930350542848, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989887, u'device': u'/dev/sda1', u'inode_used': 65089, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227136363, "block_size": 4096, "block_total": 240095108, "block_used": 12958745, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989887, "inode_total": 61054976, "inode_used": 65089, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930350542848, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.462 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.075) 0:01:56.609 **** 2020-02-12T15:06:55.499 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-02-12T15:06:55.500 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.541 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.078) 0:01:56.688 **** 2020-02-12T15:06:55.547 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:55.548 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EOygEKuo7yuiZJ85MOzSuhcrWXxcv48Zw'], u'uuids': [u'05fdc595-57f7-458e-b8bd-3d76d7969a33']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.100261", "end": "2020-02-12 15:06:55.518529", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7EOygEKuo7yuiZJ85MOzSuhcrWXxcv48Zw"], "labels": [], "masters": [], "uuids": ["05fdc595-57f7-458e-b8bd-3d76d7969a33"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:55.418268", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0976076 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0976076 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:55.570 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:06:55.572 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.607 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.066) 0:01:56.754 **** 2020-02-12T15:06:55.634 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:06:55.635 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.673 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.065) 0:01:56.820 **** 2020-02-12T15:06:55.699 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-02-12T15:06:55.700 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.738 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.064) 0:01:56.885 **** 2020-02-12T15:06:55.765 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-02-12T15:06:55.766 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.802 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.064) 0:01:56.949 **** 2020-02-12T15:06:55.832 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:55.833 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Em4fhxjhfguqcmYQh4JsePn8vZUziuXkq'], u'uuids': [u'68979a14-3dd4-406a-9fde-0784e8ddb32f']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'model': None, u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'holders': [], u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.099716", "end": "2020-02-12 15:06:55.803492", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-agp6baWaNMNOFl3Xs0BBRx7hZLkF1w7Em4fhxjhfguqcmYQh4JsePn8vZUziuXkq"], "labels": [], "masters": [], "uuids": ["68979a14-3dd4-406a-9fde-0784e8ddb32f"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2020-02-12 15:06:55.703776", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB, 110 MiB) copied, 0.0970754 s, 1.2 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB, 110 MiB) copied, 0.0970754 s, 1.2 GB/s"], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:55.835 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:55.837 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2020-02-12T15:06:55.878 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.076) 0:01:57.025 **** 2020-02-12T15:06:55.913 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:55 +0000 (0:00:00.034) 0:01:57.060 **** 2020-02-12T15:06:56.180 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2020-02-12T15:06:56.181 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.053299", "end": "2020-02-12 15:06:56.144424", "rc": 0, "start": "2020-02-12 15:06:56.091125", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:56.231 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.318) 0:01:57.378 **** 2020-02-12T15:06:56.472 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2020-02-12T15:06:56.472 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.050556", "end": "2020-02-12 15:06:56.448995", "rc": 0, "start": "2020-02-12 15:06:56.398439", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:06:56.515 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.283) 0:01:57.661 **** 2020-02-12T15:06:56.541 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2020-02-12T15:06:56.581 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.066) 0:01:57.728 **** 2020-02-12T15:06:56.602 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2020-02-12T15:06:56.603 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-02-12T15:06:56.604 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2020-02-12T15:06:56.608 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:56.649 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.068) 0:01:57.796 **** 2020-02-12T15:06:56.689 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.039) 0:01:57.836 **** 2020-02-12T15:06:56.717 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2020-02-12T15:06:56.718 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:56.771 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.082) 0:01:57.918 **** 2020-02-12T15:06:56.798 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-12T15:06:56.800 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:56.838 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.066) 0:01:57.984 **** 2020-02-12T15:06:56.864 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2020-02-12T15:06:56.866 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:56.902 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:56 +0000 (0:00:00.063) 0:01:58.048 **** 2020-02-12T15:06:57.096 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2020-02-12T15:06:57.098 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2020-02-12T15:06:57.142 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.240) 0:01:58.289 **** 2020-02-12T15:06:57.181 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2020-02-12T15:06:57.182 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={u'block_used': 12962438, u'uuid': u'66e056a8-b246-4f81-96dd-96b23573000c', u'size_total': 983429562368, u'block_total': 240095108, u'mount': u'/', u'block_available': 227132670, u'size_available': 930335416320, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60989889, u'device': u'/dev/sda1', u'inode_used': 65087, u'block_size': 4096, u'options': u'rw,seclabel,relatime'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227132670, "block_size": 4096, "block_total": 240095108, "block_used": 12962438, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60989889, "inode_total": 61054976, "inode_used": 65087, "mount": "/", "options": "rw,seclabel,relatime", "size_available": 930335416320, "size_total": 983429562368, "uuid": "66e056a8-b246-4f81-96dd-96b23573000c"}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:57.220 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.077) 0:01:58.366 **** 2020-02-12T15:06:57.246 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2020-02-12T15:06:57.247 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:57.285 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.065) 0:01:58.432 **** 2020-02-12T15:06:57.294 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:57.313 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:06:57.314 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:57.370 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.084) 0:01:58.517 **** 2020-02-12T15:06:57.406 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:06:57.408 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:57.468 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.098) 0:01:58.615 **** 2020-02-12T15:06:57.494 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2020-02-12T15:06:57.495 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:57.538 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.069) 0:01:58.684 **** 2020-02-12T15:06:57.568 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2020-02-12T15:06:57.569 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:57.608 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.069) 0:01:58.754 **** 2020-02-12T15:06:57.612 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-12T15:06:57.613 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:57.635 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2020-02-12T15:06:57.636 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:57.672 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:57 +0000 (0:00:00.064) 0:01:58.819 **** 2020-02-12T15:06:57.933 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-12T15:06:57.934 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:58.141 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2020-02-12T15:06:58.171 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:58 +0000 (0:00:00.498) 0:01:59.318 **** 2020-02-12T15:06:58.271 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-12T15:06:58.273 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:58.534 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:58.598 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:58.643 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:58 +0000 (0:00:00.472) 0:01:59.790 **** 2020-02-12T15:06:58.855 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-12T15:06:58.857 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-02-12T15:06:58.909 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:58 +0000 (0:00:00.265) 0:02:00.056 **** 2020-02-12T15:06:58.915 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-12T15:06:58.916 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:58.951 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-12T15:06:58.953 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-02-12T15:06:59.145 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:06:59.229 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:59.325 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-12T15:06:59.327 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:06:59.502 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:06:59.586 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:59.694 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** changed: [smithi105.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:06:59.732 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:59 +0000 (0:00:00.823) 0:02:00.879 **** 2020-02-12T15:06:59.915 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2020-02-12T15:06:59.916 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2020-02-12T15:06:59.959 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:06:59 +0000 (0:00:00.226) 0:02:01.106 **** 2020-02-12T15:06:59.966 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-02-12T15:06:59.967 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T15:07:00.007 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:00 +0000 (0:00:00.047) 0:02:01.154 **** 2020-02-12T15:07:00.044 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-02-12T15:07:00.045 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-02-12T15:07:00.104 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:00 +0000 (0:00:00.097) 0:02:01.251 **** 2020-02-12T15:07:00.153 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2020-02-12T15:07:00.154 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2020-02-12T15:07:00.191 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:00 +0000 (0:00:00.087) 0:02:01.338 **** 2020-02-12T15:07:00.228 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2020-02-12T15:07:00.230 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:00.422 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:07:00.600 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:07:00.790 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:07:00.979 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2020-02-12T15:07:01.024 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:01 +0000 (0:00:00.832) 0:02:02.171 **** 2020-02-12T15:07:01.227 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2020-02-12T15:07:01.228 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2020-02-12T15:07:01.265 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:01 +0000 (0:00:00.240) 0:02:02.411 **** 2020-02-12T15:07:01.300 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2020-02-12T15:07:01.302 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2020-02-12T15:07:01.340 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:01 +0000 (0:00:00.075) 0:02:02.487 **** 2020-02-12T15:07:01.574 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2020-02-12T15:07:01.575 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true} 2020-02-12T15:07:01.612 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:01 +0000 (0:00:00.272) 0:02:02.759 **** 2020-02-12T15:07:01.680 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true} 2020-02-12T15:07:01.718 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:01 +0000 (0:00:00.106) 0:02:02.865 **** 2020-02-12T15:07:02.203 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2020-02-12T15:07:02.204 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-02-12T15:07:02.255 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.536) 0:02:03.401 **** 2020-02-12T15:07:02.260 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2020-02-12T15:07:02.299 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.044) 0:02:03.446 **** 2020-02-12T15:07:02.304 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2020-02-12T15:07:02.306 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.344 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.044) 0:02:03.491 **** 2020-02-12T15:07:02.349 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.386 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.042) 0:02:03.533 **** 2020-02-12T15:07:02.392 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2020-02-12T15:07:02.393 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.437 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.050) 0:02:03.584 **** 2020-02-12T15:07:02.442 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.480 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.042) 0:02:03.627 **** 2020-02-12T15:07:02.485 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2020-02-12T15:07:02.487 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.522 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.042) 0:02:03.669 **** 2020-02-12T15:07:02.527 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.571 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.048) 0:02:03.718 **** 2020-02-12T15:07:02.576 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2020-02-12T15:07:02.578 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.615 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.043) 0:02:03.762 **** 2020-02-12T15:07:02.620 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.658 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.043) 0:02:03.805 **** 2020-02-12T15:07:02.665 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2020-02-12T15:07:02.666 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.701 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.042) 0:02:03.848 **** 2020-02-12T15:07:02.706 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.744 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.042) 0:02:03.891 **** 2020-02-12T15:07:02.749 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2020-02-12T15:07:02.750 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.787 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.042) 0:02:03.933 **** 2020-02-12T15:07:02.792 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.829 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.042) 0:02:03.976 **** 2020-02-12T15:07:02.834 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2020-02-12T15:07:02.835 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.875 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.046) 0:02:04.022 **** 2020-02-12T15:07:02.883 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.924 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.045) 0:02:04.068 **** 2020-02-12T15:07:02.928 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2020-02-12T15:07:02.930 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:02.968 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:02 +0000 (0:00:00.046) 0:02:04.115 **** 2020-02-12T15:07:02.973 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:03.012 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.044) 0:02:04.159 **** 2020-02-12T15:07:03.018 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2020-02-12T15:07:03.020 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:03.057 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.044) 0:02:04.203 **** 2020-02-12T15:07:03.062 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:03.103 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.046) 0:02:04.250 **** 2020-02-12T15:07:03.111 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2020-02-12T15:07:03.112 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:03.150 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.047) 0:02:04.297 **** 2020-02-12T15:07:03.156 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:03.196 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.045) 0:02:04.343 **** 2020-02-12T15:07:03.202 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2020-02-12T15:07:03.202 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:03.244 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.045) 0:02:04.389 **** 2020-02-12T15:07:03.247 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:03.285 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.043) 0:02:04.432 **** 2020-02-12T15:07:03.713 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2020-02-12T15:07:03.713 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-02-12T15:07:03.751 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.465) 0:02:04.897 **** 2020-02-12T15:07:03.766 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "a7ecef00073feab34f868065d34e9dac55134241", "dest": "/etc/chrony.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/chrony.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 215, "state": "file", "uid": 0} 2020-02-12T15:07:03.802 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:03 +0000 (0:00:00.051) 0:02:04.949 **** 2020-02-12T15:07:04.065 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 15:04:17 UTC", "ActiveEnterTimestampMonotonic": "12116181", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "-.mount sntp.service systemd-tmpfiles-setup.service basic.target systemd-journald.socket ntpd.service sysinit.target system.slice tmp.mount ntpdate.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 15:04:16 UTC", "AssertTimestampMonotonic": "10722303", "Before": "shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 15:04:16 UTC", "ConditionTimestampMonotonic": "10722282", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service ntpd.service shutdown.target", "ControlGroup": "/system.slice/chronyd.servic 2020-02-12T15:07:04.066 INFO:teuthology.task.ansible.out:e", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "1583", "ExecMainStartTimestamp": "Wed 2020-02-12 15:04:17 UTC", "ExecMainStartTimestampMonotonic": "12028659", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 15:04:16 UTC", "InactiveExitTimestampMonotonic": "11052411", "InvocationID": "8dc409a2d9ab4a00b5259b76b0b01163", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infini 2020-02-12T15:07:04.068 INFO:teuthology.task.ansible.out:ty", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "16777216", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "62925", "LimitNPROCSoft": "62925", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "62925", "LimitSIGPENDINGSoft": "62925", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "1583", "MemoryAccounting": "yes", "MemoryCurrent": "2760704", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "-.mount sysinit.target system.slice", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0 2020-02-12T15:07:04.069 INFO:teuthology.task.ansible.out:", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 15:04:17 UTC", "StateChangeTimestampMonotonic": "12116181", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 15:04:17 UTC", "WatchdogTimestampMonotonic": "12028673", "WatchdogUSec": "0"}} 2020-02-12T15:07:04.121 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.318) 0:02:05.268 **** 2020-02-12T15:07:04.129 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "chronyd", "state": "started", "status": {"ActiveEnterTimestamp": "Wed 2020-02-12 15:01:38 UTC", "ActiveEnterTimestampMonotonic": "13973268", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-tmpfiles-setup.service system.slice sysinit.target systemd-journald.socket sntp.service ntpdate.service tmp.mount -.mount basic.target ntpd.service", "AllowIsolate": "no", "AmbientCapabilities": "", "AssertResult": "yes", "AssertTimestamp": "Wed 2020-02-12 15:01:37 UTC", "AssertTimestampMonotonic": "12900783", "Before": "multi-user.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "[not set]", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "[not set]", "CPUUsageNSec": "[not set]", "CPUWeight": "[not set]", "CacheDirectoryMode": "0755", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "cap_chown cap_dac_override cap_dac_read_search cap_fowner cap_fsetid cap_kill cap_setgid cap_setuid cap_setpcap cap_linux_immutable cap_net_bind_service cap_net_broadcast cap_net_admin cap_net_raw cap_ipc_lock cap_ipc_owner cap_sys_module cap_sys_rawio cap_sys_chroot cap_sys_ptrace cap_sys_pacct cap_sys_admin cap_sys_boot cap_sys_nice cap_sys_resource cap_sys_time cap_sys_tty_config cap_mknod cap_lease cap_audit_write cap_audit_control cap_setfcap cap_mac_override cap_mac_admin cap_syslog cap_wake_alarm cap_block_suspend", "CollectMode": "inactive", "ConditionResult": "yes", "ConditionTimestamp": "Wed 2020-02-12 15:01:37 UTC", "ConditionTimestampMonotonic": "12900758", "ConfigurationDirectoryMode": "0755", "Conflicts": "systemd-timesyncd.service shutdown.target ntpd.service", "ControlGroup": "/system.slice/chronyd.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description" 2020-02-12T15:07:04.131 INFO:teuthology.task.ansible.out:: "NTP client/server", "DevicePolicy": "auto", "Documentation": "man:chronyd(8) man:chrony.conf(5)", "DynamicUser": "no", "EnvironmentFiles": "/etc/sysconfig/chronyd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "2337", "ExecMainStartTimestamp": "Wed 2020-02-12 15:01:38 UTC", "ExecMainStartTimestampMonotonic": "13811420", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/chronyd ; argv[]=/usr/sbin/chronyd $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStartPost": "{ path=/usr/libexec/chrony-helper ; argv[]=/usr/libexec/chrony-helper update-daemon ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/chronyd.service", "GID": "[not set]", "GuessMainPID": "yes", "IOAccounting": "no", "IOSchedulingClass": "0", "IOSchedulingPriority": "0", "IOWeight": "[not set]", "IPAccounting": "no", "IPEgressBytes": "18446744073709551615", "IPEgressPackets": "18446744073709551615", "IPIngressBytes": "18446744073709551615", "IPIngressPackets": "18446744073709551615", "Id": "chronyd.service", "IgnoreOnIsolate": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Wed 2020-02-12 15:01:37 UTC", "InactiveExitTimestampMonotonic": "12947856", "InvocationID": "da46d0c6628949a6995d58b87698e2f7", "JobRunningTimeoutUSec": "infinity", "JobTimeoutAction": "none", "JobTimeoutUSec": "infinity", "KeyringMode": "private", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "infinity", "LimitASSoft": "infinity", "LimitCORE": "infinity", "LimitCORESoft": "infinity", "LimitCPU": "infinity", "LimitCPUSoft": "infinity", "LimitDATA": "infinity", "LimitDATASoft": "infinity", "LimitFSIZE": "infinity", "LimitFSIZESoft": "infinity", "LimitLOCKS": "infinity", "LimitLOCKSSoft": "infinity", "LimitMEMLOCK": "167772 2020-02-12T15:07:04.133 INFO:teuthology.task.ansible.out:16", "LimitMEMLOCKSoft": "16777216", "LimitMSGQUEUE": "819200", "LimitMSGQUEUESoft": "819200", "LimitNICE": "0", "LimitNICESoft": "0", "LimitNOFILE": "4096", "LimitNOFILESoft": "1024", "LimitNPROC": "127443", "LimitNPROCSoft": "127443", "LimitRSS": "infinity", "LimitRSSSoft": "infinity", "LimitRTPRIO": "0", "LimitRTPRIOSoft": "0", "LimitRTTIME": "infinity", "LimitRTTIMESoft": "infinity", "LimitSIGPENDING": "127443", "LimitSIGPENDINGSoft": "127443", "LimitSTACK": "infinity", "LimitSTACKSoft": "8388608", "LoadState": "loaded", "LockPersonality": "no", "LogLevelMax": "-1", "LogsDirectoryMode": "0755", "MainPID": "2337", "MemoryAccounting": "yes", "MemoryCurrent": "2842624", "MemoryDenyWriteExecute": "no", "MemoryHigh": "infinity", "MemoryLimit": "infinity", "MemoryLow": "0", "MemoryMax": "infinity", "MemorySwapMax": "infinity", "MountAPIVFS": "no", "MountFlags": "", "NFileDescriptorStore": "0", "NRestarts": "0", "Names": "chronyd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PIDFile": "/run/chrony/chronyd.pid", "PermissionsStartOnly": "no", "Perpetual": "no", "PrivateDevices": "no", "PrivateMounts": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "PrivateUsers": "no", "ProtectControlGroups": "no", "ProtectHome": "yes", "ProtectKernelModules": "no", "ProtectKernelTunables": "no", "ProtectSystem": "full", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "RemoveIPC": "no", "Requires": "system.slice -.mount sysinit.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "RestrictNamespaces": "no", "RestrictRealtime": "no", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "RuntimeDirectoryPreserve": "no", "RuntimeMaxUSec": "infinity", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardE 2020-02-12T15:07:04.134 INFO:teuthology.task.ansible.out:rror": "inherit", "StandardInput": "null", "StandardInputData": "", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitIntervalUSec": "10s", "StartupBlockIOWeight": "[not set]", "StartupCPUShares": "[not set]", "StartupCPUWeight": "[not set]", "StartupIOWeight": "[not set]", "StateChangeTimestamp": "Wed 2020-02-12 15:01:38 UTC", "StateChangeTimestampMonotonic": "13973268", "StateDirectoryMode": "0755", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SuccessAction": "none", "SyslogFacility": "3", "SyslogLevel": "6", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "yes", "TasksCurrent": "1", "TasksMax": "26213", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "forking", "UID": "[not set]", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "enabled", "UtmpMode": "init", "WantedBy": "multi-user.target", "WatchdogTimestamp": "Wed 2020-02-12 15:01:38 UTC", "WatchdogTimestampMonotonic": "13811435", "WatchdogUSec": "0"}} 2020-02-12T15:07:04.170 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.048) 0:02:05.316 **** 2020-02-12T15:07:04.175 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2020-02-12T15:07:04.176 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:04.215 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.045) 0:02:05.362 **** 2020-02-12T15:07:04.220 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:04.266 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.050) 0:02:05.413 **** 2020-02-12T15:07:04.273 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2020-02-12T15:07:04.275 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:04.315 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.049) 0:02:05.462 **** 2020-02-12T15:07:04.322 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:04.366 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.046) 0:02:05.509 **** 2020-02-12T15:07:04.370 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2020-02-12T15:07:04.371 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:04.417 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.054) 0:02:05.564 **** 2020-02-12T15:07:04.422 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:04.461 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.044) 0:02:05.608 **** 2020-02-12T15:07:04.613 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2020-02-12T15:07:04.614 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-02-12T15:07:04.650 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.188) 0:02:05.797 **** 2020-02-12T15:07:04.673 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2020-02-12T15:07:04.707 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:04 +0000 (0:00:00.056) 0:02:05.854 **** 2020-02-12T15:07:05.133 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2020-02-12T15:07:05.134 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-02-12T15:07:05.212 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:05 +0000 (0:00:00.505) 0:02:06.359 **** 2020-02-12T15:07:05.219 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1209, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2020-02-12T15:07:05.261 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:05 +0000 (0:00:00.048) 0:02:06.408 **** 2020-02-12T15:07:06.485 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-02-12T15:07:06.487 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-02-12T15:07:06.523 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:06 +0000 (0:00:01.261) 0:02:07.670 **** 2020-02-12T15:07:06.549 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-02-12T15:07:06.550 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:06.589 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:06 +0000 (0:00:00.066) 0:02:07.736 **** 2020-02-12T15:07:06.595 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2020-02-12T15:07:06.596 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip3", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead.\n", "stderr_lines": ["WARNING: Running pip install with root privileges is generally not a good idea. Try `pip3 install --user` instead."], "stdout": "Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages\nRequirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)\nRequirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied: remoto>=0.0.35 in /usr/local/lib/python3.6/site-packages", "Requirement already satisfied: execnet in /usr/local/lib/python3.6/site-packages (from remoto>=0.0.35)", "Requirement already satisfied: apipkg>=1.4 in /usr/local/lib/python3.6/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2020-02-12T15:07:06.650 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:06 +0000 (0:00:00.061) 0:02:07.797 **** 2020-02-12T15:07:06.652 INFO:teuthology.task.ansible.out: 2020-02-12T15:07:06.656 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-02-12T15:07:06.658 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-02-12T15:07:06.703 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:06 +0000 (0:00:00.052) 0:02:07.849 **** 2020-02-12T15:07:06.710 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2020-02-12T15:07:06.711 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:06.751 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:06 +0000 (0:00:00.047) 0:02:07.897 **** 2020-02-12T15:07:06.787 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2020-02-12T15:07:06.789 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2020-02-12T15:07:06.840 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:06 +0000 (0:00:00.089) 0:02:07.987 **** 2020-02-12T15:07:06.888 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-02-12T15:07:06.895 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2020-02-12T15:07:06.952 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:06 +0000 (0:00:00.111) 0:02:08.099 **** 2020-02-12T15:07:06.979 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-02-12T15:07:06.980 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.022 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.070) 0:02:08.169 **** 2020-02-12T15:07:07.048 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2020-02-12T15:07:07.050 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** ok: [smithi105.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-02-12T15:07:07.092 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.069) 0:02:08.239 **** 2020-02-12T15:07:07.126 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.034) 0:02:08.273 **** 2020-02-12T15:07:07.131 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-02-12T15:07:07.132 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.170 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.044) 0:02:08.317 **** 2020-02-12T15:07:07.176 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2020-02-12T15:07:07.178 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.225 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.051) 0:02:08.369 **** 2020-02-12T15:07:07.248 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2020-02-12T15:07:07.249 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2020-02-12T15:07:07.285 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.063) 0:02:08.432 **** 2020-02-12T15:07:07.311 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2020-02-12T15:07:07.312 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.355 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.069) 0:02:08.502 **** 2020-02-12T15:07:07.371 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2020-02-12T15:07:07.371 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-02-12T15:07:07.409 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.053) 0:02:08.556 **** 2020-02-12T15:07:07.552 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2020-02-12T15:07:07.598 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.188) 0:02:08.745 **** 2020-02-12T15:07:07.602 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-02-12T15:07:07.603 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-02-12T15:07:07.642 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.044) 0:02:08.789 **** 2020-02-12T15:07:07.668 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2020-02-12T15:07:07.670 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.709 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.066) 0:02:08.856 **** 2020-02-12T15:07:07.745 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-02-12T15:07:07.747 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.748 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.749 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.759 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.770 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.808 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.099) 0:02:08.955 **** 2020-02-12T15:07:07.814 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2020-02-12T15:07:07.815 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2020-02-12T15:07:07.860 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.051) 0:02:09.007 **** 2020-02-12T15:07:07.865 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-02-12T15:07:07.866 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.867 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.878 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.929 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.068) 0:02:09.076 **** 2020-02-12T15:07:07.934 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-02-12T15:07:07.934 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.936 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.937 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.977 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:07 +0000 (0:00:00.048) 0:02:09.124 **** 2020-02-12T15:07:07.983 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-02-12T15:07:07.985 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi180.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.995 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:07.996 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.037 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.059) 0:02:09.184 **** 2020-02-12T15:07:08.043 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2020-02-12T15:07:08.044 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.045 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.088 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.050) 0:02:09.234 **** 2020-02-12T15:07:08.093 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-02-12T15:07:08.094 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.160 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.071) 0:02:09.306 **** 2020-02-12T15:07:08.166 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2020-02-12T15:07:08.167 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.168 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.168 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.170 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.170 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.210 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.049) 0:02:09.356 **** 2020-02-12T15:07:08.215 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-02-12T15:07:08.216 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.265 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.055) 0:02:09.411 **** 2020-02-12T15:07:08.271 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2020-02-12T15:07:08.272 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.317 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.052) 0:02:09.464 **** 2020-02-12T15:07:08.323 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-02-12T15:07:08.325 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.367 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.050) 0:02:09.514 **** 2020-02-12T15:07:08.373 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2020-02-12T15:07:08.375 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.418 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.050) 0:02:09.564 **** 2020-02-12T15:07:08.423 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-02-12T15:07:08.425 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.465 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.047) 0:02:09.612 **** 2020-02-12T15:07:08.470 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2020-02-12T15:07:08.472 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.514 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.048) 0:02:09.660 **** 2020-02-12T15:07:08.519 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-12T15:07:08.519 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.561 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.047) 0:02:09.708 **** 2020-02-12T15:07:08.566 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2020-02-12T15:07:08.568 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.607 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.045) 0:02:09.754 **** 2020-02-12T15:07:08.612 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-02-12T15:07:08.613 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.653 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.045) 0:02:09.800 **** 2020-02-12T15:07:08.658 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2020-02-12T15:07:08.659 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.706 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.049) 0:02:09.849 **** 2020-02-12T15:07:08.708 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-12T15:07:08.708 INFO:teuthology.task.ansible.out:skipping: [smithi105.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.747 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.044) 0:02:09.894 **** 2020-02-12T15:07:08.752 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-12T15:07:08.754 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.795 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.047) 0:02:09.942 **** 2020-02-12T15:07:08.820 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2020-02-12T15:07:08.822 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.860 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.065) 0:02:10.007 **** 2020-02-12T15:07:08.886 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2020-02-12T15:07:08.887 INFO:teuthology.task.ansible.out:skipping: [smithi180.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2020-02-12T15:07:08.922 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:08 +0000 (0:00:00.062) 0:02:10.069 **** 2020-02-12T15:07:08.968 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-12T15:07:08.970 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.004753", "end": "2020-02-12 15:07:08.930673", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-02-12 15:07:08.925920", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.150 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.005170", "end": "2020-02-12 15:07:09.109581", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2020-02-12 15:07:09.104411", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.151 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002950", "end": "2020-02-12 15:07:09.116564", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-02-12 15:07:09.113614", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.328 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002818", "end": "2020-02-12 15:07:09.297745", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 15:07:09.294927", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.339 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.002956", "end": "2020-02-12 15:07:09.299110", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2020-02-12 15:07:09.296154", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.516 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.002824", "end": "2020-02-12 15:07:09.487320", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2020-02-12 15:07:09.484496", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.539 INFO:teuthology.task.ansible.out:ok: [smithi105.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.022979", "end": "2020-02-12 15:07:09.497046", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-02-12 15:07:09.474067", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.587 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:09 +0000 (0:00:00.664) 0:02:10.734 **** 2020-02-12T15:07:09.614 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-02-12T15:07:09.661 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:09 +0000 (0:00:00.073) 0:02:10.808 **** 2020-02-12T15:07:09.728 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2020-02-12T15:07:09.730 INFO:teuthology.task.ansible.out:ok: [smithi180.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.021266", "end": "2020-02-12 15:07:09.698705", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2020-02-12 15:07:09.677439", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2020-02-12T15:07:09.768 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:09 +0000 (0:00:00.107) 0:02:10.915 **** 2020-02-12T15:07:09.794 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2020-02-12T15:07:09.830 INFO:teuthology.task.ansible.out:Wednesday 12 February 2020 15:07:09 +0000 (0:00:00.062) 0:02:10.977 **** 2020-02-12T15:07:09.856 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2020-02-12T15:07:09.857 INFO:teuthology.task.ansible.out:changed: [smithi105.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T15:07:10.021 INFO:teuthology.task.ansible.out:changed: [smithi180.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2020-02-12T15:07:10.115 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2020-02-12T15:07:10.117 INFO:teuthology.task.ansible.out: 2020-02-12T15:07:10.118 INFO:teuthology.task.ansible.out:PLAY [paddles] ***************************************************************** skipping: no hosts matched 2020-02-12T15:07:10.120 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched PLAY RECAP ********************************************************************* smithi105.front.sepia.ceph.com : ok=109 changed=32 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 smithi180.front.sepia.ceph.com : ok=109 changed=33 unreachable=0 failed=0 skipped=172 rescued=0 ignored=3 Wednesday 12 February 2020 15:07:10 +0000 (0:00:00.289) 0:02:11.267 **** =============================================================================== 2020-02-12T15:07:10.126 INFO:teuthology.task.ansible.out:common : nrpe - Remove SELinux policy package -------------------------- 14.94s common : nrpe - Load SELinux policy package ---------------------------- 14.39s testnode : Zap all non-root disks --------------------------------------- 5.97s 2020-02-12T15:07:10.128 INFO:teuthology.task.ansible.out:testnode : Install packages --------------------------------------------- 5.76s testnode : Base group workaround for BZ1782899 -------------------------- 3.97s Gathering Facts --------------------------------------------------------- 2.51s testnode : Install packages via pip ------------------------------------- 1.26s common : Install Kerberos Packages (RedHat) ----------------------------- 1.19s common : nrpe - Set SELinux boolean nagios_run_sudo true ---------------- 1.14s testnode : Enable copr repos -------------------------------------------- 1.05s testnode : Make sure rpm dependencies are installed --------------------- 0.95s common : Configure local epel mirrorlists ------------------------------- 0.91s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 0.90s common : Configure epel repos in /etc/yum.repos.d/ ---------------------- 0.87s testnode : Write /scratch_devs ------------------------------------------ 0.83s testnode : Ensure ceph dependency packages are not present. ------------- 0.77s users : Create all admin users with sudo access. ------------------------ 0.74s Gathering Facts --------------------------------------------------------- 0.70s users : Write /keys-repo-sha1 sentinel file ----------------------------- 0.70s testnode : List any leftover Ceph artifacts from previous jobs ---------- 0.67s 2020-02-12T15:07:10.380 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi180.front.sepia.ceph.com'), Remote(name='ubuntu@smithi105.front.sepia.ceph.com')] 2020-02-12T15:07:10.382 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:07:10.382 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi180.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:07:10.451 INFO:teuthology.orchestra.run.smithi180:> true 2020-02-12T15:07:10.543 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2020-02-12T15:07:10.543 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi105.front.sepia.ceph.com', 'timeout': 60} 2020-02-12T15:07:10.611 INFO:teuthology.orchestra.run.smithi105:> true 2020-02-12T15:07:10.698 INFO:teuthology.run_tasks:Running task clock... 2020-02-12T15:07:10.708 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2020-02-12T15:07:10.709 INFO:teuthology.orchestra.run.smithi180:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-02-12T15:07:10.743 INFO:teuthology.orchestra.run.smithi180.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-02-12T15:07:10.762 INFO:teuthology.orchestra.run.smithi180.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-02-12T15:07:10.806 INFO:teuthology.orchestra.run.smithi180.stderr:sudo: ntpd: command not found 2020-02-12T15:07:10.820 INFO:teuthology.orchestra.run.smithi180.stdout:506 Cannot talk to daemon 2020-02-12T15:07:10.837 INFO:teuthology.orchestra.run.smithi180.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-02-12T15:07:10.854 INFO:teuthology.orchestra.run.smithi180.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-02-12T15:07:10.914 INFO:teuthology.orchestra.run.smithi180.stderr:bash: ntpq: command not found 2020-02-12T15:07:10.917 INFO:teuthology.orchestra.run.smithi180.stdout:210 Number of sources = 4 2020-02-12T15:07:10.917 INFO:teuthology.orchestra.run.smithi180.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-02-12T15:07:10.917 INFO:teuthology.orchestra.run.smithi180.stdout:=============================================================================== 2020-02-12T15:07:10.917 INFO:teuthology.orchestra.run.smithi180.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:10.917 INFO:teuthology.orchestra.run.smithi180.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:10.918 INFO:teuthology.orchestra.run.smithi180.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:10.918 INFO:teuthology.orchestra.run.smithi180.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:10.918 INFO:teuthology.orchestra.run.smithi105:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2020-02-12T15:07:10.953 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2020-02-12T15:07:10.971 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2020-02-12T15:07:11.015 INFO:teuthology.orchestra.run.smithi105.stderr:sudo: ntpd: command not found 2020-02-12T15:07:11.028 INFO:teuthology.orchestra.run.smithi105.stdout:506 Cannot talk to daemon 2020-02-12T15:07:11.046 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntp.service: Unit ntp.service not found. 2020-02-12T15:07:11.063 INFO:teuthology.orchestra.run.smithi105.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2020-02-12T15:07:11.125 INFO:teuthology.orchestra.run.smithi105.stderr:bash: ntpq: command not found 2020-02-12T15:07:11.129 INFO:teuthology.orchestra.run.smithi105.stdout:210 Number of sources = 4 2020-02-12T15:07:11.129 INFO:teuthology.orchestra.run.smithi105.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2020-02-12T15:07:11.129 INFO:teuthology.orchestra.run.smithi105.stdout:=============================================================================== 2020-02-12T15:07:11.129 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:11.129 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:11.130 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:11.130 INFO:teuthology.orchestra.run.smithi105.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2020-02-12T15:07:11.130 INFO:teuthology.run_tasks:Running task install... 2020-02-12T15:07:11.143 DEBUG:teuthology.task.install:project ceph 2020-02-12T15:07:11.143 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}} 2020-02-12T15:07:11.143 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'} 2020-02-12T15:07:11.143 INFO:teuthology.task.install:Using flavor: basic 2020-02-12T15:07:11.151 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2020-02-12T15:07:11.151 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']} 2020-02-12T15:07:11.151 INFO:teuthology.orchestra.run.smithi180:> sudo lsb_release -is 2020-02-12T15:07:11.189 INFO:teuthology.orchestra.run.smithi180.stdout:CentOS 2020-02-12T15:07:11.190 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T15:07:11.190 INFO:teuthology.orchestra.run.smithi105:> sudo lsb_release -is 2020-02-12T15:07:11.191 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-02-12T15:07:11.191 INFO:teuthology.orchestra.run.smithi180:> sudo lsb_release -is 2020-02-12T15:07:11.229 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS 2020-02-12T15:07:11.230 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T15:07:11.230 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'flavor': 'basic', 'extras': None} 2020-02-12T15:07:11.230 INFO:teuthology.orchestra.run.smithi105:> sudo lsb_release -is 2020-02-12T15:07:11.265 INFO:teuthology.orchestra.run.smithi180.stdout:CentOS 2020-02-12T15:07:11.266 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T15:07:11.267 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T15:07:11.304 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS 2020-02-12T15:07:11.306 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T15:07:11.306 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T15:07:11.422 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200211.222321/7df2194963eaa185d198b9c90e899c7e7ae9eb30/centos/8/flavors/default/ 2020-02-12T15:07:11.423 INFO:teuthology.task.install.rpm:Package version is 15.1.0-567.g7df2194 2020-02-12T15:07:11.462 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/wip-pdonnell-testing-20200211.222321/7df2194963eaa185d198b9c90e899c7e7ae9eb30/centos/8/flavors/default/ 2020-02-12T15:07:11.463 INFO:teuthology.task.install.rpm:Package version is 15.1.0-567.g7df2194 2020-02-12T15:07:11.552 INFO:teuthology.orchestra.run.smithi180:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-02-12T15:07:11.578 INFO:teuthology.orchestra.run.smithi105:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2020-02-12T15:07:11.598 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-02-12T15:07:11.598 INFO:teuthology.orchestra.run.smithi180:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7df2194963eaa185d198b9c90e899c7e7ae9eb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-02-12T15:07:11.623 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel on remote rpm x86_64 2020-02-12T15:07:11.624 INFO:teuthology.orchestra.run.smithi105:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/7df2194963eaa185d198b9c90e899c7e7ae9eb30/;g' /etc/yum.repos.d/ceph.repo ; fi 2020-02-12T15:07:11.666 INFO:teuthology.orchestra.run.smithi180:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-02-12T15:07:11.692 INFO:teuthology.orchestra.run.smithi105:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2020-02-12T15:07:11.747 INFO:teuthology.orchestra.run.smithi180:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-02-12T15:07:11.772 INFO:teuthology.orchestra.run.smithi105:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2020-02-12T15:07:11.813 INFO:teuthology.orchestra.run.smithi180.stdout:check_obsoletes = 1 2020-02-12T15:07:11.814 INFO:teuthology.orchestra.run.smithi180:> sudo yum clean all 2020-02-12T15:07:11.839 INFO:teuthology.orchestra.run.smithi105.stdout:check_obsoletes = 1 2020-02-12T15:07:11.840 INFO:teuthology.orchestra.run.smithi105:> sudo yum clean all 2020-02-12T15:07:12.174 INFO:teuthology.orchestra.run.smithi180.stdout:235 files removed 2020-02-12T15:07:12.201 INFO:teuthology.orchestra.run.smithi105.stdout:235 files removed 2020-02-12T15:07:12.202 INFO:teuthology.orchestra.run.smithi180:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-02-12T15:07:12.229 INFO:teuthology.orchestra.run.smithi105:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel 2020-02-12T15:07:12.762 INFO:teuthology.orchestra.run.smithi180.stdout:ceph packages for x86_64 315 kB/s | 69 kB 00:00 2020-02-12T15:07:12.788 INFO:teuthology.orchestra.run.smithi105.stdout:ceph packages for x86_64 315 kB/s | 69 kB 00:00 2020-02-12T15:07:12.972 INFO:teuthology.orchestra.run.smithi180.stdout:ceph noarch packages 67 kB/s | 12 kB 00:00 2020-02-12T15:07:12.996 INFO:teuthology.orchestra.run.smithi105.stdout:ceph noarch packages 68 kB/s | 12 kB 00:00 2020-02-12T15:07:13.173 INFO:teuthology.orchestra.run.smithi180.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2020-02-12T15:07:13.199 INFO:teuthology.orchestra.run.smithi105.stdout:ceph source packages 7.6 kB/s | 1.4 kB 00:00 2020-02-12T15:07:13.451 INFO:teuthology.orchestra.run.smithi180.stdout:CentOS-8 - AppStream 25 MB/s | 6.4 MB 00:00 2020-02-12T15:07:13.696 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - AppStream 13 MB/s | 6.4 MB 00:00 2020-02-12T15:07:15.003 INFO:teuthology.orchestra.run.smithi180.stdout:CentOS-8 - Base 9.2 MB/s | 5.0 MB 00:00 2020-02-12T15:07:15.251 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - Base 8.8 MB/s | 5.0 MB 00:00 2020-02-12T15:07:16.128 INFO:teuthology.orchestra.run.smithi180.stdout:CentOS-8 - Extras 5.0 kB/s | 2.1 kB 00:00 2020-02-12T15:07:16.469 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS-8 - Extras 4.0 kB/s | 2.1 kB 00:00 2020-02-12T15:07:16.628 INFO:teuthology.orchestra.run.smithi180.stdout:Copr repo for ceph-el8 owned by ktdreyer 83 kB/s | 38 kB 00:00 2020-02-12T15:07:16.832 INFO:teuthology.orchestra.run.smithi105.stdout:Copr repo for ceph-el8 owned by ktdreyer 119 kB/s | 38 kB 00:00 2020-02-12T15:07:17.089 INFO:teuthology.orchestra.run.smithi180.stdout:Extra Packages for Enterprise Linux 14 MB/s | 5.6 MB 00:00 2020-02-12T15:07:17.990 INFO:teuthology.orchestra.run.smithi105.stdout:Extra Packages for Enterprise Linux 5.1 MB/s | 5.6 MB 00:01 2020-02-12T15:07:18.260 INFO:teuthology.orchestra.run.smithi180.stdout:lab-extras 6.0 MB/s | 33 kB 00:00 2020-02-12T15:07:19.136 INFO:teuthology.orchestra.run.smithi180.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T15:07:19.137 INFO:teuthology.orchestra.run.smithi180.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T15:07:19.139 INFO:teuthology.orchestra.run.smithi105.stdout:lab-extras 6.2 MB/s | 33 kB 00:00 2020-02-12T15:07:19.140 INFO:teuthology.orchestra.run.smithi180.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-02-12T15:07:19.140 INFO:teuthology.orchestra.run.smithi180.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-02-12T15:07:19.141 INFO:teuthology.orchestra.run.smithi180.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-02-12T15:07:19.142 INFO:teuthology.orchestra.run.smithi180.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-02-12T15:07:19.262 INFO:teuthology.orchestra.run.smithi180.stdout:Dependencies resolved. 2020-02-12T15:07:19.273 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:07:19.273 INFO:teuthology.orchestra.run.smithi180.stdout: Package ArchVersion Repository Size 2020-02-12T15:07:19.273 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:07:19.274 INFO:teuthology.orchestra.run.smithi180.stdout:Installing: 2020-02-12T15:07:19.274 INFO:teuthology.orchestra.run.smithi180.stdout: ceph x86_642:15.1.0-567.g7df2194.el8 ceph 6.4 k 2020-02-12T15:07:19.274 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-base x86_642:15.1.0-567.g7df2194.el8 ceph 5.5 M 2020-02-12T15:07:19.274 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 571 k 2020-02-12T15:07:19.274 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-immutable-object-cache x86_642:15.1.0-567.g7df2194.el8 ceph 202 k 2020-02-12T15:07:19.274 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr x86_642:15.1.0-567.g7df2194.el8 ceph 1.5 M 2020-02-12T15:07:19.274 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-radosgw x86_642:15.1.0-567.g7df2194.el8 ceph 9.7 M 2020-02-12T15:07:19.275 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-test x86_642:15.1.0-567.g7df2194.el8 ceph 41 M 2020-02-12T15:07:19.275 INFO:teuthology.orchestra.run.smithi180.stdout: cephadm x86_642:15.1.0-567.g7df2194.el8 ceph 32 k 2020-02-12T15:07:19.275 INFO:teuthology.orchestra.run.smithi180.stdout: libcephfs-devel x86_642:15.1.0-567.g7df2194.el8 ceph 21 k 2020-02-12T15:07:19.275 INFO:teuthology.orchestra.run.smithi180.stdout: libcephfs2 x86_642:15.1.0-567.g7df2194.el8 ceph 507 k 2020-02-12T15:07:19.275 INFO:teuthology.orchestra.run.smithi180.stdout: librados-devel x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T15:07:19.275 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cephfs x86_642:15.1.0-567.g7df2194.el8 ceph 149 k 2020-02-12T15:07:19.275 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rados x86_642:15.1.0-567.g7df2194.el8 ceph 351 k 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rbd x86_642:15.1.0-567.g7df2194.el8 ceph 309 k 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rgw x86_642:15.1.0-567.g7df2194.el8 ceph 113 k 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: rbd-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 72 k 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: rbd-mirror x86_642:15.1.0-567.g7df2194.el8 ceph 2.6 M 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: rbd-nbd x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-cephadm noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 29 k 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-dashboard noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 3.8 M 2020-02-12T15:07:19.276 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-diskprediction-local noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 8.6 M 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-rook noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 17 k 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: bison x86_643.0.4-10.el8 AppStream 688 k 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: flex x86_642.6.1-9.el8 AppStream 320 k 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: libtool x86_642.4.6-25.el8 AppStream 709 k 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: elfutils-libelf-devel x86_640.176-5.el8 BaseOS 54 k 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: libaio-devel x86_640.3.112-1.el8 BaseOS 19 k 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: libuuid-devel x86_642.32.1-17.el8 BaseOS 95 k 2020-02-12T15:07:19.277 INFO:teuthology.orchestra.run.smithi180.stdout: openssl-devel x86_641:1.1.1c-2.el8 BaseOS 2.3 M 2020-02-12T15:07:19.278 INFO:teuthology.orchestra.run.smithi180.stdout: xfsprogs-devel x86_645.0.0-1.el8 BaseOS 69 k 2020-02-12T15:07:19.278 INFO:teuthology.orchestra.run.smithi180.stdout:Upgrading: 2020-02-12T15:07:19.278 INFO:teuthology.orchestra.run.smithi180.stdout: librados2 x86_642:15.1.0-567.g7df2194.el8 ceph 3.6 M 2020-02-12T15:07:19.278 INFO:teuthology.orchestra.run.smithi180.stdout: librbd1 x86_642:15.1.0-567.g7df2194.el8 ceph 1.9 M 2020-02-12T15:07:19.278 INFO:teuthology.orchestra.run.smithi180.stdout:Installing dependencies: 2020-02-12T15:07:19.278 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 21 M 2020-02-12T15:07:19.278 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mds x86_642:15.1.0-567.g7df2194.el8 ceph 2.0 M 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mon x86_642:15.1.0-567.g7df2194.el8 ceph 4.3 M 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-osd x86_642:15.1.0-567.g7df2194.el8 ceph 17 M 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-selinux x86_642:15.1.0-567.g7df2194.el8 ceph 25 k 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: libradosstriper1 x86_642:15.1.0-567.g7df2194.el8 ceph 377 k 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: librgw2 x86_642:15.1.0-567.g7df2194.el8 ceph 6.2 M 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: python3-ceph-argparse x86_642:15.1.0-567.g7df2194.el8 ceph 40 k 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: python3-ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 51 k 2020-02-12T15:07:19.279 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-grafana-dashboards noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 22 k 2020-02-12T15:07:19.280 INFO:teuthology.orchestra.run.smithi180.stdout: automake noarch1.16.1-6.el8 AppStream 713 k 2020-02-12T15:07:19.280 INFO:teuthology.orchestra.run.smithi180.stdout: jq x86_641.5-12.el8 AppStream 161 k 2020-02-12T15:07:19.280 INFO:teuthology.orchestra.run.smithi180.stdout: librdkafka x86_640.11.4-1.el8 AppStream 353 k 2020-02-12T15:07:19.280 INFO:teuthology.orchestra.run.smithi180.stdout: lttng-ust x86_642.8.1-11.el8 AppStream 259 k 2020-02-12T15:07:19.280 INFO:teuthology.orchestra.run.smithi180.stdout: oniguruma x86_646.8.2-1.el8 AppStream 188 k 2020-02-12T15:07:19.280 INFO:teuthology.orchestra.run.smithi180.stdout: openblas x86_640.3.3-2.el8 AppStream 4.3 M 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: openblas-threads x86_640.3.3-2.el8 AppStream 4.4 M 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: python3-lxml x86_644.2.3-1.el8 AppStream 1.5 M 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: python3-mako noarch1.0.6-13.el8 AppStream 157 k 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: python3-markupsafe x86_640.23-19.el8 AppStream 39 k 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: python3-numpy x86_641:1.14.3-9.el8 AppStream 3.7 M 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 AppStream 225 k 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: python3-prettytable noarch0.7.2-14.el8 AppStream 44 k 2020-02-12T15:07:19.281 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pyasn1 noarch0.3.7-6.el8 AppStream 126 k 2020-02-12T15:07:19.282 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 AppStream 110 k 2020-02-12T15:07:19.282 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pytz noarch2017.2-9.el8 AppStream 54 k 2020-02-12T15:07:19.282 INFO:teuthology.orchestra.run.smithi180.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f AppStream 15 M 2020-02-12T15:07:19.282 INFO:teuthology.orchestra.run.smithi180.stdout: python3-webencodings noarch0.5.1-6.el8 AppStream 27 k 2020-02-12T15:07:19.282 INFO:teuthology.orchestra.run.smithi180.stdout: python3-werkzeug noarch0.12.2-4.el8 AppStream 457 k 2020-02-12T15:07:19.282 INFO:teuthology.orchestra.run.smithi180.stdout: socat x86_641.7.3.2-6.el8 AppStream 298 k 2020-02-12T15:07:19.282 INFO:teuthology.orchestra.run.smithi180.stdout: fuse x86_642.9.7-12.el8 BaseOS 82 k 2020-02-12T15:07:19.283 INFO:teuthology.orchestra.run.smithi180.stdout: fuse-common x86_643.2.1-12.el8 BaseOS 21 k 2020-02-12T15:07:19.283 INFO:teuthology.orchestra.run.smithi180.stdout: keyutils-libs-devel x86_641.5.10-6.el8 BaseOS 48 k 2020-02-12T15:07:19.283 INFO:teuthology.orchestra.run.smithi180.stdout: krb5-devel x86_641.17-9.el8 BaseOS 548 k 2020-02-12T15:07:19.283 INFO:teuthology.orchestra.run.smithi180.stdout: libcom_err-devel x86_641.44.6-3.el8 BaseOS 38 k 2020-02-12T15:07:19.283 INFO:teuthology.orchestra.run.smithi180.stdout: libgfortran x86_648.3.1-4.5.el8 BaseOS 638 k 2020-02-12T15:07:19.283 INFO:teuthology.orchestra.run.smithi180.stdout: libquadmath x86_648.3.1-4.5.el8 BaseOS 169 k 2020-02-12T15:07:19.283 INFO:teuthology.orchestra.run.smithi180.stdout: librabbitmq x86_640.9.0-1.el8 BaseOS 47 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: libselinux-devel x86_642.9-2.1.el8 BaseOS 199 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: libsepol-devel x86_642.9-1.el8 BaseOS 86 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: libverto-devel x86_640.3.0-5.el8 BaseOS 18 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: libxslt x86_641.1.32-3.el8 BaseOS 249 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: pcre2-devel x86_6410.32-1.el8 BaseOS 605 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: pcre2-utf16 x86_6410.32-1.el8 BaseOS 228 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: pcre2-utf32 x86_6410.32-1.el8 BaseOS 220 k 2020-02-12T15:07:19.284 INFO:teuthology.orchestra.run.smithi180.stdout: python3-chardet noarch3.0.4-7.el8 BaseOS 195 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: python3-jwt noarch1.6.1-2.el8 BaseOS 43 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: python3-oauthlib noarch2.1.0-1.el8 BaseOS 155 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pysocks noarch1.6.8-3.el8 BaseOS 34 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: python3-requests noarch2.20.0-2.1.el8_1 BaseOS 123 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 BaseOS 43 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: python3-urllib3 noarch1.24.2-2.el8 BaseOS 176 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: zlib-devel x86_641.2.11-10.el8 BaseOS 56 k 2020-02-12T15:07:19.285 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-02-12T15:07:19.286 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-02-12T15:07:19.286 INFO:teuthology.orchestra.run.smithi180.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-02-12T15:07:19.286 INFO:teuthology.orchestra.run.smithi180.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-02-12T15:07:19.286 INFO:teuthology.orchestra.run.smithi180.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-02-12T15:07:19.286 INFO:teuthology.orchestra.run.smithi180.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-02-12T15:07:19.286 INFO:teuthology.orchestra.run.smithi180.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-02-12T15:07:19.286 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-02-12T15:07:19.287 INFO:teuthology.orchestra.run.smithi180.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-02-12T15:07:19.288 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-02-12T15:07:19.289 INFO:teuthology.orchestra.run.smithi180.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-02-12T15:07:19.289 INFO:teuthology.orchestra.run.smithi180.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-02-12T15:07:19.289 INFO:teuthology.orchestra.run.smithi180.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2020-02-12T15:07:19.289 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-02-12T15:07:19.289 INFO:teuthology.orchestra.run.smithi180.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout: xmlstarlet x86_641.6.1-13.el8 lab-extras 69 k 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout:Installing weak dependencies: 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout: python3-html5lib noarch1:0.999999999-6.el8 AppStream 214 k 2020-02-12T15:07:19.290 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-02-12T15:07:19.291 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:07:19.291 INFO:teuthology.orchestra.run.smithi180.stdout:Transaction Summary 2020-02-12T15:07:19.291 INFO:teuthology.orchestra.run.smithi180.stdout:================================================================================ 2020-02-12T15:07:19.291 INFO:teuthology.orchestra.run.smithi180.stdout:Install 119 Packages 2020-02-12T15:07:19.291 INFO:teuthology.orchestra.run.smithi180.stdout:Upgrade 2 Packages 2020-02-12T15:07:19.291 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:07:19.292 INFO:teuthology.orchestra.run.smithi180.stdout:Total download size: 176 M 2020-02-12T15:07:19.292 INFO:teuthology.orchestra.run.smithi180.stdout:Downloading Packages: 2020-02-12T15:07:19.813 INFO:teuthology.orchestra.run.smithi180.stdout:(1/121): ceph-15.1.0-567.g7df2194.el8.x86_64.rp 71 kB/s | 6.4 kB 00:00 2020-02-12T15:07:19.938 INFO:teuthology.orchestra.run.smithi180.stdout:(2/121): ceph-fuse-15.1.0-567.g7df2194.el8.x86_ 4.5 MB/s | 571 kB 00:00 2020-02-12T15:07:19.968 INFO:teuthology.orchestra.run.smithi180.stdout:(3/121): ceph-immutable-object-cache-15.1.0-567 6.7 MB/s | 202 kB 00:00 2020-02-12T15:07:20.021 INFO:teuthology.orchestra.run.smithi105.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T15:07:20.021 INFO:teuthology.orchestra.run.smithi105.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2020-02-12T15:07:20.025 INFO:teuthology.orchestra.run.smithi105.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2020-02-12T15:07:20.025 INFO:teuthology.orchestra.run.smithi105.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2020-02-12T15:07:20.026 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2020-02-12T15:07:20.027 INFO:teuthology.orchestra.run.smithi105.stdout:Package xfsprogs-5.0.0-1.el8.x86_64 is already installed. 2020-02-12T15:07:20.144 INFO:teuthology.orchestra.run.smithi105.stdout:Dependencies resolved. 2020-02-12T15:07:20.156 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:07:20.156 INFO:teuthology.orchestra.run.smithi105.stdout: Package ArchVersion Repository Size 2020-02-12T15:07:20.156 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:07:20.156 INFO:teuthology.orchestra.run.smithi105.stdout:Installing: 2020-02-12T15:07:20.156 INFO:teuthology.orchestra.run.smithi105.stdout: ceph x86_642:15.1.0-567.g7df2194.el8 ceph 6.4 k 2020-02-12T15:07:20.156 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base x86_642:15.1.0-567.g7df2194.el8 ceph 5.5 M 2020-02-12T15:07:20.157 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 571 k 2020-02-12T15:07:20.157 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache x86_642:15.1.0-567.g7df2194.el8 ceph 202 k 2020-02-12T15:07:20.157 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr x86_642:15.1.0-567.g7df2194.el8 ceph 1.5 M 2020-02-12T15:07:20.157 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw x86_642:15.1.0-567.g7df2194.el8 ceph 9.7 M 2020-02-12T15:07:20.157 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test x86_642:15.1.0-567.g7df2194.el8 ceph 41 M 2020-02-12T15:07:20.157 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm x86_642:15.1.0-567.g7df2194.el8 ceph 32 k 2020-02-12T15:07:20.157 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel x86_642:15.1.0-567.g7df2194.el8 ceph 21 k 2020-02-12T15:07:20.158 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2 x86_642:15.1.0-567.g7df2194.el8 ceph 507 k 2020-02-12T15:07:20.158 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T15:07:20.158 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs x86_642:15.1.0-567.g7df2194.el8 ceph 149 k 2020-02-12T15:07:20.158 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados x86_642:15.1.0-567.g7df2194.el8 ceph 351 k 2020-02-12T15:07:20.158 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd x86_642:15.1.0-567.g7df2194.el8 ceph 309 k 2020-02-12T15:07:20.158 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw x86_642:15.1.0-567.g7df2194.el8 ceph 113 k 2020-02-12T15:07:20.158 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse x86_642:15.1.0-567.g7df2194.el8 ceph 72 k 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror x86_642:15.1.0-567.g7df2194.el8 ceph 2.6 M 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd x86_642:15.1.0-567.g7df2194.el8 ceph 141 k 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 29 k 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 3.8 M 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 8.6 M 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 17 k 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: bison x86_643.0.4-10.el8 AppStream 688 k 2020-02-12T15:07:20.159 INFO:teuthology.orchestra.run.smithi105.stdout: flex x86_642.6.1-9.el8 AppStream 320 k 2020-02-12T15:07:20.160 INFO:teuthology.orchestra.run.smithi105.stdout: libtool x86_642.4.6-25.el8 AppStream 709 k 2020-02-12T15:07:20.160 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel x86_640.176-5.el8 BaseOS 54 k 2020-02-12T15:07:20.160 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel x86_640.3.112-1.el8 BaseOS 19 k 2020-02-12T15:07:20.160 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel x86_642.32.1-17.el8 BaseOS 95 k 2020-02-12T15:07:20.160 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel x86_641:1.1.1c-2.el8 BaseOS 2.3 M 2020-02-12T15:07:20.160 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel x86_645.0.0-1.el8 BaseOS 69 k 2020-02-12T15:07:20.160 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrading: 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout: librados2 x86_642:15.1.0-567.g7df2194.el8 ceph 3.6 M 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1 x86_642:15.1.0-567.g7df2194.el8 ceph 1.9 M 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout:Installing dependencies: 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 21 M 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds x86_642:15.1.0-567.g7df2194.el8 ceph 2.0 M 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon x86_642:15.1.0-567.g7df2194.el8 ceph 4.3 M 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd x86_642:15.1.0-567.g7df2194.el8 ceph 17 M 2020-02-12T15:07:20.161 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux x86_642:15.1.0-567.g7df2194.el8 ceph 25 k 2020-02-12T15:07:20.162 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1 x86_642:15.1.0-567.g7df2194.el8 ceph 377 k 2020-02-12T15:07:20.162 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2 x86_642:15.1.0-567.g7df2194.el8 ceph 6.2 M 2020-02-12T15:07:20.162 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse x86_642:15.1.0-567.g7df2194.el8 ceph 40 k 2020-02-12T15:07:20.162 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common x86_642:15.1.0-567.g7df2194.el8 ceph 51 k 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards noarch2:15.1.0-567.g7df2194.el8 ceph-noarch 22 k 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: automake noarch1.16.1-6.el8 AppStream 713 k 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: jq x86_641.5-12.el8 AppStream 161 k 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka x86_640.11.4-1.el8 AppStream 353 k 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust x86_642.8.1-11.el8 AppStream 259 k 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma x86_646.8.2-1.el8 AppStream 188 k 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: openblas x86_640.3.3-2.el8 AppStream 4.3 M 2020-02-12T15:07:20.163 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-threads x86_640.3.3-2.el8 AppStream 4.4 M 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-lxml x86_644.2.3-1.el8 AppStream 1.5 M 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako noarch1.0.6-13.el8 AppStream 157 k 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe x86_640.23-19.el8 AppStream 39 k 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy x86_641:1.14.3-9.el8 AppStream 3.7 M 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py x86_641:1.14.3-9.el8 AppStream 225 k 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable noarch0.7.2-14.el8 AppStream 44 k 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1 noarch0.3.7-6.el8 AppStream 126 k 2020-02-12T15:07:20.164 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules noarch0.3.7-6.el8 AppStream 110 k 2020-02-12T15:07:20.165 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz noarch2017.2-9.el8 AppStream 54 k 2020-02-12T15:07:20.165 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy x86_641.0.0-20.module_el8.1.0+245+c39af44f AppStream 15 M 2020-02-12T15:07:20.165 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webencodings noarch0.5.1-6.el8 AppStream 27 k 2020-02-12T15:07:20.165 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug noarch0.12.2-4.el8 AppStream 457 k 2020-02-12T15:07:20.165 INFO:teuthology.orchestra.run.smithi105.stdout: socat x86_641.7.3.2-6.el8 AppStream 298 k 2020-02-12T15:07:20.165 INFO:teuthology.orchestra.run.smithi105.stdout: fuse x86_642.9.7-12.el8 BaseOS 82 k 2020-02-12T15:07:20.165 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-common x86_643.2.1-12.el8 BaseOS 21 k 2020-02-12T15:07:20.166 INFO:teuthology.orchestra.run.smithi105.stdout: keyutils-libs-devel x86_641.5.10-6.el8 BaseOS 48 k 2020-02-12T15:07:20.166 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-devel x86_641.17-9.el8 BaseOS 548 k 2020-02-12T15:07:20.166 INFO:teuthology.orchestra.run.smithi105.stdout: libcom_err-devel x86_641.44.6-3.el8 BaseOS 38 k 2020-02-12T15:07:20.166 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran x86_648.3.1-4.5.el8 BaseOS 638 k 2020-02-12T15:07:20.166 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath x86_648.3.1-4.5.el8 BaseOS 169 k 2020-02-12T15:07:20.166 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq x86_640.9.0-1.el8 BaseOS 47 k 2020-02-12T15:07:20.166 INFO:teuthology.orchestra.run.smithi105.stdout: libselinux-devel x86_642.9-2.1.el8 BaseOS 199 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: libsepol-devel x86_642.9-1.el8 BaseOS 86 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: libverto-devel x86_640.3.0-5.el8 BaseOS 18 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: libxslt x86_641.1.32-3.el8 BaseOS 249 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-devel x86_6410.32-1.el8 BaseOS 605 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf16 x86_6410.32-1.el8 BaseOS 228 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf32 x86_6410.32-1.el8 BaseOS 220 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: python3-chardet noarch3.0.4-7.el8 BaseOS 195 k 2020-02-12T15:07:20.167 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt noarch1.6.1-2.el8 BaseOS 43 k 2020-02-12T15:07:20.168 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib noarch2.1.0-1.el8 BaseOS 155 k 2020-02-12T15:07:20.168 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pysocks noarch1.6.8-3.el8 BaseOS 34 k 2020-02-12T15:07:20.168 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests noarch2.20.0-2.1.el8_1 BaseOS 123 k 2020-02-12T15:07:20.168 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib noarch1.0.0-1.el8 BaseOS 43 k 2020-02-12T15:07:20.168 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3 noarch1.24.2-2.el8 BaseOS 176 k 2020-02-12T15:07:20.168 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel x86_641.2.11-10.el8 BaseOS 56 k 2020-02-12T15:07:20.168 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot noarch8.2.1-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 145 k 2020-02-12T15:07:20.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy noarch18.4.0-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 385 k 2020-02-12T15:07:20.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-execnet noarch1.7.1-1.el8.2 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 356 k 2020-02-12T15:07:20.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco noarch6.2-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 11 k 2020-02-12T15:07:20.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools noarch2.0-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 18 k 2020-02-12T15:07:20.169 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils noarch0.3.5-11.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 49 k 2020-02-12T15:07:20.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools noarch7.2.0-3.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 59 k 2020-02-12T15:07:20.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan noarch1.3.2-9.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 283 k 2020-02-12T15:07:20.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend noarch2.6-1.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 16 k 2020-02-12T15:07:20.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-remoto noarch1.1.4-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 48 k 2020-02-12T15:07:20.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru noarch0.7-6.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 34 k 2020-02-12T15:07:20.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes noarch2.4.1-12.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 197 k 2020-02-12T15:07:20.170 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplegeneric noarch0.8.1-17.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 19 k 2020-02-12T15:07:20.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch noarch3.4.0.3-18.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 24 k 2020-02-12T15:07:20.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora noarch1.14.1-5.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 30 k 2020-02-12T15:07:20.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-trustme noarch0.5.2-4.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 27 k 2020-02-12T15:07:20.171 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile noarch2.0-2.el8 copr:copr.fedorainfracloud.org:ktdreyer:ceph-el8 23 k 2020-02-12T15:07:20.171 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs x86_642.7-6.el8 epel 315 k 2020-02-12T15:07:20.171 INFO:teuthology.orchestra.run.smithi105.stdout: liboath x86_642.6.2-3.el8 epel 59 k 2020-02-12T15:07:20.171 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind x86_641.3.1-3.el8 epel 75 k 2020-02-12T15:07:20.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-apipkg noarch1.5-6.el8 epel 21 k 2020-02-12T15:07:20.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt x86_643.1.6-2.el8.1 epel 44 k 2020-02-12T15:07:20.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-beautifulsoup4 noarch4.6.3-2.el8.1 epel 185 k 2020-02-12T15:07:20.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools noarch3.1.1-4.el8 epel 33 k 2020-02-12T15:07:20.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi noarch2018.10.15-7.el8 epel 16 k 2020-02-12T15:07:20.172 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth noarch1:1.1.1-10.el8 epel 81 k 2020-02-12T15:07:20.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes noarch10.0.1-1.el8 epel 1.1 M 2020-02-12T15:07:20.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa noarch3.4.2-12.el8 epel 73 k 2020-02-12T15:07:20.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-waitress noarch1.2.1-2.el8.1 epel 241 k 2020-02-12T15:07:20.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob noarch1.8.5-1.el8.1 epel 251 k 2020-02-12T15:07:20.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client noarch0.56.0-5.el8 epel 61 k 2020-02-12T15:07:20.173 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webtest noarch2.0.33-1.el8 epel 85 k 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout: leveldb x86_641.21-2.el8 lab-extras 179 k 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet x86_641.6.1-13.el8 lab-extras 69 k 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout:Installing weak dependencies: 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout: python3-html5lib noarch1:0.999999999-6.el8 AppStream 214 k 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cssselect noarch0.9.2-10.el8 epel 40 k 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction Summary 2020-02-12T15:07:20.174 INFO:teuthology.orchestra.run.smithi105.stdout:================================================================================ 2020-02-12T15:07:20.175 INFO:teuthology.orchestra.run.smithi105.stdout:Install 119 Packages 2020-02-12T15:07:20.175 INFO:teuthology.orchestra.run.smithi105.stdout:Upgrade 2 Packages 2020-02-12T15:07:20.175 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:07:20.176 INFO:teuthology.orchestra.run.smithi105.stdout:Total download size: 176 M 2020-02-12T15:07:20.176 INFO:teuthology.orchestra.run.smithi105.stdout:Downloading Packages: 2020-02-12T15:07:20.227 INFO:teuthology.orchestra.run.smithi180.stdout:(4/121): ceph-mds-15.1.0-567.g7df2194.el8.x86_6 7.8 MB/s | 2.0 MB 00:00 2020-02-12T15:07:20.381 INFO:teuthology.orchestra.run.smithi180.stdout:(5/121): ceph-base-15.1.0-567.g7df2194.el8.x86_ 8.3 MB/s | 5.5 MB 00:00 2020-02-12T15:07:20.404 INFO:teuthology.orchestra.run.smithi180.stdout:(6/121): ceph-mgr-15.1.0-567.g7df2194.el8.x86_6 8.7 MB/s | 1.5 MB 00:00 2020-02-12T15:07:20.818 INFO:teuthology.orchestra.run.smithi180.stdout:(7/121): ceph-mon-15.1.0-567.g7df2194.el8.x86_6 10 MB/s | 4.3 MB 00:00 2020-02-12T15:07:20.855 INFO:teuthology.orchestra.run.smithi105.stdout:(1/121): ceph-15.1.0-567.g7df2194.el8.x86_64.rp 25 kB/s | 6.4 kB 00:00 2020-02-12T15:07:21.597 INFO:teuthology.orchestra.run.smithi105.stdout:(2/121): ceph-fuse-15.1.0-567.g7df2194.el8.x86_ 769 kB/s | 571 kB 00:00 2020-02-12T15:07:21.800 INFO:teuthology.orchestra.run.smithi105.stdout:(3/121): ceph-immutable-object-cache-15.1.0-567 998 kB/s | 202 kB 00:00 2020-02-12T15:07:22.014 INFO:teuthology.orchestra.run.smithi180.stdout:(8/121): ceph-common-15.1.0-567.g7df2194.el8.x8 9.0 MB/s | 21 MB 00:02 2020-02-12T15:07:22.042 INFO:teuthology.orchestra.run.smithi180.stdout:(9/121): ceph-radosgw-15.1.0-567.g7df2194.el8.x 8.0 MB/s | 9.7 MB 00:01 2020-02-12T15:07:22.042 INFO:teuthology.orchestra.run.smithi180.stdout:(10/121): ceph-selinux-15.1.0-567.g7df2194.el8. 900 kB/s | 25 kB 00:00 2020-02-12T15:07:22.094 INFO:teuthology.orchestra.run.smithi180.stdout:(11/121): cephadm-15.1.0-567.g7df2194.el8.x86_6 622 kB/s | 32 kB 00:00 2020-02-12T15:07:22.144 INFO:teuthology.orchestra.run.smithi180.stdout:(12/121): libcephfs-devel-15.1.0-567.g7df2194.e 425 kB/s | 21 kB 00:00 2020-02-12T15:07:22.214 INFO:teuthology.orchestra.run.smithi180.stdout:(13/121): libcephfs2-15.1.0-567.g7df2194.el8.x8 7.1 MB/s | 507 kB 00:00 2020-02-12T15:07:22.273 INFO:teuthology.orchestra.run.smithi180.stdout:(14/121): librados-devel-15.1.0-567.g7df2194.el 2.4 MB/s | 141 kB 00:00 2020-02-12T15:07:22.364 INFO:teuthology.orchestra.run.smithi105.stdout:(4/121): ceph-mds-15.1.0-567.g7df2194.el8.x86_6 3.6 MB/s | 2.0 MB 00:00 2020-02-12T15:07:22.409 INFO:teuthology.orchestra.run.smithi180.stdout:(15/121): ceph-osd-15.1.0-567.g7df2194.el8.x86_ 8.3 MB/s | 17 MB 00:02 2020-02-12T15:07:22.412 INFO:teuthology.orchestra.run.smithi180.stdout:(16/121): libradosstriper1-15.1.0-567.g7df2194. 2.6 MB/s | 377 kB 00:00 2020-02-12T15:07:22.469 INFO:teuthology.orchestra.run.smithi180.stdout:(17/121): python3-ceph-argparse-15.1.0-567.g7df 701 kB/s | 40 kB 00:00 2020-02-12T15:07:22.524 INFO:teuthology.orchestra.run.smithi180.stdout:(18/121): python3-ceph-common-15.1.0-567.g7df21 930 kB/s | 51 kB 00:00 2020-02-12T15:07:22.584 INFO:teuthology.orchestra.run.smithi180.stdout:(19/121): python3-cephfs-15.1.0-567.g7df2194.el 2.4 MB/s | 149 kB 00:00 2020-02-12T15:07:22.652 INFO:teuthology.orchestra.run.smithi180.stdout:(20/121): python3-rados-15.1.0-567.g7df2194.el8 5.0 MB/s | 351 kB 00:00 2020-02-12T15:07:22.721 INFO:teuthology.orchestra.run.smithi180.stdout:(21/121): python3-rbd-15.1.0-567.g7df2194.el8.x 4.4 MB/s | 309 kB 00:00 2020-02-12T15:07:22.790 INFO:teuthology.orchestra.run.smithi105.stdout:(5/121): ceph-mgr-15.1.0-567.g7df2194.el8.x86_6 3.7 MB/s | 1.5 MB 00:00 2020-02-12T15:07:22.790 INFO:teuthology.orchestra.run.smithi180.stdout:(22/121): python3-rgw-15.1.0-567.g7df2194.el8.x 1.8 MB/s | 113 kB 00:00 2020-02-12T15:07:22.831 INFO:teuthology.orchestra.run.smithi180.stdout:(23/121): rbd-fuse-15.1.0-567.g7df2194.el8.x86_ 1.4 MB/s | 72 kB 00:00 2020-02-12T15:07:23.134 INFO:teuthology.orchestra.run.smithi180.stdout:(24/121): librgw2-15.1.0-567.g7df2194.el8.x86_6 8.7 MB/s | 6.2 MB 00:00 2020-02-12T15:07:23.171 INFO:teuthology.orchestra.run.smithi180.stdout:(25/121): rbd-mirror-15.1.0-567.g7df2194.el8.x8 7.7 MB/s | 2.6 MB 00:00 2020-02-12T15:07:23.172 INFO:teuthology.orchestra.run.smithi180.stdout:(26/121): rbd-nbd-15.1.0-567.g7df2194.el8.x86_6 2.7 MB/s | 141 kB 00:00 2020-02-12T15:07:23.200 INFO:teuthology.orchestra.run.smithi180.stdout:(27/121): ceph-grafana-dashboards-15.1.0-567.g7 761 kB/s | 22 kB 00:00 2020-02-12T15:07:23.202 INFO:teuthology.orchestra.run.smithi180.stdout:(28/121): ceph-mgr-cephadm-15.1.0-567.g7df2194. 972 kB/s | 29 kB 00:00 2020-02-12T15:07:23.675 INFO:teuthology.orchestra.run.smithi180.stdout:(29/121): ceph-mgr-dashboard-15.1.0-567.g7df219 8.0 MB/s | 3.8 MB 00:00 2020-02-12T15:07:23.722 INFO:teuthology.orchestra.run.smithi180.stdout:(30/121): ceph-mgr-rook-15.1.0-567.g7df2194.el8 362 kB/s | 17 kB 00:00 2020-02-12T15:07:23.840 INFO:teuthology.orchestra.run.smithi180.stdout:(31/121): automake-1.16.1-6.el8.noarch.rpm 5.9 MB/s | 713 kB 00:00 2020-02-12T15:07:23.861 INFO:teuthology.orchestra.run.smithi105.stdout:(6/121): ceph-mon-15.1.0-567.g7df2194.el8.x86_6 4.0 MB/s | 4.3 MB 00:01 2020-02-12T15:07:23.869 INFO:teuthology.orchestra.run.smithi180.stdout:(32/121): bison-3.0.4-10.el8.x86_64.rpm 23 MB/s | 688 kB 00:00 2020-02-12T15:07:23.889 INFO:teuthology.orchestra.run.smithi180.stdout:(33/121): flex-2.6.1-9.el8.x86_64.rpm 16 MB/s | 320 kB 00:00 2020-02-12T15:07:23.905 INFO:teuthology.orchestra.run.smithi180.stdout:(34/121): jq-1.5-12.el8.x86_64.rpm 9.5 MB/s | 161 kB 00:00 2020-02-12T15:07:23.925 INFO:teuthology.orchestra.run.smithi180.stdout:(35/121): librdkafka-0.11.4-1.el8.x86_64.rpm 18 MB/s | 353 kB 00:00 2020-02-12T15:07:23.950 INFO:teuthology.orchestra.run.smithi180.stdout:(36/121): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2020-02-12T15:07:23.968 INFO:teuthology.orchestra.run.smithi180.stdout:(37/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2020-02-12T15:07:23.985 INFO:teuthology.orchestra.run.smithi180.stdout:(38/121): oniguruma-6.8.2-1.el8.x86_64.rpm 11 MB/s | 188 kB 00:00 2020-02-12T15:07:24.058 INFO:teuthology.orchestra.run.smithi180.stdout:(39/121): openblas-0.3.3-2.el8.x86_64.rpm 59 MB/s | 4.3 MB 00:00 2020-02-12T15:07:24.123 INFO:teuthology.orchestra.run.smithi180.stdout:(40/121): openblas-threads-0.3.3-2.el8.x86_64.r 67 MB/s | 4.4 MB 00:00 2020-02-12T15:07:24.151 INFO:teuthology.orchestra.run.smithi180.stdout:(41/121): python3-html5lib-0.999999999-6.el8.no 7.5 MB/s | 214 kB 00:00 2020-02-12T15:07:24.186 INFO:teuthology.orchestra.run.smithi180.stdout:(42/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 47 MB/s | 1.5 MB 00:00 2020-02-12T15:07:24.203 INFO:teuthology.orchestra.run.smithi180.stdout:(43/121): python3-mako-1.0.6-13.el8.noarch.rpm 9.4 MB/s | 157 kB 00:00 2020-02-12T15:07:24.215 INFO:teuthology.orchestra.run.smithi180.stdout:(44/121): python3-markupsafe-0.23-19.el8.x86_64 2.5 MB/s | 39 kB 00:00 2020-02-12T15:07:24.277 INFO:teuthology.orchestra.run.smithi180.stdout:(45/121): ceph-mgr-diskprediction-local-15.1.0- 8.1 MB/s | 8.6 MB 00:01 2020-02-12T15:07:24.296 INFO:teuthology.orchestra.run.smithi180.stdout:(46/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 50 MB/s | 3.7 MB 00:00 2020-02-12T15:07:24.306 INFO:teuthology.orchestra.run.smithi180.stdout:(47/121): python3-prettytable-0.7.2-14.el8.noar 2.8 MB/s | 44 kB 00:00 2020-02-12T15:07:24.322 INFO:teuthology.orchestra.run.smithi180.stdout:(48/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 7.6 MB/s | 126 kB 00:00 2020-02-12T15:07:24.339 INFO:teuthology.orchestra.run.smithi180.stdout:(49/121): python3-pyasn1-modules-0.3.7-6.el8.no 6.8 MB/s | 110 kB 00:00 2020-02-12T15:07:24.355 INFO:teuthology.orchestra.run.smithi180.stdout:(50/121): python3-pytz-2017.2-9.el8.noarch.rpm 3.3 MB/s | 54 kB 00:00 2020-02-12T15:07:24.368 INFO:teuthology.orchestra.run.smithi180.stdout:(51/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 2.2 MB/s | 225 kB 00:00 2020-02-12T15:07:24.386 INFO:teuthology.orchestra.run.smithi180.stdout:(52/121): python3-webencodings-0.5.1-6.el8.noar 1.5 MB/s | 27 kB 00:00 2020-02-12T15:07:24.433 INFO:teuthology.orchestra.run.smithi180.stdout:(53/121): python3-werkzeug-0.12.2-4.el8.noarch. 9.8 MB/s | 457 kB 00:00 2020-02-12T15:07:24.459 INFO:teuthology.orchestra.run.smithi180.stdout:(54/121): socat-1.7.3.2-6.el8.x86_64.rpm 11 MB/s | 298 kB 00:00 2020-02-12T15:07:24.607 INFO:teuthology.orchestra.run.smithi180.stdout:(55/121): python3-scipy-1.0.0-20.module_el8.1.0 58 MB/s | 15 MB 00:00 2020-02-12T15:07:24.608 INFO:teuthology.orchestra.run.smithi180.stdout:(56/121): elfutils-libelf-devel-0.176-5.el8.x86 363 kB/s | 54 kB 00:00 2020-02-12T15:07:24.636 INFO:teuthology.orchestra.run.smithi180.stdout:(57/121): fuse-common-3.2.1-12.el8.x86_64.rpm 753 kB/s | 21 kB 00:00 2020-02-12T15:07:24.665 INFO:teuthology.orchestra.run.smithi180.stdout:(58/121): keyutils-libs-devel-1.5.10-6.el8.x86_ 1.7 MB/s | 48 kB 00:00 2020-02-12T15:07:24.722 INFO:teuthology.orchestra.run.smithi180.stdout:(59/121): fuse-2.9.7-12.el8.x86_64.rpm 751 kB/s | 82 kB 00:00 2020-02-12T15:07:24.745 INFO:teuthology.orchestra.run.smithi180.stdout:(60/121): libaio-devel-0.3.112-1.el8.x86_64.rpm 668 kB/s | 19 kB 00:00 2020-02-12T15:07:24.749 INFO:teuthology.orchestra.run.smithi180.stdout:(61/121): krb5-devel-1.17-9.el8.x86_64.rpm 6.4 MB/s | 548 kB 00:00 2020-02-12T15:07:24.773 INFO:teuthology.orchestra.run.smithi180.stdout:(62/121): libcom_err-devel-1.44.6-3.el8.x86_64. 1.3 MB/s | 38 kB 00:00 2020-02-12T15:07:24.805 INFO:teuthology.orchestra.run.smithi180.stdout:(63/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 11 MB/s | 638 kB 00:00 2020-02-12T15:07:24.829 INFO:teuthology.orchestra.run.smithi180.stdout:(64/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 3.0 MB/s | 169 kB 00:00 2020-02-12T15:07:24.832 INFO:teuthology.orchestra.run.smithi180.stdout:(65/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 1.6 MB/s | 47 kB 00:00 2020-02-12T15:07:24.858 INFO:teuthology.orchestra.run.smithi180.stdout:(66/121): libselinux-devel-2.9-2.1.el8.x86_64.r 6.8 MB/s | 199 kB 00:00 2020-02-12T15:07:24.860 INFO:teuthology.orchestra.run.smithi180.stdout:(67/121): libsepol-devel-2.9-1.el8.x86_64.rpm 3.0 MB/s | 86 kB 00:00 2020-02-12T15:07:24.886 INFO:teuthology.orchestra.run.smithi180.stdout:(68/121): libuuid-devel-2.32.1-17.el8.x86_64.rp 3.3 MB/s | 95 kB 00:00 2020-02-12T15:07:24.889 INFO:teuthology.orchestra.run.smithi180.stdout:(69/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 644 kB/s | 18 kB 00:00 2020-02-12T15:07:24.942 INFO:teuthology.orchestra.run.smithi180.stdout:(70/121): libxslt-1.1.32-3.el8.x86_64.rpm 4.4 MB/s | 249 kB 00:00 2020-02-12T15:07:24.953 INFO:teuthology.orchestra.run.smithi180.stdout:(71/121): openssl-devel-1.1.1c-2.el8.x86_64.rpm 36 MB/s | 2.3 MB 00:00 2020-02-12T15:07:24.983 INFO:teuthology.orchestra.run.smithi180.stdout:(72/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 7.3 MB/s | 228 kB 00:00 2020-02-12T15:07:24.999 INFO:teuthology.orchestra.run.smithi180.stdout:(73/121): pcre2-devel-10.32-1.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2020-02-12T15:07:25.005 INFO:teuthology.orchestra.run.smithi105.stdout:(7/121): ceph-base-15.1.0-567.g7df2194.el8.x86_ 1.2 MB/s | 5.5 MB 00:04 2020-02-12T15:07:25.012 INFO:teuthology.orchestra.run.smithi180.stdout:(74/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 7.5 MB/s | 220 kB 00:00 2020-02-12T15:07:25.028 INFO:teuthology.orchestra.run.smithi180.stdout:(75/121): python3-chardet-3.0.4-7.el8.noarch.rp 6.7 MB/s | 195 kB 00:00 2020-02-12T15:07:25.040 INFO:teuthology.orchestra.run.smithi180.stdout:(76/121): python3-jwt-1.6.1-2.el8.noarch.rpm 1.5 MB/s | 43 kB 00:00 2020-02-12T15:07:25.057 INFO:teuthology.orchestra.run.smithi180.stdout:(77/121): python3-oauthlib-2.1.0-1.el8.noarch.r 5.3 MB/s | 155 kB 00:00 2020-02-12T15:07:25.068 INFO:teuthology.orchestra.run.smithi180.stdout:(78/121): python3-pysocks-1.6.8-3.el8.noarch.rp 1.2 MB/s | 34 kB 00:00 2020-02-12T15:07:25.085 INFO:teuthology.orchestra.run.smithi180.stdout:(79/121): python3-requests-2.20.0-2.1.el8_1.noa 4.3 MB/s | 123 kB 00:00 2020-02-12T15:07:25.096 INFO:teuthology.orchestra.run.smithi180.stdout:(80/121): python3-requests-oauthlib-1.0.0-1.el8 1.5 MB/s | 43 kB 00:00 2020-02-12T15:07:25.114 INFO:teuthology.orchestra.run.smithi180.stdout:(81/121): python3-urllib3-1.24.2-2.el8.noarch.r 6.0 MB/s | 176 kB 00:00 2020-02-12T15:07:25.124 INFO:teuthology.orchestra.run.smithi180.stdout:(82/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 2.4 MB/s | 69 kB 00:00 2020-02-12T15:07:25.142 INFO:teuthology.orchestra.run.smithi180.stdout:(83/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 2.0 MB/s | 56 kB 00:00 2020-02-12T15:07:25.189 INFO:teuthology.orchestra.run.smithi180.stdout:(84/121): python3-cheroot-8.2.1-1.el8.noarch.rp 2.2 MB/s | 145 kB 00:00 2020-02-12T15:07:25.209 INFO:teuthology.orchestra.run.smithi180.stdout:(85/121): python3-execnet-1.7.1-1.el8.2.noarch. 17 MB/s | 356 kB 00:00 2020-02-12T15:07:25.212 INFO:teuthology.orchestra.run.smithi180.stdout:(86/121): python3-cherrypy-18.4.0-1.el8.noarch. 5.4 MB/s | 385 kB 00:00 2020-02-12T15:07:25.221 INFO:teuthology.orchestra.run.smithi180.stdout:(87/121): python3-jaraco-functools-2.0-4.el8.no 1.9 MB/s | 18 kB 00:00 2020-02-12T15:07:25.223 INFO:teuthology.orchestra.run.smithi180.stdout:(88/121): python3-jaraco-6.2-6.el8.noarch.rpm 839 kB/s | 11 kB 00:00 2020-02-12T15:07:25.230 INFO:teuthology.orchestra.run.smithi180.stdout:(89/121): python3-logutils-0.3.5-11.el8.noarch. 5.3 MB/s | 49 kB 00:00 2020-02-12T15:07:25.234 INFO:teuthology.orchestra.run.smithi180.stdout:(90/121): python3-more-itertools-7.2.0-3.el8.no 5.3 MB/s | 59 kB 00:00 2020-02-12T15:07:25.242 INFO:teuthology.orchestra.run.smithi180.stdout:(91/121): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-02-12T15:07:25.243 INFO:teuthology.orchestra.run.smithi180.stdout:(92/121): python3-pecan-1.3.2-9.el8.noarch.rpm 21 MB/s | 283 kB 00:00 2020-02-12T15:07:25.253 INFO:teuthology.orchestra.run.smithi180.stdout:(93/121): python3-remoto-1.1.4-4.el8.noarch.rpm 5.3 MB/s | 48 kB 00:00 2020-02-12T15:07:25.253 INFO:teuthology.orchestra.run.smithi180.stdout:(94/121): python3-repoze-lru-0.7-6.el8.noarch.r 3.9 MB/s | 34 kB 00:00 2020-02-12T15:07:25.262 INFO:teuthology.orchestra.run.smithi180.stdout:(95/121): python3-simplegeneric-0.8.1-17.el8.no 2.0 MB/s | 19 kB 00:00 2020-02-12T15:07:25.274 INFO:teuthology.orchestra.run.smithi180.stdout:(96/121): python3-routes-2.4.1-12.el8.noarch.rp 16 MB/s | 197 kB 00:00 2020-02-12T15:07:25.275 INFO:teuthology.orchestra.run.smithi180.stdout:(97/121): python3-singledispatch-3.4.0.3-18.el8 2.0 MB/s | 24 kB 00:00 2020-02-12T15:07:25.282 INFO:teuthology.orchestra.run.smithi180.stdout:(98/121): python3-trustme-0.5.2-4.el8.noarch.rp 3.1 MB/s | 27 kB 00:00 2020-02-12T15:07:25.291 INFO:teuthology.orchestra.run.smithi180.stdout:(99/121): python3-zc-lockfile-2.0-2.el8.noarch. 2.6 MB/s | 23 kB 00:00 2020-02-12T15:07:25.336 INFO:teuthology.orchestra.run.smithi180.stdout:(100/121): python3-tempora-1.14.1-5.el8.noarch. 414 kB/s | 30 kB 00:00 2020-02-12T15:07:25.689 INFO:teuthology.orchestra.run.smithi180.stdout:(101/121): ceph-test-15.1.0-567.g7df2194.el8.x8 11 MB/s | 41 MB 00:03 2020-02-12T15:07:25.690 INFO:teuthology.orchestra.run.smithi180.stdout:(102/121): liboath-2.6.2-3.el8.x86_64.rpm 166 kB/s | 59 kB 00:00 2020-02-12T15:07:25.692 INFO:teuthology.orchestra.run.smithi180.stdout:(103/121): gperftools-libs-2.7-6.el8.x86_64.rpm 787 kB/s | 315 kB 00:00 2020-02-12T15:07:25.708 INFO:teuthology.orchestra.run.smithi180.stdout:(104/121): python3-bcrypt-3.1.6-2.el8.1.x86_64. 2.7 MB/s | 44 kB 00:00 2020-02-12T15:07:25.728 INFO:teuthology.orchestra.run.smithi180.stdout:(105/121): python3-apipkg-1.5-6.el8.noarch.rpm 571 kB/s | 21 kB 00:00 2020-02-12T15:07:25.740 INFO:teuthology.orchestra.run.smithi180.stdout:(106/121): python3-beautifulsoup4-4.6.3-2.el8.1 5.8 MB/s | 185 kB 00:00 2020-02-12T15:07:25.747 INFO:teuthology.orchestra.run.smithi180.stdout:(107/121): python3-cachetools-3.1.1-4.el8.noarc 1.7 MB/s | 33 kB 00:00 2020-02-12T15:07:25.751 INFO:teuthology.orchestra.run.smithi180.stdout:(108/121): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2020-02-12T15:07:25.755 INFO:teuthology.orchestra.run.smithi180.stdout:(109/121): python3-certifi-2018.10.15-7.el8.noa 1.0 MB/s | 16 kB 00:00 2020-02-12T15:07:25.766 INFO:teuthology.orchestra.run.smithi180.stdout:(110/121): python3-cssselect-0.9.2-10.el8.noarc 2.0 MB/s | 40 kB 00:00 2020-02-12T15:07:25.782 INFO:teuthology.orchestra.run.smithi180.stdout:(111/121): python3-google-auth-1.1.1-10.el8.noa 2.6 MB/s | 81 kB 00:00 2020-02-12T15:07:25.786 INFO:teuthology.orchestra.run.smithi180.stdout:(112/121): python3-rsa-3.4.2-12.el8.noarch.rpm 3.6 MB/s | 73 kB 00:00 2020-02-12T15:07:25.814 INFO:teuthology.orchestra.run.smithi180.stdout:(113/121): python3-waitress-1.2.1-2.el8.1.noarc 7.4 MB/s | 241 kB 00:00 2020-02-12T15:07:25.825 INFO:teuthology.orchestra.run.smithi180.stdout:(114/121): python3-webob-1.8.5-1.el8.1.noarch.r 6.4 MB/s | 251 kB 00:00 2020-02-12T15:07:25.830 INFO:teuthology.orchestra.run.smithi180.stdout:(115/121): python3-websocket-client-0.56.0-5.el 3.8 MB/s | 61 kB 00:00 2020-02-12T15:07:25.837 INFO:teuthology.orchestra.run.smithi180.stdout:(116/121): leveldb-1.21-2.el8.x86_64.rpm 29 MB/s | 179 kB 00:00 2020-02-12T15:07:25.838 INFO:teuthology.orchestra.run.smithi180.stdout:(117/121): xmlstarlet-1.6.1-13.el8.x86_64.rpm 46 MB/s | 69 kB 00:00 2020-02-12T15:07:25.844 INFO:teuthology.orchestra.run.smithi180.stdout:(118/121): python3-webtest-2.0.33-1.el8.noarch. 4.3 MB/s | 85 kB 00:00 2020-02-12T15:07:25.849 INFO:teuthology.orchestra.run.smithi180.stdout:(119/121): python3-kubernetes-10.0.1-1.el8.noar 12 MB/s | 1.1 MB 00:00 2020-02-12T15:07:25.877 INFO:teuthology.orchestra.run.smithi105.stdout:(8/121): ceph-osd-15.1.0-567.g7df2194.el8.x86_6 8.2 MB/s | 17 MB 00:02 2020-02-12T15:07:25.899 INFO:teuthology.orchestra.run.smithi105.stdout:(9/121): ceph-selinux-15.1.0-567.g7df2194.el8.x 1.1 MB/s | 25 kB 00:00 2020-02-12T15:07:26.147 INFO:teuthology.orchestra.run.smithi180.stdout:(120/121): librbd1-15.1.0-567.g7df2194.el8.x86_ 6.2 MB/s | 1.9 MB 00:00 2020-02-12T15:07:26.265 INFO:teuthology.orchestra.run.smithi180.stdout:(121/121): librados2-15.1.0-567.g7df2194.el8.x8 8.3 MB/s | 3.6 MB 00:00 2020-02-12T15:07:26.269 INFO:teuthology.orchestra.run.smithi180.stdout:-------------------------------------------------------------------------------- 2020-02-12T15:07:26.270 INFO:teuthology.orchestra.run.smithi180.stdout:Total 25 MB/s | 176 MB 00:06 2020-02-12T15:07:26.335 INFO:teuthology.orchestra.run.smithi180.stdout:Running transaction check 2020-02-12T15:07:26.445 INFO:teuthology.orchestra.run.smithi180.stdout:Transaction check succeeded. 2020-02-12T15:07:26.445 INFO:teuthology.orchestra.run.smithi180.stdout:Running transaction test 2020-02-12T15:07:27.056 INFO:teuthology.orchestra.run.smithi105.stdout:(10/121): ceph-radosgw-15.1.0-567.g7df2194.el8. 4.7 MB/s | 9.7 MB 00:02 2020-02-12T15:07:27.083 INFO:teuthology.orchestra.run.smithi105.stdout:(11/121): cephadm-15.1.0-567.g7df2194.el8.x86_6 1.2 MB/s | 32 kB 00:00 2020-02-12T15:07:27.103 INFO:teuthology.orchestra.run.smithi105.stdout:(12/121): libcephfs-devel-15.1.0-567.g7df2194.e 1.0 MB/s | 21 kB 00:00 2020-02-12T15:07:27.187 INFO:teuthology.orchestra.run.smithi105.stdout:(13/121): libcephfs2-15.1.0-567.g7df2194.el8.x8 6.0 MB/s | 507 kB 00:00 2020-02-12T15:07:27.208 INFO:teuthology.orchestra.run.smithi105.stdout:(14/121): librados-devel-15.1.0-567.g7df2194.el 6.4 MB/s | 141 kB 00:00 2020-02-12T15:07:27.270 INFO:teuthology.orchestra.run.smithi105.stdout:(15/121): libradosstriper1-15.1.0-567.g7df2194. 6.0 MB/s | 377 kB 00:00 2020-02-12T15:07:27.714 INFO:teuthology.orchestra.run.smithi180.stdout:Transaction test succeeded. 2020-02-12T15:07:27.714 INFO:teuthology.orchestra.run.smithi180.stdout:Running transaction 2020-02-12T15:07:27.878 INFO:teuthology.orchestra.run.smithi105.stdout:(16/121): ceph-common-15.1.0-567.g7df2194.el8.x 2.8 MB/s | 21 MB 00:07 2020-02-12T15:07:27.906 INFO:teuthology.orchestra.run.smithi105.stdout:(17/121): python3-ceph-argparse-15.1.0-567.g7df 1.4 MB/s | 40 kB 00:00 2020-02-12T15:07:27.927 INFO:teuthology.orchestra.run.smithi105.stdout:(18/121): python3-ceph-common-15.1.0-567.g7df21 2.4 MB/s | 51 kB 00:00 2020-02-12T15:07:27.950 INFO:teuthology.orchestra.run.smithi105.stdout:(19/121): python3-cephfs-15.1.0-567.g7df2194.el 6.4 MB/s | 149 kB 00:00 2020-02-12T15:07:28.013 INFO:teuthology.orchestra.run.smithi105.stdout:(20/121): python3-rados-15.1.0-567.g7df2194.el8 5.5 MB/s | 351 kB 00:00 2020-02-12T15:07:28.058 INFO:teuthology.orchestra.run.smithi105.stdout:(21/121): python3-rbd-15.1.0-567.g7df2194.el8.x 6.7 MB/s | 309 kB 00:00 2020-02-12T15:07:28.079 INFO:teuthology.orchestra.run.smithi105.stdout:(22/121): python3-rgw-15.1.0-567.g7df2194.el8.x 5.2 MB/s | 113 kB 00:00 2020-02-12T15:07:28.104 INFO:teuthology.orchestra.run.smithi105.stdout:(23/121): rbd-fuse-15.1.0-567.g7df2194.el8.x86_ 3.4 MB/s | 72 kB 00:00 2020-02-12T15:07:28.199 INFO:teuthology.orchestra.run.smithi105.stdout:(24/121): librgw2-15.1.0-567.g7df2194.el8.x86_6 6.7 MB/s | 6.2 MB 00:00 2020-02-12T15:07:28.230 INFO:teuthology.orchestra.run.smithi105.stdout:(25/121): rbd-nbd-15.1.0-567.g7df2194.el8.x86_6 4.4 MB/s | 141 kB 00:00 2020-02-12T15:07:28.251 INFO:teuthology.orchestra.run.smithi105.stdout:(26/121): ceph-grafana-dashboards-15.1.0-567.g7 1.1 MB/s | 22 kB 00:00 2020-02-12T15:07:28.272 INFO:teuthology.orchestra.run.smithi105.stdout:(27/121): ceph-mgr-cephadm-15.1.0-567.g7df2194. 1.4 MB/s | 29 kB 00:00 2020-02-12T15:07:28.453 INFO:teuthology.orchestra.run.smithi105.stdout:(28/121): rbd-mirror-15.1.0-567.g7df2194.el8.x8 7.4 MB/s | 2.6 MB 00:00 2020-02-12T15:07:28.794 INFO:teuthology.orchestra.run.smithi105.stdout:(29/121): ceph-mgr-dashboard-15.1.0-567.g7df219 7.3 MB/s | 3.8 MB 00:00 2020-02-12T15:07:28.816 INFO:teuthology.orchestra.run.smithi105.stdout:(30/121): ceph-mgr-rook-15.1.0-567.g7df2194.el8 794 kB/s | 17 kB 00:00 2020-02-12T15:07:28.932 INFO:teuthology.orchestra.run.smithi105.stdout:(31/121): automake-1.16.1-6.el8.noarch.rpm 6.0 MB/s | 713 kB 00:00 2020-02-12T15:07:28.959 INFO:teuthology.orchestra.run.smithi105.stdout:(32/121): bison-3.0.4-10.el8.x86_64.rpm 26 MB/s | 688 kB 00:00 2020-02-12T15:07:28.978 INFO:teuthology.orchestra.run.smithi105.stdout:(33/121): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2020-02-12T15:07:28.994 INFO:teuthology.orchestra.run.smithi105.stdout:(34/121): jq-1.5-12.el8.x86_64.rpm 9.7 MB/s | 161 kB 00:00 2020-02-12T15:07:29.269 INFO:teuthology.orchestra.run.smithi105.stdout:(35/121): ceph-test-15.1.0-567.g7df2194.el8.x86 12 MB/s | 41 MB 00:03 2020-02-12T15:07:29.272 INFO:teuthology.orchestra.run.smithi105.stdout:(36/121): librdkafka-0.11.4-1.el8.x86_64.rpm 1.2 MB/s | 353 kB 00:00 2020-02-12T15:07:29.291 INFO:teuthology.orchestra.run.smithi105.stdout:(37/121): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2020-02-12T15:07:29.308 INFO:teuthology.orchestra.run.smithi105.stdout:(38/121): oniguruma-6.8.2-1.el8.x86_64.rpm 11 MB/s | 188 kB 00:00 2020-02-12T15:07:29.383 INFO:teuthology.orchestra.run.smithi105.stdout:(39/121): openblas-0.3.3-2.el8.x86_64.rpm 57 MB/s | 4.3 MB 00:00 2020-02-12T15:07:29.428 INFO:teuthology.orchestra.run.smithi105.stdout:(40/121): libtool-2.4.6-25.el8.x86_64.rpm 4.4 MB/s | 709 kB 00:00 2020-02-12T15:07:29.452 INFO:teuthology.orchestra.run.smithi105.stdout:(41/121): openblas-threads-0.3.3-2.el8.x86_64.r 64 MB/s | 4.4 MB 00:00 2020-02-12T15:07:29.454 INFO:teuthology.orchestra.run.smithi105.stdout:(42/121): python3-html5lib-0.999999999-6.el8.no 8.2 MB/s | 214 kB 00:00 2020-02-12T15:07:29.485 INFO:teuthology.orchestra.run.smithi105.stdout:(43/121): python3-lxml-4.2.3-1.el8.x86_64.rpm 46 MB/s | 1.5 MB 00:00 2020-02-12T15:07:29.486 INFO:teuthology.orchestra.run.smithi105.stdout:(44/121): python3-mako-1.0.6-13.el8.noarch.rpm 4.8 MB/s | 157 kB 00:00 2020-02-12T15:07:29.500 INFO:teuthology.orchestra.run.smithi105.stdout:(45/121): python3-markupsafe-0.23-19.el8.x86_64 2.5 MB/s | 39 kB 00:00 2020-02-12T15:07:29.517 INFO:teuthology.orchestra.run.smithi105.stdout:(46/121): python3-numpy-f2py-1.14.3-9.el8.x86_6 13 MB/s | 225 kB 00:00 2020-02-12T15:07:29.533 INFO:teuthology.orchestra.run.smithi105.stdout:(47/121): python3-prettytable-0.7.2-14.el8.noar 2.9 MB/s | 44 kB 00:00 2020-02-12T15:07:29.549 INFO:teuthology.orchestra.run.smithi105.stdout:(48/121): python3-pyasn1-0.3.7-6.el8.noarch.rpm 7.5 MB/s | 126 kB 00:00 2020-02-12T15:07:29.573 INFO:teuthology.orchestra.run.smithi105.stdout:(49/121): python3-numpy-1.14.3-9.el8.x86_64.rpm 43 MB/s | 3.7 MB 00:00 2020-02-12T15:07:29.596 INFO:teuthology.orchestra.run.smithi105.stdout:(50/121): ceph-mgr-diskprediction-local-15.1.0- 7.5 MB/s | 8.6 MB 00:01 2020-02-12T15:07:29.596 INFO:teuthology.orchestra.run.smithi105.stdout:(51/121): python3-pyasn1-modules-0.3.7-6.el8.no 2.3 MB/s | 110 kB 00:00 2020-02-12T15:07:29.597 INFO:teuthology.orchestra.run.smithi105.stdout:(52/121): python3-pytz-2017.2-9.el8.noarch.rpm 2.3 MB/s | 54 kB 00:00 2020-02-12T15:07:29.626 INFO:teuthology.orchestra.run.smithi105.stdout:(53/121): python3-werkzeug-0.12.2-4.el8.noarch. 16 MB/s | 457 kB 00:00 2020-02-12T15:07:29.638 INFO:teuthology.orchestra.run.smithi105.stdout:(54/121): python3-webencodings-0.5.1-6.el8.noar 651 kB/s | 27 kB 00:00 2020-02-12T15:07:29.657 INFO:teuthology.orchestra.run.smithi105.stdout:(55/121): socat-1.7.3.2-6.el8.x86_64.rpm 9.2 MB/s | 298 kB 00:00 2020-02-12T15:07:29.748 INFO:teuthology.orchestra.run.smithi105.stdout:(56/121): elfutils-libelf-devel-0.176-5.el8.x86 490 kB/s | 54 kB 00:00 2020-02-12T15:07:29.857 INFO:teuthology.orchestra.run.smithi105.stdout:(57/121): python3-scipy-1.0.0-20.module_el8.1.0 56 MB/s | 15 MB 00:00 2020-02-12T15:07:29.857 INFO:teuthology.orchestra.run.smithi105.stdout:(58/121): fuse-common-3.2.1-12.el8.x86_64.rpm 194 kB/s | 21 kB 00:00 2020-02-12T15:07:29.858 INFO:teuthology.orchestra.run.smithi105.stdout:(59/121): fuse-2.9.7-12.el8.x86_64.rpm 412 kB/s | 82 kB 00:00 2020-02-12T15:07:29.886 INFO:teuthology.orchestra.run.smithi105.stdout:(60/121): libaio-devel-0.3.112-1.el8.x86_64.rpm 670 kB/s | 19 kB 00:00 2020-02-12T15:07:29.914 INFO:teuthology.orchestra.run.smithi105.stdout:(61/121): libcom_err-devel-1.44.6-3.el8.x86_64. 1.3 MB/s | 38 kB 00:00 2020-02-12T15:07:29.967 INFO:teuthology.orchestra.run.smithi105.stdout:(62/121): keyutils-libs-devel-1.5.10-6.el8.x86_ 435 kB/s | 48 kB 00:00 2020-02-12T15:07:29.969 INFO:teuthology.orchestra.run.smithi105.stdout:(63/121): krb5-devel-1.17-9.el8.x86_64.rpm 4.8 MB/s | 548 kB 00:00 2020-02-12T15:07:29.997 INFO:teuthology.orchestra.run.smithi105.stdout:(64/121): librabbitmq-0.9.0-1.el8.x86_64.rpm 1.6 MB/s | 47 kB 00:00 2020-02-12T15:07:30.025 INFO:teuthology.orchestra.run.smithi105.stdout:(65/121): libgfortran-8.3.1-4.5.el8.x86_64.rpm 5.6 MB/s | 638 kB 00:00 2020-02-12T15:07:30.026 INFO:teuthology.orchestra.run.smithi105.stdout:(66/121): libselinux-devel-2.9-2.1.el8.x86_64.r 6.7 MB/s | 199 kB 00:00 2020-02-12T15:07:30.049 INFO:teuthology.orchestra.run.smithi105.stdout:(67/121): libquadmath-8.3.1-4.5.el8.x86_64.rpm 2.0 MB/s | 169 kB 00:00 2020-02-12T15:07:30.053 INFO:teuthology.orchestra.run.smithi105.stdout:(68/121): libsepol-devel-2.9-1.el8.x86_64.rpm 3.0 MB/s | 86 kB 00:00 2020-02-12T15:07:30.054 INFO:teuthology.orchestra.run.smithi105.stdout:(69/121): libuuid-devel-2.32.1-17.el8.x86_64.rp 3.3 MB/s | 95 kB 00:00 2020-02-12T15:07:30.077 INFO:teuthology.orchestra.run.smithi105.stdout:(70/121): libverto-devel-0.3.0-5.el8.x86_64.rpm 641 kB/s | 18 kB 00:00 2020-02-12T15:07:30.082 INFO:teuthology.orchestra.run.smithi105.stdout:(71/121): libxslt-1.1.32-3.el8.x86_64.rpm 8.4 MB/s | 249 kB 00:00 2020-02-12T15:07:30.112 INFO:teuthology.orchestra.run.smithi105.stdout:(72/121): pcre2-utf16-10.32-1.el8.x86_64.rpm 7.6 MB/s | 228 kB 00:00 2020-02-12T15:07:30.135 INFO:teuthology.orchestra.run.smithi105.stdout:(73/121): pcre2-devel-10.32-1.el8.x86_64.rpm 10 MB/s | 605 kB 00:00 2020-02-12T15:07:30.144 INFO:teuthology.orchestra.run.smithi105.stdout:(74/121): openssl-devel-1.1.1c-2.el8.x86_64.rpm 25 MB/s | 2.3 MB 00:00 2020-02-12T15:07:30.146 INFO:teuthology.orchestra.run.smithi105.stdout:(75/121): pcre2-utf32-10.32-1.el8.x86_64.rpm 6.4 MB/s | 220 kB 00:00 2020-02-12T15:07:30.165 INFO:teuthology.orchestra.run.smithi105.stdout:(76/121): python3-chardet-3.0.4-7.el8.noarch.rp 6.6 MB/s | 195 kB 00:00 2020-02-12T15:07:30.172 INFO:teuthology.orchestra.run.smithi105.stdout:(77/121): python3-jwt-1.6.1-2.el8.noarch.rpm 1.5 MB/s | 43 kB 00:00 2020-02-12T15:07:30.175 INFO:teuthology.orchestra.run.smithi105.stdout:(78/121): python3-oauthlib-2.1.0-1.el8.noarch.r 5.3 MB/s | 155 kB 00:00 2020-02-12T15:07:30.194 INFO:teuthology.orchestra.run.smithi105.stdout:(79/121): python3-pysocks-1.6.8-3.el8.noarch.rp 1.2 MB/s | 34 kB 00:00 2020-02-12T15:07:30.201 INFO:teuthology.orchestra.run.smithi105.stdout:(80/121): python3-requests-2.20.0-2.1.el8_1.noa 4.2 MB/s | 123 kB 00:00 2020-02-12T15:07:30.203 INFO:teuthology.orchestra.run.smithi105.stdout:(81/121): python3-requests-oauthlib-1.0.0-1.el8 1.5 MB/s | 43 kB 00:00 2020-02-12T15:07:30.221 INFO:teuthology.orchestra.run.smithi105.stdout:(82/121): python3-urllib3-1.24.2-2.el8.noarch.r 5.9 MB/s | 176 kB 00:00 2020-02-12T15:07:30.229 INFO:teuthology.orchestra.run.smithi105.stdout:(83/121): xfsprogs-devel-5.0.0-1.el8.x86_64.rpm 2.4 MB/s | 69 kB 00:00 2020-02-12T15:07:30.237 INFO:teuthology.orchestra.run.smithi105.stdout:(84/121): zlib-devel-1.2.11-10.el8.x86_64.rpm 1.7 MB/s | 56 kB 00:00 2020-02-12T15:07:30.282 INFO:teuthology.orchestra.run.smithi105.stdout:(85/121): python3-cheroot-8.2.1-1.el8.noarch.rp 2.3 MB/s | 145 kB 00:00 2020-02-12T15:07:30.291 INFO:teuthology.orchestra.run.smithi105.stdout:(86/121): python3-jaraco-6.2-6.el8.noarch.rpm 1.3 MB/s | 11 kB 00:00 2020-02-12T15:07:30.298 INFO:teuthology.orchestra.run.smithi105.stdout:(87/121): python3-cherrypy-18.4.0-1.el8.noarch. 5.5 MB/s | 385 kB 00:00 2020-02-12T15:07:30.299 INFO:teuthology.orchestra.run.smithi105.stdout:(88/121): python3-execnet-1.7.1-1.el8.2.noarch. 5.4 MB/s | 356 kB 00:00 2020-02-12T15:07:30.300 INFO:teuthology.orchestra.run.smithi105.stdout:(89/121): python3-jaraco-functools-2.0-4.el8.no 2.1 MB/s | 18 kB 00:00 2020-02-12T15:07:30.306 INFO:teuthology.orchestra.run.smithi105.stdout:(90/121): python3-logutils-0.3.5-11.el8.noarch. 5.6 MB/s | 49 kB 00:00 2020-02-12T15:07:30.310 INFO:teuthology.orchestra.run.smithi105.stdout:(91/121): python3-more-itertools-7.2.0-3.el8.no 5.6 MB/s | 59 kB 00:00 2020-02-12T15:07:30.315 INFO:teuthology.orchestra.run.smithi105.stdout:(92/121): python3-portend-2.6-1.el8.noarch.rpm 1.9 MB/s | 16 kB 00:00 2020-02-12T15:07:30.319 INFO:teuthology.orchestra.run.smithi105.stdout:(93/121): python3-remoto-1.1.4-4.el8.noarch.rpm 5.2 MB/s | 48 kB 00:00 2020-02-12T15:07:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:(94/121): python3-pecan-1.3.2-9.el8.noarch.rpm 12 MB/s | 283 kB 00:00 2020-02-12T15:07:30.324 INFO:teuthology.orchestra.run.smithi105.stdout:(95/121): python3-repoze-lru-0.7-6.el8.noarch.r 3.6 MB/s | 34 kB 00:00 2020-02-12T15:07:30.330 INFO:teuthology.orchestra.run.smithi105.stdout:(96/121): python3-routes-2.4.1-12.el8.noarch.rp 17 MB/s | 197 kB 00:00 2020-02-12T15:07:30.333 INFO:teuthology.orchestra.run.smithi105.stdout:(97/121): python3-singledispatch-3.4.0.3-18.el8 2.7 MB/s | 24 kB 00:00 2020-02-12T15:07:30.335 INFO:teuthology.orchestra.run.smithi105.stdout:(98/121): python3-simplegeneric-0.8.1-17.el8.no 1.6 MB/s | 19 kB 00:00 2020-02-12T15:07:30.339 INFO:teuthology.orchestra.run.smithi105.stdout:(99/121): python3-tempora-1.14.1-5.el8.noarch.r 3.5 MB/s | 30 kB 00:00 2020-02-12T15:07:30.343 INFO:teuthology.orchestra.run.smithi105.stdout:(100/121): python3-trustme-0.5.2-4.el8.noarch.r 2.6 MB/s | 27 kB 00:00 2020-02-12T15:07:30.345 INFO:teuthology.orchestra.run.smithi105.stdout:(101/121): python3-zc-lockfile-2.0-2.el8.noarch 2.5 MB/s | 23 kB 00:00 2020-02-12T15:07:30.408 INFO:teuthology.orchestra.run.smithi105.stdout:(102/121): libunwind-1.3.1-3.el8.x86_64.rpm 1.2 MB/s | 75 kB 00:00 2020-02-12T15:07:30.418 INFO:teuthology.orchestra.run.smithi105.stdout:(103/121): liboath-2.6.2-3.el8.x86_64.rpm 787 kB/s | 59 kB 00:00 2020-02-12T15:07:30.423 INFO:teuthology.orchestra.run.smithi105.stdout:(104/121): python3-apipkg-1.5-6.el8.noarch.rpm 1.3 MB/s | 21 kB 00:00 2020-02-12T15:07:30.453 INFO:teuthology.orchestra.run.smithi105.stdout:(105/121): gperftools-libs-2.7-6.el8.x86_64.rpm 2.7 MB/s | 315 kB 00:00 2020-02-12T15:07:30.455 INFO:teuthology.orchestra.run.smithi105.stdout:(106/121): python3-beautifulsoup4-4.6.3-2.el8.1 5.7 MB/s | 185 kB 00:00 2020-02-12T15:07:30.456 INFO:teuthology.orchestra.run.smithi105.stdout:(107/121): python3-bcrypt-3.1.6-2.el8.1.x86_64. 1.1 MB/s | 44 kB 00:00 2020-02-12T15:07:30.471 INFO:teuthology.orchestra.run.smithi105.stdout:(108/121): python3-cssselect-0.9.2-10.el8.noarc 2.5 MB/s | 40 kB 00:00 2020-02-12T15:07:30.472 INFO:teuthology.orchestra.run.smithi105.stdout:(109/121): python3-cachetools-3.1.1-4.el8.noarc 1.7 MB/s | 33 kB 00:00 2020-02-12T15:07:30.474 INFO:teuthology.orchestra.run.smithi105.stdout:(110/121): python3-certifi-2018.10.15-7.el8.noa 857 kB/s | 16 kB 00:00 2020-02-12T15:07:30.488 INFO:teuthology.orchestra.run.smithi105.stdout:(111/121): python3-google-auth-1.1.1-10.el8.noa 5.0 MB/s | 81 kB 00:00 2020-02-12T15:07:30.512 INFO:teuthology.orchestra.run.smithi105.stdout:(112/121): python3-rsa-3.4.2-12.el8.noarch.rpm 1.9 MB/s | 73 kB 00:00 2020-02-12T15:07:30.519 INFO:teuthology.orchestra.run.smithi105.stdout:(113/121): python3-waitress-1.2.1-2.el8.1.noarc 7.5 MB/s | 241 kB 00:00 2020-02-12T15:07:30.535 INFO:teuthology.orchestra.run.smithi105.stdout:(114/121): python3-websocket-client-0.56.0-5.el 3.8 MB/s | 61 kB 00:00 2020-02-12T15:07:30.551 INFO:teuthology.orchestra.run.smithi105.stdout:(115/121): python3-webob-1.8.5-1.el8.1.noarch.r 6.4 MB/s | 251 kB 00:00 2020-02-12T15:07:30.552 INFO:teuthology.orchestra.run.smithi105.stdout:(116/121): python3-webtest-2.0.33-1.el8.noarch. 5.2 MB/s | 85 kB 00:00 2020-02-12T15:07:30.554 INFO:teuthology.orchestra.run.smithi105.stdout:(117/121): xmlstarlet-1.6.1-13.el8.x86_64.rpm 24 MB/s | 69 kB 00:00 2020-02-12T15:07:30.556 INFO:teuthology.orchestra.run.smithi105.stdout:(118/121): leveldb-1.21-2.el8.x86_64.rpm 33 MB/s | 179 kB 00:00 2020-02-12T15:07:30.569 INFO:teuthology.orchestra.run.smithi105.stdout:(119/121): python3-kubernetes-10.0.1-1.el8.noar 12 MB/s | 1.1 MB 00:00 2020-02-12T15:07:30.855 INFO:teuthology.orchestra.run.smithi105.stdout:(120/121): librbd1-15.1.0-567.g7df2194.el8.x86_ 6.3 MB/s | 1.9 MB 00:00 2020-02-12T15:07:30.905 INFO:teuthology.orchestra.run.smithi105.stdout:(121/121): librados2-15.1.0-567.g7df2194.el8.x8 10 MB/s | 3.6 MB 00:00 2020-02-12T15:07:30.909 INFO:teuthology.orchestra.run.smithi105.stdout:-------------------------------------------------------------------------------- 2020-02-12T15:07:30.909 INFO:teuthology.orchestra.run.smithi105.stdout:Total 16 MB/s | 176 MB 00:10 2020-02-12T15:07:30.969 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction check 2020-02-12T15:07:31.076 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction check succeeded. 2020-02-12T15:07:31.077 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction test 2020-02-12T15:07:32.210 INFO:teuthology.orchestra.run.smithi180.stdout: Preparing : 1/1 2020-02-12T15:07:32.362 INFO:teuthology.orchestra.run.smithi105.stdout:Transaction test succeeded. 2020-02-12T15:07:32.363 INFO:teuthology.orchestra.run.smithi105.stdout:Running transaction 2020-02-12T15:07:32.390 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-02-12T15:07:32.606 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/123 2020-02-12T15:07:32.812 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T15:07:33.203 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T15:07:33.354 INFO:teuthology.orchestra.run.smithi180.stdout: Upgrading : librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T15:07:33.615 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T15:07:33.821 INFO:teuthology.orchestra.run.smithi180.stdout: Upgrading : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T15:07:33.924 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T15:07:34.054 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T15:07:34.131 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T15:07:34.320 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T15:07:34.512 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T15:07:35.123 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T15:07:35.279 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T15:07:35.373 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T15:07:35.595 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/123 2020-02-12T15:07:35.779 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T15:07:35.895 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T15:07:36.073 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/123 2020-02-12T15:07:36.259 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/123 2020-02-12T15:07:36.491 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/123 2020-02-12T15:07:36.572 INFO:teuthology.orchestra.run.smithi105.stdout: Preparing : 1/1 2020-02-12T15:07:36.695 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/123 2020-02-12T15:07:36.739 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/123 2020-02-12T15:07:36.921 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/123 2020-02-12T15:07:36.925 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librabbitmq-0.9.0-1.el8.x86_64 2/123 2020-02-12T15:07:37.054 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T15:07:37.126 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T15:07:37.210 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T15:07:37.378 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T15:07:37.512 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/123 2020-02-12T15:07:37.668 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T15:07:37.901 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T15:07:37.920 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T15:07:38.084 INFO:teuthology.orchestra.run.smithi105.stdout: Upgrading : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T15:07:38.086 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T15:07:38.174 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 5/123 2020-02-12T15:07:38.346 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T15:07:38.424 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T15:07:38.600 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T15:07:38.610 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T15:07:38.753 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T15:07:38.768 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T15:07:39.379 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 8/123 2020-02-12T15:07:39.475 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T15:07:39.517 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T15:07:39.622 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T15:07:39.821 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/123 2020-02-12T15:07:39.845 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/123 2020-02-12T15:07:39.951 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T15:07:40.058 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/123 2020-02-12T15:07:40.069 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 11/123 2020-02-12T15:07:40.261 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 23/123 2020-02-12T15:07:40.271 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 12/123 2020-02-12T15:07:40.432 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 13/123 2020-02-12T15:07:40.492 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T15:07:40.633 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : zlib-devel-1.2.11-10.el8.x86_64 14/123 2020-02-12T15:07:40.736 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T15:07:40.809 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 15/123 2020-02-12T15:07:41.016 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libxslt-1.1.32-3.el8.x86_64 16/123 2020-02-12T15:07:41.171 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T15:07:41.293 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libquadmath-8.3.1-4.5.el8.x86_64 17/123 2020-02-12T15:07:41.451 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T15:07:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libgfortran-8.3.1-4.5.el8.x86_64 18/123 2020-02-12T15:07:42.126 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T15:07:42.666 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openblas-0.3.3-2.el8.x86_64 19/123 2020-02-12T15:07:42.710 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T15:07:42.792 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T15:07:43.030 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/123 2020-02-12T15:07:43.249 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 27/123 2020-02-12T15:07:43.510 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: openblas-threads-0.3.3-2.el8.x86_64 20/123 2020-02-12T15:07:43.523 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/123 2020-02-12T15:07:43.767 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/123 2020-02-12T15:07:43.842 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 21/123 2020-02-12T15:07:43.964 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/123 2020-02-12T15:07:44.022 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 22/123 2020-02-12T15:07:44.173 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 31/123 2020-02-12T15:07:44.187 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 23/123 2020-02-12T15:07:44.341 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 32/123 2020-02-12T15:07:44.463 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T15:07:44.580 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 33/123 2020-02-12T15:07:44.717 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T15:07:44.841 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/123 2020-02-12T15:07:45.037 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/123 2020-02-12T15:07:45.225 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/123 2020-02-12T15:07:45.391 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/123 2020-02-12T15:07:45.665 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/123 2020-02-12T15:07:45.886 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/123 2020-02-12T15:07:46.108 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/123 2020-02-12T15:07:46.347 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/123 2020-02-12T15:07:46.594 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/123 2020-02-12T15:07:46.681 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 25/123 2020-02-12T15:07:46.769 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/123 2020-02-12T15:07:46.968 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 26/123 2020-02-12T15:07:47.004 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/123 2020-02-12T15:07:47.176 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/123 2020-02-12T15:07:47.187 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xmlstarlet-1.6.1-13.el8.x86_64 27/123 2020-02-12T15:07:47.351 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/123 2020-02-12T15:07:47.453 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 28/123 2020-02-12T15:07:47.534 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/123 2020-02-12T15:07:47.691 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/123 2020-02-12T15:07:47.747 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 29/123 2020-02-12T15:07:47.856 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/123 2020-02-12T15:07:47.928 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rsa-3.4.2-12.el8.noarch 30/123 2020-02-12T15:07:48.037 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/123 2020-02-12T15:07:48.120 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 31/123 2020-02-12T15:07:48.218 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/123 2020-02-12T15:07:48.339 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 32/123 2020-02-12T15:07:48.420 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/123 2020-02-12T15:07:48.502 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 33/123 2020-02-12T15:07:48.604 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/123 2020-02-12T15:07:48.762 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 34/123 2020-02-12T15:07:48.774 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/123 2020-02-12T15:07:48.926 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-waitress-1.2.1-2.el8.1.noarch 35/123 2020-02-12T15:07:48.967 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/123 2020-02-12T15:07:49.073 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cssselect-0.9.2-10.el8.noarch 36/123 2020-02-12T15:07:49.167 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/123 2020-02-12T15:07:49.238 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 37/123 2020-02-12T15:07:49.390 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/123 2020-02-12T15:07:49.453 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 38/123 2020-02-12T15:07:49.634 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 39/123 2020-02-12T15:07:49.839 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 40/123 2020-02-12T15:07:49.957 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/123 2020-02-12T15:07:50.086 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 41/123 2020-02-12T15:07:50.166 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/123 2020-02-12T15:07:50.286 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-execnet-1.7.1-1.el8.2.noarch 42/123 2020-02-12T15:07:50.374 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/123 2020-02-12T15:07:50.450 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-remoto-1.1.4-4.el8.noarch 43/123 2020-02-12T15:07:50.635 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 44/123 2020-02-12T15:07:50.799 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : gperftools-libs-2.7-6.el8.x86_64 45/123 2020-02-12T15:07:50.982 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : leveldb-1.21-2.el8.x86_64 46/123 2020-02-12T15:07:51.140 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 47/123 2020-02-12T15:07:51.298 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-trustme-0.5.2-4.el8.noarch 48/123 2020-02-12T15:07:51.415 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/123 2020-02-12T15:07:51.437 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 49/123 2020-02-12T15:07:51.584 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 50/123 2020-02-12T15:07:51.670 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 62/123 2020-02-12T15:07:51.765 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 51/123 2020-02-12T15:07:51.863 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/123 2020-02-12T15:07:51.959 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 52/123 2020-02-12T15:07:52.133 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 53/123 2020-02-12T15:07:52.181 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/123 2020-02-12T15:07:52.271 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 54/123 2020-02-12T15:07:52.370 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/123 2020-02-12T15:07:52.462 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 55/123 2020-02-12T15:07:52.516 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/123 2020-02-12T15:07:52.623 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cheroot-8.2.1-1.el8.noarch 56/123 2020-02-12T15:07:52.673 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/123 2020-02-12T15:07:52.954 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pysocks-1.6.8-3.el8.noarch 57/123 2020-02-12T15:07:52.954 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T15:07:53.158 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-urllib3-1.24.2-2.el8.noarch 58/123 2020-02-12T15:07:53.180 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/123 2020-02-12T15:07:53.345 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-chardet-3.0.4-7.el8.noarch 59/123 2020-02-12T15:07:53.347 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/123 2020-02-12T15:07:53.537 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-2.20.0-2.1.el8_1.noarch 60/123 2020-02-12T15:07:53.573 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/123 2020-02-12T15:07:53.795 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/123 2020-02-12T15:07:53.795 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/123 2020-02-12T15:07:53.795 INFO:teuthology.orchestra.run.smithi180.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-02-12T15:07:53.795 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:07:54.218 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/123 2020-02-12T15:07:54.387 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/123 2020-02-12T15:07:54.548 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 61/123 2020-02-12T15:07:54.637 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/123 2020-02-12T15:07:54.751 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-kubernetes-10.0.1-1.el8.noarch 62/123 2020-02-12T15:07:54.905 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/123 2020-02-12T15:07:54.951 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-utf32-10.32-1.el8.x86_64 63/123 2020-02-12T15:07:55.262 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-utf16-10.32-1.el8.x86_64 64/123 2020-02-12T15:07:55.468 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : pcre2-devel-10.32-1.el8.x86_64 65/123 2020-02-12T15:07:55.524 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/123 2020-02-12T15:07:55.589 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 66/123 2020-02-12T15:07:55.771 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libuuid-devel-2.32.1-17.el8.x86_64 67/123 2020-02-12T15:07:55.797 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/123 2020-02-12T15:07:56.014 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T15:07:56.047 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/123 2020-02-12T15:07:56.190 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libselinux-devel-2.9-2.1.el8.x86_64 69/123 2020-02-12T15:07:56.253 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/123 2020-02-12T15:07:56.335 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcom_err-devel-1.44.6-3.el8.x86_64 70/123 2020-02-12T15:07:56.480 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/123 2020-02-12T15:07:56.524 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 71/123 2020-02-12T15:07:56.726 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/123 2020-02-12T15:07:56.726 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : krb5-devel-1.17-9.el8.x86_64 72/123 2020-02-12T15:07:56.726 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-common-3.2.1-12.el8.x86_64 73/123 2020-02-12T15:07:56.727 INFO:teuthology.orchestra.run.smithi105.stdout:warning: /etc/fuse.conf created as /etc/fuse.conf.rpmnew 2020-02-12T15:07:56.727 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:07:56.992 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/123 2020-02-12T15:07:57.142 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : fuse-2.9.7-12.el8.x86_64 74/123 2020-02-12T15:07:57.163 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/123 2020-02-12T15:07:57.334 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : socat-1.7.3.2-6.el8.x86_64 75/123 2020-02-12T15:07:57.430 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-02-12T15:07:57.576 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webencodings-0.5.1-6.el8.noarch 76/123 2020-02-12T15:07:57.758 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/123 2020-02-12T15:07:57.802 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-html5lib-1:0.999999999-6.el8.noarch 77/123 2020-02-12T15:07:58.053 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/123 2020-02-12T15:07:58.225 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T15:07:58.300 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T15:07:58.512 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 78/123 2020-02-12T15:07:58.569 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : jq-1.5-12.el8.x86_64 90/123 2020-02-12T15:07:58.755 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-lxml-4.2.3-1.el8.x86_64 79/123 2020-02-12T15:07:58.798 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : automake-1.16.1-6.el8.noarch 91/123 2020-02-12T15:07:58.979 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 80/123 2020-02-12T15:07:59.024 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 92/123 2020-02-12T15:07:59.176 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 81/123 2020-02-12T15:07:59.250 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 93/123 2020-02-12T15:07:59.378 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 82/123 2020-02-12T15:07:59.629 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-portend-2.6-1.el8.noarch 83/123 2020-02-12T15:07:59.907 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 84/123 2020-02-12T15:08:00.069 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 85/123 2020-02-12T15:08:00.293 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 86/123 2020-02-12T15:08:00.615 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 87/123 2020-02-12T15:08:00.910 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 88/123 2020-02-12T15:08:01.065 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T15:08:01.138 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: oniguruma-6.8.2-1.el8.x86_64 89/123 2020-02-12T15:08:01.468 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : jq-1.5-12.el8.x86_64 90/123 2020-02-12T15:08:01.704 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : automake-1.16.1-6.el8.noarch 91/123 2020-02-12T15:08:01.914 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 92/123 2020-02-12T15:08:02.069 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 93/123 2020-02-12T15:08:02.769 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T15:08:02.974 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T15:08:03.645 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T15:08:03.932 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T15:08:04.038 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T15:08:04.182 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T15:08:05.490 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T15:08:05.740 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T15:08:06.406 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 94/123 2020-02-12T15:08:06.656 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T15:08:06.747 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 95/123 2020-02-12T15:08:06.906 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T15:08:20.621 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T15:08:20.621 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /sys 2020-02-12T15:08:20.622 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /proc 2020-02-12T15:08:20.622 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /dev 2020-02-12T15:08:20.622 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /run 2020-02-12T15:08:20.622 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /mnt 2020-02-12T15:08:20.622 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /var/tmp 2020-02-12T15:08:20.622 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /home 2020-02-12T15:08:20.622 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /tmp 2020-02-12T15:08:20.623 INFO:teuthology.orchestra.run.smithi180.stdout:skipping the directory /dev 2020-02-12T15:08:20.623 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:21.054 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T15:08:21.249 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T15:08:21.438 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T15:08:21.817 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T15:08:22.024 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T15:08:23.072 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 96/123 2020-02-12T15:08:23.072 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /sys 2020-02-12T15:08:23.072 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /proc 2020-02-12T15:08:23.072 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /dev 2020-02-12T15:08:23.073 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /run 2020-02-12T15:08:23.073 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /mnt 2020-02-12T15:08:23.073 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /var/tmp 2020-02-12T15:08:23.073 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /home 2020-02-12T15:08:23.073 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /tmp 2020-02-12T15:08:23.073 INFO:teuthology.orchestra.run.smithi105.stdout:skipping the directory /dev 2020-02-12T15:08:23.073 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:23.438 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T15:08:23.529 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T15:08:23.637 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T15:08:23.661 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T15:08:23.724 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 97/123 2020-02-12T15:08:23.904 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T15:08:24.284 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 98/123 2020-02-12T15:08:24.461 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T15:08:25.027 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T15:08:25.216 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T15:08:25.361 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T15:08:25.376 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T15:08:25.881 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 99/123 2020-02-12T15:08:26.086 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T15:08:26.111 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 100/123 2020-02-12T15:08:26.326 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-2:15.1.0-567.g7df2194.el8.x86_64 103/123 2020-02-12T15:08:26.619 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T15:08:27.373 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T15:08:27.549 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 101/123 2020-02-12T15:08:27.661 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T15:08:27.727 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T15:08:27.741 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 102/123 2020-02-12T15:08:27.871 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T15:08:27.886 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T15:08:28.061 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T15:08:28.649 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-2:15.1.0-567.g7df2194.el8.x86_64 103/123 2020-02-12T15:08:28.911 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T15:08:28.949 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T15:08:29.169 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T15:08:29.474 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T15:08:29.671 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T15:08:29.951 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 104/123 2020-02-12T15:08:30.136 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T15:08:30.153 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 105/123 2020-02-12T15:08:30.303 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T15:08:31.184 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 106/123 2020-02-12T15:08:31.969 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T15:08:32.272 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 107/123 2020-02-12T15:08:32.526 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T15:08:33.497 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T15:08:33.825 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 109/123 2020-02-12T15:08:34.422 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T15:08:34.484 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T15:08:36.190 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 111/123 2020-02-12T15:08:36.340 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 108/123 2020-02-12T15:08:36.462 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 112/123 2020-02-12T15:08:36.637 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-02-12T15:08:36.647 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 109/123 2020-02-12T15:08:36.820 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 114/123 2020-02-12T15:08:36.942 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-02-12T15:08:37.139 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 116/123 2020-02-12T15:08:37.243 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T15:08:37.321 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 110/123 2020-02-12T15:08:37.370 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 117/123 2020-02-12T15:08:37.559 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T15:08:37.582 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T15:08:37.752 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-02-12T15:08:38.001 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T15:08:38.107 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T15:08:38.342 INFO:teuthology.orchestra.run.smithi180.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T15:08:38.357 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T15:08:38.357 INFO:teuthology.orchestra.run.smithi180.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T15:08:38.620 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T15:08:38.621 INFO:teuthology.orchestra.run.smithi180.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T15:08:38.972 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 111/123 2020-02-12T15:08:39.204 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : openssl-devel-1:1.1.1c-2.el8.x86_64 112/123 2020-02-12T15:08:39.346 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : xfsprogs-devel-5.0.0-1.el8.x86_64 113/123 2020-02-12T15:08:39.438 INFO:teuthology.orchestra.run.smithi180.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T15:08:39.438 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-2:15.1.0-567.g7df2194.el8.x86_64 1/123 2020-02-12T15:08:39.438 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2/123 2020-02-12T15:08:39.438 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 3/123 2020-02-12T15:08:39.439 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T15:08:39.439 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-immutable-object-cache-2:15.1.0-567.g7df219 5/123 2020-02-12T15:08:39.439 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T15:08:39.439 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T15:08:39.439 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 8/123 2020-02-12T15:08:39.439 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T15:08:39.439 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 10/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 11/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 12/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 13/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 14/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 15/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 16/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 17/123 2020-02-12T15:08:39.440 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 18/123 2020-02-12T15:08:39.441 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 19/123 2020-02-12T15:08:39.441 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 20/123 2020-02-12T15:08:39.441 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 21/123 2020-02-12T15:08:39.441 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 22/123 2020-02-12T15:08:39.441 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 23/123 2020-02-12T15:08:39.441 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T15:08:39.441 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 25/123 2020-02-12T15:08:39.442 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 26/123 2020-02-12T15:08:39.442 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 27/123 2020-02-12T15:08:39.442 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 28/123 2020-02-12T15:08:39.442 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 29/123 2020-02-12T15:08:39.442 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 30/123 2020-02-12T15:08:39.451 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 31/123 2020-02-12T15:08:39.451 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 32/123 2020-02-12T15:08:39.451 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : automake-1.16.1-6.el8.noarch 33/123 2020-02-12T15:08:39.451 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : bison-3.0.4-10.el8.x86_64 34/123 2020-02-12T15:08:39.451 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : flex-2.6.1-9.el8.x86_64 35/123 2020-02-12T15:08:39.452 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : jq-1.5-12.el8.x86_64 36/123 2020-02-12T15:08:39.452 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 37/123 2020-02-12T15:08:39.452 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 38/123 2020-02-12T15:08:39.452 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 39/123 2020-02-12T15:08:39.452 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 40/123 2020-02-12T15:08:39.452 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 41/123 2020-02-12T15:08:39.452 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 42/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 43/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 44/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 45/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 46/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 47/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 48/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 49/123 2020-02-12T15:08:39.453 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 50/123 2020-02-12T15:08:39.454 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 51/123 2020-02-12T15:08:39.454 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 52/123 2020-02-12T15:08:39.454 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 53/123 2020-02-12T15:08:39.454 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 54/123 2020-02-12T15:08:39.454 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 55/123 2020-02-12T15:08:39.454 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 56/123 2020-02-12T15:08:39.454 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 57/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 58/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 59/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 61/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 63/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 64/123 2020-02-12T15:08:39.455 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 65/123 2020-02-12T15:08:39.456 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 66/123 2020-02-12T15:08:39.456 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 67/123 2020-02-12T15:08:39.456 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T15:08:39.456 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 69/123 2020-02-12T15:08:39.456 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/123 2020-02-12T15:08:39.456 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 71/123 2020-02-12T15:08:39.456 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 72/123 2020-02-12T15:08:39.457 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 73/123 2020-02-12T15:08:39.457 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 74/123 2020-02-12T15:08:39.457 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 75/123 2020-02-12T15:08:39.457 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 76/123 2020-02-12T15:08:39.457 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/123 2020-02-12T15:08:39.457 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 78/123 2020-02-12T15:08:39.457 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 79/123 2020-02-12T15:08:39.458 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 80/123 2020-02-12T15:08:39.458 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/123 2020-02-12T15:08:39.458 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 82/123 2020-02-12T15:08:39.458 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 83/123 2020-02-12T15:08:39.458 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 84/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 85/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 86/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 87/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 88/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 89/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 90/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 91/123 2020-02-12T15:08:39.459 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 92/123 2020-02-12T15:08:39.460 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-portend-2.6-1.el8.noarch 93/123 2020-02-12T15:08:39.460 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 94/123 2020-02-12T15:08:39.460 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 95/123 2020-02-12T15:08:39.460 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 96/123 2020-02-12T15:08:39.460 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 97/123 2020-02-12T15:08:39.460 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 98/123 2020-02-12T15:08:39.460 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 99/123 2020-02-12T15:08:39.461 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 100/123 2020-02-12T15:08:39.461 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 101/123 2020-02-12T15:08:39.461 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/123 2020-02-12T15:08:39.461 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 103/123 2020-02-12T15:08:39.461 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 104/123 2020-02-12T15:08:39.461 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 105/123 2020-02-12T15:08:39.461 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 106/123 2020-02-12T15:08:39.462 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 107/123 2020-02-12T15:08:39.462 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 108/123 2020-02-12T15:08:39.462 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 109/123 2020-02-12T15:08:39.462 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 110/123 2020-02-12T15:08:39.462 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 111/123 2020-02-12T15:08:39.462 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 112/123 2020-02-12T15:08:39.462 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 113/123 2020-02-12T15:08:39.463 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 114/123 2020-02-12T15:08:39.463 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 115/123 2020-02-12T15:08:39.463 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 116/123 2020-02-12T15:08:39.463 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 117/123 2020-02-12T15:08:39.463 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : leveldb-1.21-2.el8.x86_64 118/123 2020-02-12T15:08:39.463 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 119/123 2020-02-12T15:08:39.463 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librados2-2:15.1.0-567.g7df2194.el8.x86_64 120/123 2020-02-12T15:08:39.464 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-02-12T15:08:39.464 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 122/123 2020-02-12T15:08:39.496 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 114/123 2020-02-12T15:08:39.658 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : elfutils-libelf-devel-0.176-5.el8.x86_64 115/123 2020-02-12T15:08:39.831 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 116/123 2020-02-12T15:08:40.020 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 117/123 2020-02-12T15:08:40.193 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T15:08:40.219 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.1.0-567.g7df219 118/123 2020-02-12T15:08:40.386 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 119/123 2020-02-12T15:08:40.617 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T15:08:40.709 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/123 2020-02-12T15:08:40.934 INFO:teuthology.orchestra.run.smithi105.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T15:08:40.950 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/123 2020-02-12T15:08:40.953 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T15:08:41.031 INFO:teuthology.orchestra.run.smithi180.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T15:08:41.031 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:41.031 INFO:teuthology.orchestra.run.smithi180.stdout:Upgraded: 2020-02-12T15:08:41.032 INFO:teuthology.orchestra.run.smithi180.stdout: librados2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.032 INFO:teuthology.orchestra.run.smithi180.stdout: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.032 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:41.032 INFO:teuthology.orchestra.run.smithi180.stdout:Installed: 2020-02-12T15:08:41.032 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.032 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.032 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.033 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-immutable-object-cache-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.033 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.033 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.033 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.033 INFO:teuthology.orchestra.run.smithi180.stdout: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.033 INFO:teuthology.orchestra.run.smithi180.stdout: libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.034 INFO:teuthology.orchestra.run.smithi180.stdout: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.034 INFO:teuthology.orchestra.run.smithi180.stdout: librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.034 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.034 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.034 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.035 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.035 INFO:teuthology.orchestra.run.smithi180.stdout: rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.035 INFO:teuthology.orchestra.run.smithi180.stdout: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.035 INFO:teuthology.orchestra.run.smithi180.stdout: rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.035 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:41.035 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:41.036 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:41.036 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:41.036 INFO:teuthology.orchestra.run.smithi180.stdout: bison-3.0.4-10.el8.x86_64 2020-02-12T15:08:41.036 INFO:teuthology.orchestra.run.smithi180.stdout: flex-2.6.1-9.el8.x86_64 2020-02-12T15:08:41.036 INFO:teuthology.orchestra.run.smithi180.stdout: libtool-2.4.6-25.el8.x86_64 2020-02-12T15:08:41.036 INFO:teuthology.orchestra.run.smithi180.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-02-12T15:08:41.036 INFO:teuthology.orchestra.run.smithi180.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-02-12T15:08:41.037 INFO:teuthology.orchestra.run.smithi180.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-02-12T15:08:41.037 INFO:teuthology.orchestra.run.smithi180.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-02-12T15:08:41.037 INFO:teuthology.orchestra.run.smithi180.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-02-12T15:08:41.037 INFO:teuthology.orchestra.run.smithi180.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-02-12T15:08:41.037 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-02-12T15:08:41.037 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.037 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.038 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.038 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.038 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.038 INFO:teuthology.orchestra.run.smithi180.stdout: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.038 INFO:teuthology.orchestra.run.smithi180.stdout: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.038 INFO:teuthology.orchestra.run.smithi180.stdout: python3-ceph-argparse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.038 INFO:teuthology.orchestra.run.smithi180.stdout: python3-ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: automake-1.16.1-6.el8.noarch 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: jq-1.5-12.el8.x86_64 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: openblas-0.3.3-2.el8.x86_64 2020-02-12T15:08:41.039 INFO:teuthology.orchestra.run.smithi180.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-mako-1.0.6-13.el8.noarch 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-02-12T15:08:41.040 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pytz-2017.2-9.el8.noarch 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: socat-1.7.3.2-6.el8.x86_64 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: fuse-2.9.7-12.el8.x86_64 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-02-12T15:08:41.041 INFO:teuthology.orchestra.run.smithi180.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-02-12T15:08:41.042 INFO:teuthology.orchestra.run.smithi180.stdout: krb5-devel-1.17-9.el8.x86_64 2020-02-12T15:08:41.042 INFO:teuthology.orchestra.run.smithi180.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-02-12T15:08:41.042 INFO:teuthology.orchestra.run.smithi180.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-02-12T15:08:41.042 INFO:teuthology.orchestra.run.smithi180.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-02-12T15:08:41.042 INFO:teuthology.orchestra.run.smithi180.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-02-12T15:08:41.042 INFO:teuthology.orchestra.run.smithi180.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-02-12T15:08:41.042 INFO:teuthology.orchestra.run.smithi180.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: libxslt-1.1.32-3.el8.x86_64 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-02-12T15:08:41.043 INFO:teuthology.orchestra.run.smithi180.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-02-12T15:08:41.044 INFO:teuthology.orchestra.run.smithi180.stdout: python3-jaraco-6.2-6.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-portend-2.6-1.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-02-12T15:08:41.045 INFO:teuthology.orchestra.run.smithi180.stdout: python3-routes-2.4.1-12.el8.noarch 2020-02-12T15:08:41.046 INFO:teuthology.orchestra.run.smithi180.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-02-12T15:08:41.046 INFO:teuthology.orchestra.run.smithi180.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-02-12T15:08:41.046 INFO:teuthology.orchestra.run.smithi180.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-02-12T15:08:41.046 INFO:teuthology.orchestra.run.smithi180.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-02-12T15:08:41.046 INFO:teuthology.orchestra.run.smithi180.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-02-12T15:08:41.046 INFO:teuthology.orchestra.run.smithi180.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-02-12T15:08:41.046 INFO:teuthology.orchestra.run.smithi180.stdout: liboath-2.6.2-3.el8.x86_64 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: libunwind-1.3.1-3.el8.x86_64 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: python3-apipkg-1.5-6.el8.noarch 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-02-12T15:08:41.047 INFO:teuthology.orchestra.run.smithi180.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: leveldb-1.21-2.el8.x86_64 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: xmlstarlet-1.6.1-13.el8.x86_64 2020-02-12T15:08:41.048 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:41.049 INFO:teuthology.orchestra.run.smithi180.stdout:Complete! 2020-02-12T15:08:41.187 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 122/123 2020-02-12T15:08:41.187 INFO:teuthology.orchestra.run.smithi105.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T15:08:41.189 DEBUG:teuthology.parallel:result is None 2020-02-12T15:08:41.980 INFO:teuthology.orchestra.run.smithi105.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T15:08:41.980 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-2:15.1.0-567.g7df2194.el8.x86_64 1/123 2020-02-12T15:08:41.980 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2/123 2020-02-12T15:08:41.980 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 3/123 2020-02-12T15:08:41.980 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 4/123 2020-02-12T15:08:41.980 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-immutable-object-cache-2:15.1.0-567.g7df219 5/123 2020-02-12T15:08:41.980 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 6/123 2020-02-12T15:08:41.981 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 7/123 2020-02-12T15:08:41.981 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 8/123 2020-02-12T15:08:41.981 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 9/123 2020-02-12T15:08:41.981 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 10/123 2020-02-12T15:08:41.981 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 11/123 2020-02-12T15:08:41.981 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 12/123 2020-02-12T15:08:41.981 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : cephadm-2:15.1.0-567.g7df2194.el8.x86_64 13/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 14/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 15/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 16/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_6 17/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librgw2-2:15.1.0-567.g7df2194.el8.x86_64 18/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-argparse-2:15.1.0-567.g7df2194.el8. 19/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-ceph-common-2:15.1.0-567.g7df2194.el8.x8 20/123 2020-02-12T15:08:41.982 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 21/123 2020-02-12T15:08:41.983 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 22/123 2020-02-12T15:08:41.983 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 23/123 2020-02-12T15:08:41.983 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 24/123 2020-02-12T15:08:41.983 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 25/123 2020-02-12T15:08:41.983 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 26/123 2020-02-12T15:08:41.983 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 27/123 2020-02-12T15:08:41.983 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el 28/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarc 29/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noa 30/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2 31/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 32/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : automake-1.16.1-6.el8.noarch 33/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : bison-3.0.4-10.el8.x86_64 34/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : flex-2.6.1-9.el8.x86_64 35/123 2020-02-12T15:08:41.984 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : jq-1.5-12.el8.x86_64 36/123 2020-02-12T15:08:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 37/123 2020-02-12T15:08:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 38/123 2020-02-12T15:08:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 39/123 2020-02-12T15:08:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : oniguruma-6.8.2-1.el8.x86_64 40/123 2020-02-12T15:08:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-0.3.3-2.el8.x86_64 41/123 2020-02-12T15:08:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openblas-threads-0.3.3-2.el8.x86_64 42/123 2020-02-12T15:08:41.985 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-html5lib-1:0.999999999-6.el8.noarch 43/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-lxml-4.2.3-1.el8.x86_64 44/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 45/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 46/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 47/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 48/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 49/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 50/123 2020-02-12T15:08:41.986 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 51/123 2020-02-12T15:08:41.987 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 52/123 2020-02-12T15:08:41.987 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-scipy-1.0.0-20.module_el8.1.0+245+c39af4 53/123 2020-02-12T15:08:41.987 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webencodings-0.5.1-6.el8.noarch 54/123 2020-02-12T15:08:41.987 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 55/123 2020-02-12T15:08:41.987 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : socat-1.7.3.2-6.el8.x86_64 56/123 2020-02-12T15:08:41.987 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : elfutils-libelf-devel-0.176-5.el8.x86_64 57/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 58/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : fuse-common-3.2.1-12.el8.x86_64 59/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 60/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : krb5-devel-1.17-9.el8.x86_64 61/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 62/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libcom_err-devel-1.44.6-3.el8.x86_64 63/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libgfortran-8.3.1-4.5.el8.x86_64 64/123 2020-02-12T15:08:41.988 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libquadmath-8.3.1-4.5.el8.x86_64 65/123 2020-02-12T15:08:41.989 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librabbitmq-0.9.0-1.el8.x86_64 66/123 2020-02-12T15:08:41.989 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libselinux-devel-2.9-2.1.el8.x86_64 67/123 2020-02-12T15:08:41.989 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libsepol-devel-2.9-1.el8.x86_64 68/123 2020-02-12T15:08:41.989 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libuuid-devel-2.32.1-17.el8.x86_64 69/123 2020-02-12T15:08:41.989 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 70/123 2020-02-12T15:08:41.989 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libxslt-1.1.32-3.el8.x86_64 71/123 2020-02-12T15:08:41.989 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : openssl-devel-1:1.1.1c-2.el8.x86_64 72/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-devel-10.32-1.el8.x86_64 73/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-utf16-10.32-1.el8.x86_64 74/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : pcre2-utf32-10.32-1.el8.x86_64 75/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-chardet-3.0.4-7.el8.noarch 76/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 77/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 78/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pysocks-1.6.8-3.el8.noarch 79/123 2020-02-12T15:08:41.990 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-2.20.0-2.1.el8_1.noarch 80/123 2020-02-12T15:08:41.991 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 81/123 2020-02-12T15:08:41.991 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-urllib3-1.24.2-2.el8.noarch 82/123 2020-02-12T15:08:41.991 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xfsprogs-devel-5.0.0-1.el8.x86_64 83/123 2020-02-12T15:08:41.991 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : zlib-devel-1.2.11-10.el8.x86_64 84/123 2020-02-12T15:08:41.991 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cheroot-8.2.1-1.el8.noarch 85/123 2020-02-12T15:08:41.991 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 86/123 2020-02-12T15:08:41.991 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-execnet-1.7.1-1.el8.2.noarch 87/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 88/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 89/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 90/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 91/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 92/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-portend-2.6-1.el8.noarch 93/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-remoto-1.1.4-4.el8.noarch 94/123 2020-02-12T15:08:41.992 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 95/123 2020-02-12T15:08:41.993 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 96/123 2020-02-12T15:08:41.993 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 97/123 2020-02-12T15:08:41.993 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 98/123 2020-02-12T15:08:41.993 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 99/123 2020-02-12T15:08:41.993 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-trustme-0.5.2-4.el8.noarch 100/123 2020-02-12T15:08:41.993 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 101/123 2020-02-12T15:08:41.993 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : gperftools-libs-2.7-6.el8.x86_64 102/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 103/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 104/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 105/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 106/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 107/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 108/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 109/123 2020-02-12T15:08:41.994 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-cssselect-0.9.2-10.el8.noarch 110/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 111/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-kubernetes-10.0.1-1.el8.noarch 112/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-rsa-3.4.2-12.el8.noarch 113/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-waitress-1.2.1-2.el8.1.noarch 114/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 115/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 116/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 117/123 2020-02-12T15:08:41.995 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : leveldb-1.21-2.el8.x86_64 118/123 2020-02-12T15:08:41.996 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : xmlstarlet-1.6.1-13.el8.x86_64 119/123 2020-02-12T15:08:41.996 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-2:15.1.0-567.g7df2194.el8.x86_64 120/123 2020-02-12T15:08:41.996 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 121/123 2020-02-12T15:08:41.996 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-2:15.1.0-567.g7df2194.el8.x86_64 122/123 2020-02-12T15:08:43.475 INFO:teuthology.orchestra.run.smithi105.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 123/123 2020-02-12T15:08:43.475 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:43.475 INFO:teuthology.orchestra.run.smithi105.stdout:Upgraded: 2020-02-12T15:08:43.475 INFO:teuthology.orchestra.run.smithi105.stdout: librados2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout: librbd1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout:Installed: 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-base-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-immutable-object-cache-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.476 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-radosgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-test-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: cephadm-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: libcephfs2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: librados-devel-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cephfs-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.477 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rados-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rgw-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-fuse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-mirror-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: rbd-nbd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-cephadm-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-dashboard-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:43.478 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-diskprediction-local-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:43.479 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mgr-rook-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:43.479 INFO:teuthology.orchestra.run.smithi105.stdout: bison-3.0.4-10.el8.x86_64 2020-02-12T15:08:43.479 INFO:teuthology.orchestra.run.smithi105.stdout: flex-2.6.1-9.el8.x86_64 2020-02-12T15:08:43.479 INFO:teuthology.orchestra.run.smithi105.stdout: libtool-2.4.6-25.el8.x86_64 2020-02-12T15:08:43.479 INFO:teuthology.orchestra.run.smithi105.stdout: elfutils-libelf-devel-0.176-5.el8.x86_64 2020-02-12T15:08:43.479 INFO:teuthology.orchestra.run.smithi105.stdout: libaio-devel-0.3.112-1.el8.x86_64 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: libuuid-devel-2.32.1-17.el8.x86_64 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: openssl-devel-1:1.1.1c-2.el8.x86_64 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: xfsprogs-devel-5.0.0-1.el8.x86_64 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: python3-html5lib-1:0.999999999-6.el8.noarch 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cssselect-0.9.2-10.el8.noarch 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mds-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.480 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-mon-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.481 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-osd-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.481 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-selinux-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.481 INFO:teuthology.orchestra.run.smithi105.stdout: libradosstriper1-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.481 INFO:teuthology.orchestra.run.smithi105.stdout: librgw2-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.481 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-argparse-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.481 INFO:teuthology.orchestra.run.smithi105.stdout: python3-ceph-common-2:15.1.0-567.g7df2194.el8.x86_64 2020-02-12T15:08:43.481 INFO:teuthology.orchestra.run.smithi105.stdout: ceph-grafana-dashboards-2:15.1.0-567.g7df2194.el8.noarch 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: automake-1.16.1-6.el8.noarch 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: jq-1.5-12.el8.x86_64 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: librdkafka-0.11.4-1.el8.x86_64 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: lttng-ust-2.8.1-11.el8.x86_64 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: oniguruma-6.8.2-1.el8.x86_64 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-0.3.3-2.el8.x86_64 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: openblas-threads-0.3.3-2.el8.x86_64 2020-02-12T15:08:43.482 INFO:teuthology.orchestra.run.smithi105.stdout: python3-lxml-4.2.3-1.el8.x86_64 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-mako-1.0.6-13.el8.noarch 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-markupsafe-0.23-19.el8.x86_64 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-prettytable-0.7.2-14.el8.noarch 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pytz-2017.2-9.el8.noarch 2020-02-12T15:08:43.483 INFO:teuthology.orchestra.run.smithi105.stdout: python3-scipy-1.0.0-20.module_el8.1.0+245+c39af44f.x86_64 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webencodings-0.5.1-6.el8.noarch 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: socat-1.7.3.2-6.el8.x86_64 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-2.9.7-12.el8.x86_64 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: fuse-common-3.2.1-12.el8.x86_64 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: krb5-devel-1.17-9.el8.x86_64 2020-02-12T15:08:43.484 INFO:teuthology.orchestra.run.smithi105.stdout: libcom_err-devel-1.44.6-3.el8.x86_64 2020-02-12T15:08:43.485 INFO:teuthology.orchestra.run.smithi105.stdout: libgfortran-8.3.1-4.5.el8.x86_64 2020-02-12T15:08:43.485 INFO:teuthology.orchestra.run.smithi105.stdout: libquadmath-8.3.1-4.5.el8.x86_64 2020-02-12T15:08:43.485 INFO:teuthology.orchestra.run.smithi105.stdout: librabbitmq-0.9.0-1.el8.x86_64 2020-02-12T15:08:43.485 INFO:teuthology.orchestra.run.smithi105.stdout: libselinux-devel-2.9-2.1.el8.x86_64 2020-02-12T15:08:43.485 INFO:teuthology.orchestra.run.smithi105.stdout: libsepol-devel-2.9-1.el8.x86_64 2020-02-12T15:08:43.485 INFO:teuthology.orchestra.run.smithi105.stdout: libverto-devel-0.3.0-5.el8.x86_64 2020-02-12T15:08:43.485 INFO:teuthology.orchestra.run.smithi105.stdout: libxslt-1.1.32-3.el8.x86_64 2020-02-12T15:08:43.486 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-devel-10.32-1.el8.x86_64 2020-02-12T15:08:43.486 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf16-10.32-1.el8.x86_64 2020-02-12T15:08:43.486 INFO:teuthology.orchestra.run.smithi105.stdout: pcre2-utf32-10.32-1.el8.x86_64 2020-02-12T15:08:43.486 INFO:teuthology.orchestra.run.smithi105.stdout: python3-chardet-3.0.4-7.el8.noarch 2020-02-12T15:08:43.486 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jwt-1.6.1-2.el8.noarch 2020-02-12T15:08:43.486 INFO:teuthology.orchestra.run.smithi105.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2020-02-12T15:08:43.486 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pysocks-1.6.8-3.el8.noarch 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-2.20.0-2.1.el8_1.noarch 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: python3-urllib3-1.24.2-2.el8.noarch 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: zlib-devel-1.2.11-10.el8.x86_64 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cheroot-8.2.1-1.el8.noarch 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: python3-execnet-1.7.1-1.el8.2.noarch 2020-02-12T15:08:43.487 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-6.2-6.el8.noarch 2020-02-12T15:08:43.488 INFO:teuthology.orchestra.run.smithi105.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2020-02-12T15:08:43.488 INFO:teuthology.orchestra.run.smithi105.stdout: python3-logutils-0.3.5-11.el8.noarch 2020-02-12T15:08:43.488 INFO:teuthology.orchestra.run.smithi105.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2020-02-12T15:08:43.488 INFO:teuthology.orchestra.run.smithi105.stdout: python3-pecan-1.3.2-9.el8.noarch 2020-02-12T15:08:43.488 INFO:teuthology.orchestra.run.smithi105.stdout: python3-portend-2.6-1.el8.noarch 2020-02-12T15:08:43.488 INFO:teuthology.orchestra.run.smithi105.stdout: python3-remoto-1.1.4-4.el8.noarch 2020-02-12T15:08:43.488 INFO:teuthology.orchestra.run.smithi105.stdout: python3-repoze-lru-0.7-6.el8.noarch 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: python3-routes-2.4.1-12.el8.noarch 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: python3-tempora-1.14.1-5.el8.noarch 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: python3-trustme-0.5.2-4.el8.noarch 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: gperftools-libs-2.7-6.el8.x86_64 2020-02-12T15:08:43.489 INFO:teuthology.orchestra.run.smithi105.stdout: liboath-2.6.2-3.el8.x86_64 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: libunwind-1.3.1-3.el8.x86_64 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: python3-apipkg-1.5-6.el8.noarch 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: python3-cachetools-3.1.1-4.el8.noarch 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: python3-certifi-2018.10.15-7.el8.noarch 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2020-02-12T15:08:43.490 INFO:teuthology.orchestra.run.smithi105.stdout: python3-kubernetes-10.0.1-1.el8.noarch 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: python3-rsa-3.4.2-12.el8.noarch 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: python3-waitress-1.2.1-2.el8.1.noarch 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webob-1.8.5-1.el8.1.noarch 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: python3-webtest-2.0.33-1.el8.noarch 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: leveldb-1.21-2.el8.x86_64 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: xmlstarlet-1.6.1-13.el8.x86_64 2020-02-12T15:08:43.491 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:43.492 INFO:teuthology.orchestra.run.smithi105.stdout:Complete! 2020-02-12T15:08:43.642 DEBUG:teuthology.parallel:result is None 2020-02-12T15:08:43.643 INFO:teuthology.orchestra.run.smithi180:> sudo lsb_release -is 2020-02-12T15:08:43.695 INFO:teuthology.orchestra.run.smithi180.stdout:CentOS 2020-02-12T15:08:43.697 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T15:08:43.697 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T15:08:43.867 INFO:teuthology.orchestra.run.smithi180:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-02-12T15:08:43.889 INFO:teuthology.orchestra.run.smithi180.stdout:15.1.0-567.g7df2194.el8 2020-02-12T15:08:43.889 INFO:teuthology.packaging:The installed version of ceph is 15.1.0-567.g7df2194.el8 2020-02-12T15:08:43.889 INFO:teuthology.task.install:The correct ceph version 15.1.0-567.g7df2194 is installed. 2020-02-12T15:08:43.890 INFO:teuthology.orchestra.run.smithi105:> sudo lsb_release -is 2020-02-12T15:08:43.938 INFO:teuthology.orchestra.run.smithi105.stdout:CentOS 2020-02-12T15:08:43.939 DEBUG:teuthology.misc:System to be installed: CentOS 2020-02-12T15:08:43.940 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T15:08:44.100 INFO:teuthology.orchestra.run.smithi105:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2020-02-12T15:08:44.120 INFO:teuthology.orchestra.run.smithi105.stdout:15.1.0-567.g7df2194.el8 2020-02-12T15:08:44.120 INFO:teuthology.packaging:The installed version of ceph is 15.1.0-567.g7df2194.el8 2020-02-12T15:08:44.121 INFO:teuthology.task.install:The correct ceph version 15.1.0-567.g7df2194 is installed. 2020-02-12T15:08:44.121 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2020-02-12T15:08:44.121 INFO:teuthology.orchestra.run.smithi180:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-02-12T15:08:44.154 INFO:teuthology.orchestra.run.smithi105:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2020-02-12T15:08:44.189 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2020-02-12T15:08:44.189 INFO:teuthology.orchestra.run.smithi180:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-02-12T15:08:44.226 INFO:teuthology.orchestra.run.smithi180:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-02-12T15:08:44.296 INFO:teuthology.orchestra.run.smithi105:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2020-02-12T15:08:44.325 INFO:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/daemon-helper 2020-02-12T15:08:44.392 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2020-02-12T15:08:44.393 INFO:teuthology.orchestra.run.smithi180:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-02-12T15:08:44.441 INFO:teuthology.orchestra.run.smithi180:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-02-12T15:08:44.511 INFO:teuthology.orchestra.run.smithi105:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2020-02-12T15:08:44.555 INFO:teuthology.orchestra.run.smithi105:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2020-02-12T15:08:44.621 INFO:teuthology.run_tasks:Running task ceph... 2020-02-12T15:08:44.679 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2020-02-12T15:08:44.679 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 777 /var/log/ceph 2020-02-12T15:08:44.682 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 777 /var/log/ceph 2020-02-12T15:08:44.711 INFO:tasks.ceph:Disabling ceph logrotate... 2020-02-12T15:08:44.712 INFO:teuthology.orchestra.run.smithi105:> sudo rm -f -- /etc/logrotate.d/ceph 2020-02-12T15:08:44.748 INFO:teuthology.orchestra.run.smithi180:> sudo rm -f -- /etc/logrotate.d/ceph 2020-02-12T15:08:44.780 INFO:tasks.ceph:Creating extra log directories... 2020-02-12T15:08:44.781 INFO:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-02-12T15:08:44.814 INFO:teuthology.orchestra.run.smithi180:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2020-02-12T15:08:44.849 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2020-02-12T15:08:44.849 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2020-02-12T15:08:44.849 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2020-02-12T15:08:44.849 INFO:teuthology.orchestra.run.smithi180:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-02-12T15:08:44.933 INFO:teuthology.orchestra.run.smithi180:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:45.048 INFO:teuthology.orchestra.run.smithi180:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:45.075 INFO:teuthology.orchestra.run.smithi105:> cat > /home/ubuntu/cephtest/logrotate.ceph-test.conf 2020-02-12T15:08:45.119 INFO:teuthology.orchestra.run.smithi105:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:45.231 INFO:teuthology.orchestra.run.smithi105:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2020-02-12T15:08:45.258 INFO:tasks.ceph:Creating ceph cluster ceph... 2020-02-12T15:08:45.258 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'osd_max_omap_entries_per_request': 10000, 'debug journal': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}}} 2020-02-12T15:08:45.258 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'dump', 'indent'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel']}, 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell'], 'rpm': ['python3-cephfs']}, 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}}, {'ceph': None}, {'exec': {'client.0': ['sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it']}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['fs/misc/trivial_sync.sh']}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-pdonnell-testing-20200211.222321/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.2510', 'owner': 'scheduled_pdonnell@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 30}}, {'machine': {'disk': 200}}], 'targets': {'smithi180.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQC8O5rBCIl/GN7WtRNJnG594kWaZ9QrMRG3j9MGW1ZrEJxu3JMokeCsRZ0vUQlSVu8T4r4BueI64HcMkbtR6ENE5xaoDlLIDX3IT+R07yVC4MPQPVM4aW6eynSUlDpOoeBAqLCI+YExiXSI68S0sBPILnIJoiIO7FwjDkWF9zMlXpaHVHwj3e3Zz5U+VrzdZ3NYac54/u9Wu1G03Z32oKZS7JTIaLUeLcSIVGDuFjQvawqCzB85a1o8xfSC5UV7nyvEJMJGBWBD3Vh+K0Wg+uHngYC9i4zKBpEC3qRI3IpV37XDTZ2gqjOJo9AGcZdJOy5BhCxNOxBiDSrFqy89Q8mg9MWpEzH/EXpTO4S9LLQE9TO8syzVvSk4NYFbIcEmQnVbPFUh1K29l7BJAkEowkL9pIYb7pkMVjWpJLvHuRfxgI7G6vs2qQeorb0xtmtmSHRQO+u/GWOUOQGhle9bcpHU6Alk9LTIc0eMglFuYOp0ItYFgkSez721MsodmWCVMf0=', 'smithi105.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDGWm+CuGOlwlg/4n3cZDEHqIXErpq2JC1q7Ew92Ft9+1YdqCcloPse1w2Af0XvCFvWxSsehcZXSJdBZ+9ESw7skbR6sB/5igEUMJNRhwxa9WfiyGoN5nkuGyDskHIjhOaBal0Q0drPIC+lax/glKEG4TPzge9PxWSJUwUmWZGDIcQ9uifpPFPQp54haBFfDBPIIIBce8PgvM3nXx/NLIVpXYAs9U+TnXUWoYQBEi+QLDNlV1jIu3jVx8qWHjPj0YUVXfx3JdfhSWHAUuWPBr7FknKcgHq0PS39YQMp04MKdvoLgef2SfXaRi3rr6rqivhOKdloBUdwZuxt7PHuirdqu0qvW4UcU6xD/u/AEr4IS4s7bzQRuHsYfiSFQuEdcEVGb4Q4iw7HlaSNGfbt1XkCuPq/hGSB7KDSod2/0DV0BCBa+PUve1YO5lXFGVa0EJj6DxrXV7lCPCGqmD1iNPtbz6tPsbElfUYfSUalnynqze+swojqB76NS8LSYohh1G8='}, 'job_id': '4755732', 'tube': 'smithi', 'suite_branch': 'wip-pdonnell-testing-20200211.222321', 'priority': 75, 'os_version': '8.1', 'first_in_suite': False, 'branch': 'wip-pdonnell-testing-20200211.222321', 'suite': 'fs', 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'email': 'pdonnell@redhat.com', 'archive_path': '/home/teuthworker/archive/pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi/4755732', 'description': 'fs/basic_workload/{begin.yaml clusters/fixed-2-ucephfs.yaml conf/{client.yaml mds.yaml mon.yaml osd.yaml} inline/yes.yaml mount/fuse.yaml objectstore-ec/bluestore-comp-ec-root.yaml omap_limit/10000.yaml overrides/{frag_enable.yaml whitelist_health.yaml whitelist_wrongly_marked_down.yaml} supported-random-distros$/{centos_8.yaml} tasks/cfuse_workunit_trivial_sync.yaml}', 'nuke-on-error': True, 'repo': 'git://git.ceph.com/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'name': 'pdonnell-2020-02-12_01:56:22-fs-wip-pdonnell-testing-20200211.222321-distro-basic-smithi', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'overrides': {'ceph': {'cephfs_ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'conf': {'mds': {'mds debug frag': True, 'mds bal split bits': 3, 'mds bal split size': 100, 'debug mds': 20, 'mds bal merge size': 5, 'debug ms': 1, 'mds bal frag': True, 'mds bal fragment size max': 10000, 'mds op complaint time': 180, 'mds debug scatterstat': True, 'osd op complaint time': 180, 'mds verify scatter': True}, 'client': {'debug ms': 1, 'debug client': 20, 'client mount timeout': 600}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon op complaint time': 120, 'debug ms': 1}, 'osd': {'mon osd full ratio': 0.9, 'debug ms': 1, 'bluestore fsck on mount': True, 'debug osd': 25, 'bluestore compression mode': 'aggressive', 'debug bluestore': 20, 'debug bluefs': 20, 'mon osd backfillfull_ratio': 0.85, 'osd_max_omap_entries_per_request': 10000, 'debug journal': 20, 'debug rocksdb': 10, 'mon osd nearfull ratio': 0.8, 'osd objectstore': 'bluestore', 'osd failsafe full ratio': 0.95, 'bluestore block size': 96636764160, 'debug filestore': 20, 'osd op complaint time': 180}}, 'fs': 'xfs', 'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}, 'thrashosds': {'bdev_inject_crash_probability': 0.5, 'bdev_inject_crash': 2}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}}}, 'install': {'ceph': {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'}}, 'admin_socket': {'branch': 'wip-pdonnell-testing-20200211.222321'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'workunit': {'sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30', 'branch': 'wip-pdonnell-testing-20200211.222321'}}, 'os_type': 'centos', 'suite_sha1': '7df2194963eaa185d198b9c90e899c7e7ae9eb30'} 2020-02-12T15:08:45.259 INFO:teuthology.orchestra.run.smithi105:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-02-12T15:08:45.300 INFO:teuthology.orchestra.run.smithi180:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2020-02-12T15:08:45.314 INFO:teuthology.orchestra.run.smithi105:> sudo install -d -m0777 -- /var/run/ceph 2020-02-12T15:08:45.354 INFO:teuthology.orchestra.run.smithi180:> sudo install -d -m0777 -- /var/run/ceph 2020-02-12T15:08:45.438 DEBUG:teuthology.orchestra.remote:smithi180:/scratch_devs is 72B 2020-02-12T15:08:45.487 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T15:08:45.487 INFO:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-02-12T15:08:45.501 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-02-12T15:08:45.501 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:45.501 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 55682 Links: 1 2020-02-12T15:08:45.501 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:45.501 INFO:teuthology.orchestra.run.smithi180.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:45.502 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2020-02-12 15:08:39.089666256 +0000 2020-02-12T15:08:45.502 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2020-02-12 15:06:58.845512514 +0000 2020-02-12T15:08:45.502 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2020-02-12 15:06:58.845512514 +0000 2020-02-12T15:08:45.502 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2020-02-12T15:08:45.514 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2020-02-12T15:08:45.514 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2020-02-12T15:08:45.514 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 0.000112069 s, 4.6 MB/s 2020-02-12T15:08:45.517 INFO:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-02-12T15:08:45.571 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-02-12T15:08:45.571 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:45.571 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 56748 Links: 1 2020-02-12T15:08:45.571 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:45.572 INFO:teuthology.orchestra.run.smithi180.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:45.572 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2020-02-12 15:08:39.089666256 +0000 2020-02-12T15:08:45.572 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2020-02-12 15:06:59.188505795 +0000 2020-02-12T15:08:45.572 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2020-02-12 15:06:59.188505795 +0000 2020-02-12T15:08:45.572 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2020-02-12T15:08:45.584 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2020-02-12T15:08:45.584 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2020-02-12T15:08:45.584 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 8.8819e-05 s, 5.8 MB/s 2020-02-12T15:08:45.586 INFO:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-02-12T15:08:45.640 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-02-12T15:08:45.640 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:45.640 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 52123 Links: 1 2020-02-12T15:08:45.640 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:45.640 INFO:teuthology.orchestra.run.smithi180.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:45.640 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2020-02-12 15:08:39.089666256 +0000 2020-02-12T15:08:45.640 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2020-02-12 15:06:59.556498588 +0000 2020-02-12T15:08:45.641 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2020-02-12 15:06:59.556498588 +0000 2020-02-12T15:08:45.641 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2020-02-12T15:08:45.652 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2020-02-12T15:08:45.653 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2020-02-12T15:08:45.653 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 9.2259e-05 s, 5.5 MB/s 2020-02-12T15:08:45.655 INFO:teuthology.orchestra.run.smithi180:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-02-12T15:08:45.709 INFO:teuthology.orchestra.run.smithi180.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-02-12T15:08:45.709 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:45.709 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 6h/6d Inode: 57634 Links: 1 2020-02-12T15:08:45.709 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:45.709 INFO:teuthology.orchestra.run.smithi180.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:45.710 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 2020-02-12 15:08:39.089666256 +0000 2020-02-12T15:08:45.710 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2020-02-12 15:06:59.879492262 +0000 2020-02-12T15:08:45.710 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2020-02-12 15:06:59.879492262 +0000 2020-02-12T15:08:45.710 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2020-02-12T15:08:45.722 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records in 2020-02-12T15:08:45.722 INFO:teuthology.orchestra.run.smithi180.stderr:1+0 records out 2020-02-12T15:08:45.722 INFO:teuthology.orchestra.run.smithi180.stderr:512 bytes copied, 0.00010116 s, 5.1 MB/s 2020-02-12T15:08:45.724 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-02-12T15:08:45.724 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T15:08:45.724 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-02-12T15:08:45.725 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:45.742 DEBUG:teuthology.orchestra.remote:smithi105:/scratch_devs is 72B 2020-02-12T15:08:45.790 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T15:08:45.791 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2020-02-12T15:08:45.804 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-1 2020-02-12T15:08:45.805 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:45.805 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 63508 Links: 1 2020-02-12T15:08:45.805 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:45.805 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:45.805 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-02-12 15:08:41.648181193 +0000 2020-02-12T15:08:45.805 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-02-12 15:06:57.554257294 +0000 2020-02-12T15:08:45.805 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-02-12 15:06:57.554257294 +0000 2020-02-12T15:08:45.806 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-02-12T15:08:45.818 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-02-12T15:08:45.818 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-02-12T15:08:45.818 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000218158 s, 2.3 MB/s 2020-02-12T15:08:45.821 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2020-02-12T15:08:45.875 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2020-02-12T15:08:45.875 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:45.875 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 56266 Links: 1 2020-02-12T15:08:45.875 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:45.875 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:45.875 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-02-12 15:08:41.648181193 +0000 2020-02-12T15:08:45.876 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-02-12 15:06:57.907249986 +0000 2020-02-12T15:08:45.876 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-02-12 15:06:57.907249986 +0000 2020-02-12T15:08:45.876 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-02-12T15:08:45.887 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-02-12T15:08:45.888 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-02-12T15:08:45.888 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000159765 s, 3.2 MB/s 2020-02-12T15:08:45.890 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2020-02-12T15:08:45.944 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-3 2020-02-12T15:08:45.945 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:45.945 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 57277 Links: 1 2020-02-12T15:08:45.945 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:45.945 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:45.945 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-02-12 15:08:41.648181193 +0000 2020-02-12T15:08:45.945 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-02-12 15:06:58.237243154 +0000 2020-02-12T15:08:45.946 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-02-12 15:06:58.237243154 +0000 2020-02-12T15:08:45.946 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-02-12T15:08:45.958 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-02-12T15:08:45.958 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-02-12T15:08:45.958 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000204302 s, 2.5 MB/s 2020-02-12T15:08:45.960 INFO:teuthology.orchestra.run.smithi105:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2020-02-12T15:08:46.015 INFO:teuthology.orchestra.run.smithi105.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-4 2020-02-12T15:08:46.015 INFO:teuthology.orchestra.run.smithi105.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2020-02-12T15:08:46.015 INFO:teuthology.orchestra.run.smithi105.stdout:Device: 6h/6d Inode: 57343 Links: 1 2020-02-12T15:08:46.015 INFO:teuthology.orchestra.run.smithi105.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:08:46.015 INFO:teuthology.orchestra.run.smithi105.stdout:Context: system_u:object_r:device_t:s0 2020-02-12T15:08:46.015 INFO:teuthology.orchestra.run.smithi105.stdout:Access: 2020-02-12 15:08:41.648181193 +0000 2020-02-12T15:08:46.015 INFO:teuthology.orchestra.run.smithi105.stdout:Modify: 2020-02-12 15:06:58.566236344 +0000 2020-02-12T15:08:46.016 INFO:teuthology.orchestra.run.smithi105.stdout:Change: 2020-02-12 15:06:58.566236344 +0000 2020-02-12T15:08:46.016 INFO:teuthology.orchestra.run.smithi105.stdout: Birth: - 2020-02-12T15:08:46.028 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records in 2020-02-12T15:08:46.028 INFO:teuthology.orchestra.run.smithi105.stderr:1+0 records out 2020-02-12T15:08:46.028 INFO:teuthology.orchestra.run.smithi105.stderr:512 bytes copied, 0.000198949 s, 2.6 MB/s 2020-02-12T15:08:46.030 INFO:tasks.ceph:fs option selected, checking for scratch devs 2020-02-12T15:08:46.030 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2020-02-12T15:08:46.031 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2020-02-12T15:08:46.031 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:46.031 INFO:tasks.ceph:Generating config... 2020-02-12T15:08:46.032 INFO:tasks.ceph:[mds] mds debug frag = True 2020-02-12T15:08:46.032 INFO:tasks.ceph:[mds] mds bal split bits = 3 2020-02-12T15:08:46.032 INFO:tasks.ceph:[mds] mds bal split size = 100 2020-02-12T15:08:46.032 INFO:tasks.ceph:[mds] debug mds = 20 2020-02-12T15:08:46.032 INFO:tasks.ceph:[mds] mds bal merge size = 5 2020-02-12T15:08:46.033 INFO:tasks.ceph:[mds] debug ms = 1 2020-02-12T15:08:46.033 INFO:tasks.ceph:[mds] mds bal frag = True 2020-02-12T15:08:46.033 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2020-02-12T15:08:46.033 INFO:tasks.ceph:[mds] mds op complaint time = 180 2020-02-12T15:08:46.033 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2020-02-12T15:08:46.033 INFO:tasks.ceph:[mds] osd op complaint time = 180 2020-02-12T15:08:46.041 INFO:tasks.ceph:[mds] mds verify scatter = True 2020-02-12T15:08:46.041 INFO:tasks.ceph:[client] debug ms = 1 2020-02-12T15:08:46.042 INFO:tasks.ceph:[client] debug client = 20 2020-02-12T15:08:46.042 INFO:tasks.ceph:[client] client mount timeout = 600 2020-02-12T15:08:46.042 INFO:tasks.ceph:[mon] debug mon = 20 2020-02-12T15:08:46.042 INFO:tasks.ceph:[mon] debug paxos = 20 2020-02-12T15:08:46.042 INFO:tasks.ceph:[mon] mon op complaint time = 120 2020-02-12T15:08:46.042 INFO:tasks.ceph:[mon] debug ms = 1 2020-02-12T15:08:46.042 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2020-02-12T15:08:46.042 INFO:tasks.ceph:[osd] debug ms = 1 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] debug osd = 25 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] debug bluestore = 20 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] debug bluefs = 20 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] osd_max_omap_entries_per_request = 10000 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] debug journal = 20 2020-02-12T15:08:46.043 INFO:tasks.ceph:[osd] debug rocksdb = 10 2020-02-12T15:08:46.044 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2020-02-12T15:08:46.044 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2020-02-12T15:08:46.044 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2020-02-12T15:08:46.044 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2020-02-12T15:08:46.044 INFO:tasks.ceph:[osd] debug filestore = 20 2020-02-12T15:08:46.044 INFO:tasks.ceph:[osd] osd op complaint time = 180 2020-02-12T15:08:46.044 INFO:tasks.ceph:Setting up mon.a... 2020-02-12T15:08:46.045 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2020-02-12T15:08:46.160 INFO:teuthology.orchestra.run.smithi180.stdout:creating /etc/ceph/ceph.keyring 2020-02-12T15:08:46.162 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2020-02-12T15:08:46.203 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-12T15:08:46.270 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.180'), ('mon.c', '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]'), ('mon.b', '172.21.15.105')] 2020-02-12T15:08:46.270 INFO:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.180 --addv c '[v2:172.21.15.105:3301,v1:172.21.15.105:6790]' --add b 172.21.15.105 --print /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:46.346 INFO:teuthology.orchestra.run.smithi180.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:46.346 INFO:teuthology.orchestra.run.smithi180.stdout:monmaptool: generated fsid c77fb549-2ffe-4090-8606-e21e8ca1873f 2020-02-12T15:08:46.347 INFO:teuthology.orchestra.run.smithi180.stdout:epoch 0 2020-02-12T15:08:46.347 INFO:teuthology.orchestra.run.smithi180.stdout:fsid c77fb549-2ffe-4090-8606-e21e8ca1873f 2020-02-12T15:08:46.347 INFO:teuthology.orchestra.run.smithi180.stdout:last_changed 2020-02-12T15:08:46.344759+0000 2020-02-12T15:08:46.347 INFO:teuthology.orchestra.run.smithi180.stdout:created 2020-02-12T15:08:46.344759+0000 2020-02-12T15:08:46.347 INFO:teuthology.orchestra.run.smithi180.stdout:min_mon_release 0 (unknown) 2020-02-12T15:08:46.347 INFO:teuthology.orchestra.run.smithi180.stdout:0: [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] mon.a 2020-02-12T15:08:46.347 INFO:teuthology.orchestra.run.smithi180.stdout:1: [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] mon.b 2020-02-12T15:08:46.348 INFO:teuthology.orchestra.run.smithi180.stdout:2: [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] mon.c 2020-02-12T15:08:46.348 INFO:teuthology.orchestra.run.smithi180.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2020-02-12T15:08:46.349 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c77fb549-2ffe-4090-8606-e21e8ca1873f... 2020-02-12T15:08:46.350 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-02-12T15:08:46.352 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2020-02-12T15:08:46.401 INFO:teuthology.orchestra.run.smithi105.stdout:[global] 2020-02-12T15:08:46.402 INFO:teuthology.orchestra.run.smithi105.stdout: chdir = "" 2020-02-12T15:08:46.402 INFO:teuthology.orchestra.run.smithi105.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-02-12T15:08:46.402 INFO:teuthology.orchestra.run.smithi105.stdout: auth supported = cephx 2020-02-12T15:08:46.402 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.402 INFO:teuthology.orchestra.run.smithi105.stdout: filestore xattr use omap = true 2020-02-12T15:08:46.402 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.403 INFO:teuthology.orchestra.run.smithi105.stdout: mon clock drift allowed = 1.000 2020-02-12T15:08:46.403 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.403 INFO:teuthology.orchestra.run.smithi105.stdout: osd crush chooseleaf type = 0 2020-02-12T15:08:46.403 INFO:teuthology.orchestra.run.smithi105.stdout: auth debug = true 2020-02-12T15:08:46.403 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.403 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on old message = true 2020-02-12T15:08:46.403 INFO:teuthology.orchestra.run.smithi105.stdout: ms die on bug = true 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: mon max pg per osd = 10000 # >= luminous 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: mon pg warn max object skew = 0 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: # disable pg_autoscaler by default for new pools 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: osd_pool_default_pg_autoscale_mode = off 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.404 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default size = 2 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow primary affinity = true 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd allow pg remap = true 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on legacy crush tunables = false 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on crush straw calc version zero = false 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on no sortbitwise = false 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on osd down out interval zero = false 2020-02-12T15:08:46.405 INFO:teuthology.orchestra.run.smithi105.stdout: mon warn on too few osds = false 2020-02-12T15:08:46.406 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-02-12T15:08:46.406 INFO:teuthology.orchestra.run.smithi105.stdout: mon_warn_on_pool_no_redundancy = false 2020-02-12T15:08:46.406 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.406 INFO:teuthology.orchestra.run.smithi105.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-02-12T15:08:46.406 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.406 INFO:teuthology.orchestra.run.smithi105.stdout: osd default data pool replay window = 5 2020-02-12T15:08:46.406 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout: mon allow pool delete = true 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout: mon cluster log file level = debug 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout: debug asserts on shutdown = true 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout: mon host = "172.21.15.180,[v2:172.21.15.105:3301,v1:172.21.15.105:6790],172.21.15.105" 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout: fsid = c77fb549-2ffe-4090-8606-e21e8ca1873f 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.407 INFO:teuthology.orchestra.run.smithi105.stdout:[osd] 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: osd journal size = 100 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub load threshold = 5.0 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: osd scrub max interval = 600 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: osd recover clone overlap = true 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: osd recovery max chunk = 1048576 2020-02-12T15:08:46.408 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.409 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug shutdown = true 2020-02-12T15:08:46.409 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug op order = true 2020-02-12T15:08:46.409 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug verify stray on activate = true 2020-02-12T15:08:46.409 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.409 INFO:teuthology.orchestra.run.smithi105.stdout: osd open classes on start = true 2020-02-12T15:08:46.409 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug pg log writeout = true 2020-02-12T15:08:46.409 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: osd deep scrub update digest min age = 30 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: osd map max advance = 10 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: journal zero on create = true 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: filestore ondisk finisher threads = 3 2020-02-12T15:08:46.410 INFO:teuthology.orchestra.run.smithi105.stdout: filestore apply finisher threads = 3 2020-02-12T15:08:46.411 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.411 INFO:teuthology.orchestra.run.smithi105.stdout: bdev debug aio = true 2020-02-12T15:08:46.411 INFO:teuthology.orchestra.run.smithi105.stdout: osd debug misdirected ops = true 2020-02-12T15:08:46.411 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd full ratio = 0.9 2020-02-12T15:08:46.411 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-02-12T15:08:46.411 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore fsck on mount = True 2020-02-12T15:08:46.411 INFO:teuthology.orchestra.run.smithi105.stdout: debug osd = 25 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore compression mode = aggressive 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluestore = 20 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: debug bluefs = 20 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd backfillfull_ratio = 0.85 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: osd_max_omap_entries_per_request = 10000 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: debug journal = 20 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: debug rocksdb = 10 2020-02-12T15:08:46.412 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd nearfull ratio = 0.8 2020-02-12T15:08:46.413 INFO:teuthology.orchestra.run.smithi105.stdout: osd objectstore = bluestore 2020-02-12T15:08:46.413 INFO:teuthology.orchestra.run.smithi105.stdout: osd failsafe full ratio = 0.95 2020-02-12T15:08:46.413 INFO:teuthology.orchestra.run.smithi105.stdout: bluestore block size = 96636764160 2020-02-12T15:08:46.413 INFO:teuthology.orchestra.run.smithi105.stdout: debug filestore = 20 2020-02-12T15:08:46.413 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2020-02-12T15:08:46.413 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.413 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr] 2020-02-12T15:08:46.414 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-02-12T15:08:46.414 INFO:teuthology.orchestra.run.smithi105.stdout: debug mgr = 20 2020-02-12T15:08:46.414 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2020-02-12T15:08:46.414 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2020-02-12T15:08:46.414 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2020-02-12T15:08:46.414 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2020-02-12T15:08:46.414 INFO:teuthology.orchestra.run.smithi105.stdout: mgr/telemetry/nag = false 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout:[mon] 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout: debug mon = 20 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout: debug paxos = 20 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout: debug auth = 20 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout: mon data avail warn = 5 2020-02-12T15:08:46.415 INFO:teuthology.orchestra.run.smithi105.stdout: mon mgr mkfs grace = 240 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min pgs per osd = 4 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd reporter subtree level = osd 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout: mon osd prime pg temp = true 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout: mon reweight min bytes per osd = 10 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout: mon op complaint time = 120 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout: 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout:[client] 2020-02-12T15:08:46.416 INFO:teuthology.orchestra.run.smithi105.stdout: rgw cache enabled = true 2020-02-12T15:08:46.417 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable ops log = true 2020-02-12T15:08:46.417 INFO:teuthology.orchestra.run.smithi105.stdout: rgw enable usage log = true 2020-02-12T15:08:46.417 INFO:teuthology.orchestra.run.smithi105.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-02-12T15:08:46.417 INFO:teuthology.orchestra.run.smithi105.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-02-12T15:08:46.417 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-02-12T15:08:46.417 INFO:teuthology.orchestra.run.smithi105.stdout: debug client = 20 2020-02-12T15:08:46.417 INFO:teuthology.orchestra.run.smithi105.stdout: client mount timeout = 600 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.a] 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.c] 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout:[mon.b] 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout:[mds] 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug frag = True 2020-02-12T15:08:46.418 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal split bits = 3 2020-02-12T15:08:46.419 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal split size = 100 2020-02-12T15:08:46.419 INFO:teuthology.orchestra.run.smithi105.stdout: debug mds = 20 2020-02-12T15:08:46.419 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal merge size = 5 2020-02-12T15:08:46.419 INFO:teuthology.orchestra.run.smithi105.stdout: debug ms = 1 2020-02-12T15:08:46.419 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal frag = True 2020-02-12T15:08:46.419 INFO:teuthology.orchestra.run.smithi105.stdout: mds bal fragment size max = 10000 2020-02-12T15:08:46.419 INFO:teuthology.orchestra.run.smithi105.stdout: mds op complaint time = 180 2020-02-12T15:08:46.420 INFO:teuthology.orchestra.run.smithi105.stdout: mds debug scatterstat = True 2020-02-12T15:08:46.420 INFO:teuthology.orchestra.run.smithi105.stdout: osd op complaint time = 180 2020-02-12T15:08:46.420 INFO:teuthology.orchestra.run.smithi105.stdout: mds verify scatter = True 2020-02-12T15:08:46.442 INFO:teuthology.orchestra.run.smithi180.stdout:[global] 2020-02-12T15:08:46.442 INFO:teuthology.orchestra.run.smithi180.stdout: chdir = "" 2020-02-12T15:08:46.442 INFO:teuthology.orchestra.run.smithi180.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2020-02-12T15:08:46.443 INFO:teuthology.orchestra.run.smithi180.stdout: auth supported = cephx 2020-02-12T15:08:46.443 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.443 INFO:teuthology.orchestra.run.smithi180.stdout: filestore xattr use omap = true 2020-02-12T15:08:46.443 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.443 INFO:teuthology.orchestra.run.smithi180.stdout: mon clock drift allowed = 1.000 2020-02-12T15:08:46.443 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.443 INFO:teuthology.orchestra.run.smithi180.stdout: osd crush chooseleaf type = 0 2020-02-12T15:08:46.444 INFO:teuthology.orchestra.run.smithi180.stdout: auth debug = true 2020-02-12T15:08:46.444 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.444 INFO:teuthology.orchestra.run.smithi180.stdout: ms die on old message = true 2020-02-12T15:08:46.444 INFO:teuthology.orchestra.run.smithi180.stdout: ms die on bug = true 2020-02-12T15:08:46.444 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.444 INFO:teuthology.orchestra.run.smithi180.stdout: mon max pg per osd = 10000 # >= luminous 2020-02-12T15:08:46.445 INFO:teuthology.orchestra.run.smithi180.stdout: mon pg warn max object skew = 0 2020-02-12T15:08:46.445 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.445 INFO:teuthology.orchestra.run.smithi180.stdout: # disable pg_autoscaler by default for new pools 2020-02-12T15:08:46.445 INFO:teuthology.orchestra.run.smithi180.stdout: osd_pool_default_pg_autoscale_mode = off 2020-02-12T15:08:46.445 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.445 INFO:teuthology.orchestra.run.smithi180.stdout: osd pool default size = 2 2020-02-12T15:08:46.445 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.446 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd allow primary affinity = true 2020-02-12T15:08:46.446 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd allow pg remap = true 2020-02-12T15:08:46.446 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on legacy crush tunables = false 2020-02-12T15:08:46.446 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on crush straw calc version zero = false 2020-02-12T15:08:46.446 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on no sortbitwise = false 2020-02-12T15:08:46.446 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on osd down out interval zero = false 2020-02-12T15:08:46.446 INFO:teuthology.orchestra.run.smithi180.stdout: mon warn on too few osds = false 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: mon_warn_on_pool_no_redundancy = false 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 ruleset-failure-domain=osd crush-failure-domain=osd 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: osd default data pool replay window = 5 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.447 INFO:teuthology.orchestra.run.smithi180.stdout: mon allow pool delete = true 2020-02-12T15:08:46.448 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.448 INFO:teuthology.orchestra.run.smithi180.stdout: mon cluster log file level = debug 2020-02-12T15:08:46.448 INFO:teuthology.orchestra.run.smithi180.stdout: debug asserts on shutdown = true 2020-02-12T15:08:46.448 INFO:teuthology.orchestra.run.smithi180.stdout: mon host = "172.21.15.180,[v2:172.21.15.105:3301,v1:172.21.15.105:6790],172.21.15.105" 2020-02-12T15:08:46.448 INFO:teuthology.orchestra.run.smithi180.stdout: fsid = c77fb549-2ffe-4090-8606-e21e8ca1873f 2020-02-12T15:08:46.448 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.448 INFO:teuthology.orchestra.run.smithi180.stdout:[osd] 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: osd journal size = 100 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: osd scrub load threshold = 5.0 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: osd scrub max interval = 600 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: osd recover clone overlap = true 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: osd recovery max chunk = 1048576 2020-02-12T15:08:46.449 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.450 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug shutdown = true 2020-02-12T15:08:46.450 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug op order = true 2020-02-12T15:08:46.450 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug verify stray on activate = true 2020-02-12T15:08:46.450 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.450 INFO:teuthology.orchestra.run.smithi180.stdout: osd open classes on start = true 2020-02-12T15:08:46.450 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug pg log writeout = true 2020-02-12T15:08:46.450 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: osd deep scrub update digest min age = 30 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: osd map max advance = 10 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: journal zero on create = true 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: filestore ondisk finisher threads = 3 2020-02-12T15:08:46.451 INFO:teuthology.orchestra.run.smithi180.stdout: filestore apply finisher threads = 3 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: bdev debug aio = true 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: osd debug misdirected ops = true 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd full ratio = 0.9 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: bluestore fsck on mount = True 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: debug osd = 25 2020-02-12T15:08:46.452 INFO:teuthology.orchestra.run.smithi180.stdout: bluestore compression mode = aggressive 2020-02-12T15:08:46.453 INFO:teuthology.orchestra.run.smithi180.stdout: debug bluestore = 20 2020-02-12T15:08:46.453 INFO:teuthology.orchestra.run.smithi180.stdout: debug bluefs = 20 2020-02-12T15:08:46.453 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd backfillfull_ratio = 0.85 2020-02-12T15:08:46.453 INFO:teuthology.orchestra.run.smithi180.stdout: osd_max_omap_entries_per_request = 10000 2020-02-12T15:08:46.453 INFO:teuthology.orchestra.run.smithi180.stdout: debug journal = 20 2020-02-12T15:08:46.453 INFO:teuthology.orchestra.run.smithi180.stdout: debug rocksdb = 10 2020-02-12T15:08:46.453 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd nearfull ratio = 0.8 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout: osd objectstore = bluestore 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout: osd failsafe full ratio = 0.95 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout: bluestore block size = 96636764160 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout: debug filestore = 20 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout: osd op complaint time = 180 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout:[mgr] 2020-02-12T15:08:46.454 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2020-02-12T15:08:46.455 INFO:teuthology.orchestra.run.smithi180.stdout: debug mgr = 20 2020-02-12T15:08:46.455 INFO:teuthology.orchestra.run.smithi180.stdout: debug mon = 20 2020-02-12T15:08:46.455 INFO:teuthology.orchestra.run.smithi180.stdout: debug auth = 20 2020-02-12T15:08:46.455 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min pgs per osd = 4 2020-02-12T15:08:46.455 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min bytes per osd = 10 2020-02-12T15:08:46.455 INFO:teuthology.orchestra.run.smithi180.stdout: mgr/telemetry/nag = false 2020-02-12T15:08:46.455 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout:[mon] 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout: debug mon = 20 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout: debug paxos = 20 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout: debug auth = 20 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout: mon data avail warn = 5 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout: mon mgr mkfs grace = 240 2020-02-12T15:08:46.456 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min pgs per osd = 4 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd reporter subtree level = osd 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout: mon osd prime pg temp = true 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout: mon reweight min bytes per osd = 10 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout: mon op complaint time = 120 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout:[client] 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout: rgw cache enabled = true 2020-02-12T15:08:46.457 INFO:teuthology.orchestra.run.smithi180.stdout: rgw enable ops log = true 2020-02-12T15:08:46.458 INFO:teuthology.orchestra.run.smithi180.stdout: rgw enable usage log = true 2020-02-12T15:08:46.458 INFO:teuthology.orchestra.run.smithi180.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2020-02-12T15:08:46.458 INFO:teuthology.orchestra.run.smithi180.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2020-02-12T15:08:46.458 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2020-02-12T15:08:46.458 INFO:teuthology.orchestra.run.smithi180.stdout: debug client = 20 2020-02-12T15:08:46.458 INFO:teuthology.orchestra.run.smithi180.stdout: client mount timeout = 600 2020-02-12T15:08:46.458 INFO:teuthology.orchestra.run.smithi180.stdout:[mon.a] 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout:[mon.c] 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout:[mon.b] 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout:[mds.a] 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout:[mds.b] 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout:[mds] 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout: mds debug frag = True 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout: mds bal split bits = 3 2020-02-12T15:08:46.459 INFO:teuthology.orchestra.run.smithi180.stdout: mds bal split size = 100 2020-02-12T15:08:46.460 INFO:teuthology.orchestra.run.smithi180.stdout: debug mds = 20 2020-02-12T15:08:46.460 INFO:teuthology.orchestra.run.smithi180.stdout: mds bal merge size = 5 2020-02-12T15:08:46.460 INFO:teuthology.orchestra.run.smithi180.stdout: debug ms = 1 2020-02-12T15:08:46.460 INFO:teuthology.orchestra.run.smithi180.stdout: mds bal frag = True 2020-02-12T15:08:46.460 INFO:teuthology.orchestra.run.smithi180.stdout: mds bal fragment size max = 10000 2020-02-12T15:08:46.460 INFO:teuthology.orchestra.run.smithi180.stdout: mds op complaint time = 180 2020-02-12T15:08:46.460 INFO:teuthology.orchestra.run.smithi180.stdout: mds debug scatterstat = True 2020-02-12T15:08:46.461 INFO:teuthology.orchestra.run.smithi180.stdout: osd op complaint time = 180 2020-02-12T15:08:46.461 INFO:teuthology.orchestra.run.smithi180.stdout: mds verify scatter = True 2020-02-12T15:08:46.462 INFO:tasks.ceph:Creating admin key on mon.a... 2020-02-12T15:08:46.462 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2020-02-12T15:08:46.513 INFO:tasks.ceph:Copying monmap to all nodes... 2020-02-12T15:08:46.530 DEBUG:teuthology.orchestra.remote:smithi180:/etc/ceph/ceph.keyring is 206B 2020-02-12T15:08:46.623 DEBUG:teuthology.orchestra.remote:smithi180:/home/ubuntu/cephtest/ceph.monmap is 379B 2020-02-12T15:08:46.672 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:08:46.672 INFO:teuthology.orchestra.run.smithi180:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-12T15:08:46.733 INFO:teuthology.orchestra.run.smithi180:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:46.818 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:08:46.818 INFO:teuthology.orchestra.run.smithi105:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2020-02-12T15:08:46.876 INFO:teuthology.orchestra.run.smithi105:> cat > /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:46.961 INFO:tasks.ceph:Setting up mon nodes... 2020-02-12T15:08:46.962 INFO:tasks.ceph:Setting up mgr nodes... 2020-02-12T15:08:46.962 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2020-02-12T15:08:47.016 INFO:teuthology.orchestra.run.smithi180.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2020-02-12T15:08:47.018 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2020-02-12T15:08:47.079 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2020-02-12T15:08:47.081 INFO:tasks.ceph:Setting up mds nodes... 2020-02-12T15:08:47.081 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2020-02-12T15:08:47.134 INFO:teuthology.orchestra.run.smithi180.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2020-02-12T15:08:47.136 INFO:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2020-02-12T15:08:47.163 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2020-02-12T15:08:47.216 INFO:teuthology.orchestra.run.smithi105.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2020-02-12T15:08:47.218 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2020-02-12T15:08:47.245 INFO:tasks.ceph_client:Setting up client nodes... 2020-02-12T15:08:47.245 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2020-02-12T15:08:47.284 INFO:teuthology.orchestra.run.smithi180.stdout:creating /etc/ceph/ceph.client.0.keyring 2020-02-12T15:08:47.301 INFO:tasks.ceph:Running mkfs on osd nodes... 2020-02-12T15:08:47.302 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi180.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi105.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}} 2020-02-12T15:08:47.302 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2020-02-12T15:08:47.368 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:47.368 INFO:tasks.ceph:{} 2020-02-12T15:08:47.368 INFO:tasks.ceph:osd.0 2020-02-12T15:08:47.368 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:08:47.369 INFO:teuthology.orchestra.run.smithi180:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-02-12T15:08:47.461 INFO:teuthology.orchestra.run.smithi180.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:08:47.461 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:08:47.461 INFO:teuthology.orchestra.run.smithi180.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:08:47.462 INFO:teuthology.orchestra.run.smithi180.stdout: = reflink=1 2020-02-12T15:08:47.462 INFO:teuthology.orchestra.run.smithi180.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:08:47.462 INFO:teuthology.orchestra.run.smithi180.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:08:47.462 INFO:teuthology.orchestra.run.smithi180.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:08:47.462 INFO:teuthology.orchestra.run.smithi180.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:08:47.463 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:08:47.463 INFO:teuthology.orchestra.run.smithi180.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:08:47.464 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi180.front.sepia.ceph.com -o noatime 2020-02-12T15:08:47.464 INFO:teuthology.orchestra.run.smithi180:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2020-02-12T15:08:47.504 INFO:teuthology.orchestra.run.smithi180:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2020-02-12T15:08:47.576 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2020-02-12T15:08:47.643 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:47.643 INFO:tasks.ceph:{} 2020-02-12T15:08:47.643 INFO:tasks.ceph:osd.1 2020-02-12T15:08:47.644 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:08:47.644 INFO:teuthology.orchestra.run.smithi180:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-02-12T15:08:47.736 INFO:teuthology.orchestra.run.smithi180.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:08:47.736 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:08:47.736 INFO:teuthology.orchestra.run.smithi180.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:08:47.736 INFO:teuthology.orchestra.run.smithi180.stdout: = reflink=1 2020-02-12T15:08:47.736 INFO:teuthology.orchestra.run.smithi180.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:08:47.737 INFO:teuthology.orchestra.run.smithi180.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:08:47.737 INFO:teuthology.orchestra.run.smithi180.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:08:47.737 INFO:teuthology.orchestra.run.smithi180.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:08:47.737 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:08:47.737 INFO:teuthology.orchestra.run.smithi180.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:08:47.738 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi180.front.sepia.ceph.com -o noatime 2020-02-12T15:08:47.738 INFO:teuthology.orchestra.run.smithi180:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2020-02-12T15:08:47.778 INFO:teuthology.orchestra.run.smithi180:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2020-02-12T15:08:47.848 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2020-02-12T15:08:47.916 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:47.916 INFO:tasks.ceph:{} 2020-02-12T15:08:47.916 INFO:tasks.ceph:osd.2 2020-02-12T15:08:47.916 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:08:47.917 INFO:teuthology.orchestra.run.smithi180:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-02-12T15:08:48.009 INFO:teuthology.orchestra.run.smithi180.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:08:48.010 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:08:48.010 INFO:teuthology.orchestra.run.smithi180.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:08:48.010 INFO:teuthology.orchestra.run.smithi180.stdout: = reflink=1 2020-02-12T15:08:48.010 INFO:teuthology.orchestra.run.smithi180.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:08:48.010 INFO:teuthology.orchestra.run.smithi180.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:08:48.010 INFO:teuthology.orchestra.run.smithi180.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:08:48.011 INFO:teuthology.orchestra.run.smithi180.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:08:48.011 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:08:48.011 INFO:teuthology.orchestra.run.smithi180.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:08:48.012 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi180.front.sepia.ceph.com -o noatime 2020-02-12T15:08:48.012 INFO:teuthology.orchestra.run.smithi180:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2020-02-12T15:08:48.051 INFO:teuthology.orchestra.run.smithi180:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2020-02-12T15:08:48.122 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2020-02-12T15:08:48.189 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:48.189 INFO:tasks.ceph:{} 2020-02-12T15:08:48.189 INFO:tasks.ceph:osd.3 2020-02-12T15:08:48.189 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:08:48.189 INFO:teuthology.orchestra.run.smithi180:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-02-12T15:08:48.282 INFO:teuthology.orchestra.run.smithi180.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:08:48.282 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:08:48.282 INFO:teuthology.orchestra.run.smithi180.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:08:48.282 INFO:teuthology.orchestra.run.smithi180.stdout: = reflink=1 2020-02-12T15:08:48.282 INFO:teuthology.orchestra.run.smithi180.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:08:48.283 INFO:teuthology.orchestra.run.smithi180.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:08:48.283 INFO:teuthology.orchestra.run.smithi180.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:08:48.283 INFO:teuthology.orchestra.run.smithi180.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:08:48.283 INFO:teuthology.orchestra.run.smithi180.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:08:48.283 INFO:teuthology.orchestra.run.smithi180.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:08:48.284 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi180.front.sepia.ceph.com -o noatime 2020-02-12T15:08:48.284 INFO:teuthology.orchestra.run.smithi180:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2020-02-12T15:08:48.323 INFO:teuthology.orchestra.run.smithi180:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2020-02-12T15:08:48.393 INFO:teuthology.orchestra.run.smithi180:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:48.482 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:48.480+0000 7f5b1294dec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2020-02-12T15:08:48.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:48.480+0000 7f5b1294dec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2020-02-12T15:08:48.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:48.480+0000 7f5b1294dec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-12T15:08:48.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:48.480+0000 7f5b1294dec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-12T15:08:48.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:48.480+0000 7f5b1294dec0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2020-02-12T15:08:48.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:48.480+0000 7f5b1294dec0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2020-02-12T15:08:50.819 INFO:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2020-02-12T15:08:50.850 INFO:teuthology.orchestra.run.smithi180:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:50.937 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:50.934+0000 7f52e35ceec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2020-02-12T15:08:50.937 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:50.934+0000 7f52e35ceec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2020-02-12T15:08:50.937 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:50.934+0000 7f52e35ceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-12T15:08:50.938 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:50.934+0000 7f52e35ceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-12T15:08:50.938 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:50.934+0000 7f52e35ceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2020-02-12T15:08:50.938 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:50.935+0000 7f52e35ceec0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2020-02-12T15:08:53.273 INFO:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2020-02-12T15:08:53.304 INFO:teuthology.orchestra.run.smithi180:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:53.392 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:53.389+0000 7f42b853cec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2020-02-12T15:08:53.393 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:53.389+0000 7f42b853cec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2020-02-12T15:08:53.393 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:53.389+0000 7f42b853cec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-12T15:08:53.393 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:53.389+0000 7f42b853cec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-12T15:08:53.394 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:53.389+0000 7f42b853cec0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2020-02-12T15:08:53.394 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:53.390+0000 7f42b853cec0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2020-02-12T15:08:55.729 INFO:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2020-02-12T15:08:55.760 INFO:teuthology.orchestra.run.smithi180:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:08:55.847 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:55.843+0000 7f505e300ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2020-02-12T15:08:55.847 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:55.844+0000 7f505e300ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2020-02-12T15:08:55.847 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:55.844+0000 7f505e300ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-12T15:08:55.847 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:55.844+0000 7f505e300ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-12T15:08:55.847 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:55.844+0000 7f505e300ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2020-02-12T15:08:55.847 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:08:55.844+0000 7f505e300ec0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2020-02-12T15:08:58.187 INFO:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2020-02-12T15:08:58.217 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2020-02-12T15:08:58.249 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:58.249 INFO:tasks.ceph:{} 2020-02-12T15:08:58.249 INFO:tasks.ceph:osd.4 2020-02-12T15:08:58.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:08:58.250 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2020-02-12T15:08:58.795 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:08:58.796 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:08:58.796 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:08:58.796 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-02-12T15:08:58.796 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:08:58.797 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:08:58.797 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:08:58.797 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:08:58.797 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:08:58.797 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:08:58.798 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-02-12T15:08:58.799 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2020-02-12T15:08:58.932 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2020-02-12T15:08:58.967 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2020-02-12T15:08:59.036 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:59.036 INFO:tasks.ceph:{} 2020-02-12T15:08:59.036 INFO:tasks.ceph:osd.5 2020-02-12T15:08:59.036 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:08:59.036 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2020-02-12T15:08:59.542 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:08:59.542 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:08:59.542 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:08:59.542 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-02-12T15:08:59.542 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:08:59.543 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:08:59.543 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:08:59.543 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:08:59.543 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:08:59.544 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:08:59.544 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-02-12T15:08:59.545 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2020-02-12T15:08:59.591 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2020-02-12T15:08:59.624 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2020-02-12T15:08:59.692 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T15:08:59.693 INFO:tasks.ceph:{} 2020-02-12T15:08:59.693 INFO:tasks.ceph:osd.6 2020-02-12T15:08:59.693 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:08:59.693 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2020-02-12T15:09:00.257 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:09:00.257 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:09:00.257 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:09:00.257 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-02-12T15:09:00.257 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:09:00.258 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:09:00.258 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:09:00.258 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:09:00.258 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:09:00.258 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:09:00.259 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-02-12T15:09:00.259 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2020-02-12T15:09:00.333 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2020-02-12T15:09:00.366 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2020-02-12T15:09:00.434 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2020-02-12T15:09:00.434 INFO:tasks.ceph:{} 2020-02-12T15:09:00.434 INFO:tasks.ceph:osd.7 2020-02-12T15:09:00.434 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com 2020-02-12T15:09:00.435 INFO:teuthology.orchestra.run.smithi105:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2020-02-12T15:09:00.974 INFO:teuthology.orchestra.run.smithi105.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2020-02-12T15:09:00.974 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 attr=2, projid32bit=1 2020-02-12T15:09:00.974 INFO:teuthology.orchestra.run.smithi105.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2020-02-12T15:09:00.974 INFO:teuthology.orchestra.run.smithi105.stdout: = reflink=1 2020-02-12T15:09:00.975 INFO:teuthology.orchestra.run.smithi105.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2020-02-12T15:09:00.975 INFO:teuthology.orchestra.run.smithi105.stdout: = sunit=0 swidth=0 blks 2020-02-12T15:09:00.975 INFO:teuthology.orchestra.run.smithi105.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2020-02-12T15:09:00.975 INFO:teuthology.orchestra.run.smithi105.stdout:log =internal log bsize=4096 blocks=11443, version=2 2020-02-12T15:09:00.975 INFO:teuthology.orchestra.run.smithi105.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2020-02-12T15:09:00.975 INFO:teuthology.orchestra.run.smithi105.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2020-02-12T15:09:00.976 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi105.front.sepia.ceph.com -o noatime 2020-02-12T15:09:00.976 INFO:teuthology.orchestra.run.smithi105:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2020-02-12T15:09:01.089 INFO:teuthology.orchestra.run.smithi105:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2020-02-12T15:09:01.120 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:09:01.204 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:01.201+0000 7f528839aec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2020-02-12T15:09:01.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:01.204+0000 7f528839aec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2020-02-12T15:09:01.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:01.204+0000 7f528839aec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-12T15:09:01.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:01.204+0000 7f528839aec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-12T15:09:01.207 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:01.204+0000 7f528839aec0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2020-02-12T15:09:01.212 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:01.209+0000 7f528839aec0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2020-02-12T15:09:03.545 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2020-02-12T15:09:03.617 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:09:03.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:03.701+0000 7ff96e3e9ec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2020-02-12T15:09:03.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:03.702+0000 7ff96e3e9ec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2020-02-12T15:09:03.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:03.702+0000 7ff96e3e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-12T15:09:03.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:03.702+0000 7ff96e3e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-12T15:09:03.705 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:03.702+0000 7ff96e3e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2020-02-12T15:09:03.706 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:03.702+0000 7ff96e3e9ec0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2020-02-12T15:09:06.038 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2020-02-12T15:09:06.070 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:09:06.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:06.162+0000 7fde1621aec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2020-02-12T15:09:06.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:06.163+0000 7fde1621aec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2020-02-12T15:09:06.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:06.163+0000 7fde1621aec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-12T15:09:06.166 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:06.163+0000 7fde1621aec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-12T15:09:06.167 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:06.163+0000 7fde1621aec0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2020-02-12T15:09:06.167 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:06.163+0000 7fde1621aec0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2020-02-12T15:09:08.506 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2020-02-12T15:09:08.538 INFO:teuthology.orchestra.run.smithi105:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:09:08.632 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:08.622+0000 7f18186eeec0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2020-02-12T15:09:08.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:08.623+0000 7f18186eeec0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2020-02-12T15:09:08.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:08.623+0000 7f18186eeec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-12T15:09:08.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:08.623+0000 7f18186eeec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-12T15:09:08.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:08.623+0000 7f18186eeec0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2020-02-12T15:09:08.633 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:08.623+0000 7f18186eeec0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2020-02-12T15:09:10.960 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2020-02-12T15:09:10.991 INFO:tasks.ceph:Reading keys from all nodes... 2020-02-12T15:09:10.992 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:11.009 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.Lf06wsaPN2 2020-02-12T15:09:11.010 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.Lf06wsaPN2 2020-02-12T15:09:11.081 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.Lf06wsaPN2 2020-02-12T15:09:11.211 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.Lf06wsaPN2 is 56B 2020-02-12T15:09:11.258 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.Lf06wsaPN2 2020-02-12T15:09:11.273 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:11.327 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.mrKNnmIBWu 2020-02-12T15:09:11.327 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/mds/ceph-a/keyring /tmp/tmp.mrKNnmIBWu 2020-02-12T15:09:11.396 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.mrKNnmIBWu 2020-02-12T15:09:11.522 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.mrKNnmIBWu is 56B 2020-02-12T15:09:11.571 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.mrKNnmIBWu 2020-02-12T15:09:11.585 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:11.638 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.eCUCDU7q5q 2020-02-12T15:09:11.638 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.eCUCDU7q5q 2020-02-12T15:09:11.706 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.eCUCDU7q5q 2020-02-12T15:09:11.829 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.eCUCDU7q5q is 56B 2020-02-12T15:09:11.881 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.eCUCDU7q5q 2020-02-12T15:09:11.895 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:11.948 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.naczlSYraZ 2020-02-12T15:09:11.948 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.naczlSYraZ 2020-02-12T15:09:12.015 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.naczlSYraZ 2020-02-12T15:09:12.139 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.naczlSYraZ is 56B 2020-02-12T15:09:12.187 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.naczlSYraZ 2020-02-12T15:09:12.201 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:12.254 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.AEI643cqLq 2020-02-12T15:09:12.254 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.AEI643cqLq 2020-02-12T15:09:12.321 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.AEI643cqLq 2020-02-12T15:09:12.445 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.AEI643cqLq is 56B 2020-02-12T15:09:12.493 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.AEI643cqLq 2020-02-12T15:09:12.510 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:12.564 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.7PmoPJuzn6 2020-02-12T15:09:12.564 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.7PmoPJuzn6 2020-02-12T15:09:12.631 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.7PmoPJuzn6 2020-02-12T15:09:12.768 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.7PmoPJuzn6 is 56B 2020-02-12T15:09:12.824 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.7PmoPJuzn6 2020-02-12T15:09:12.837 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:12.855 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.q41vyXOxnI 2020-02-12T15:09:12.855 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.q41vyXOxnI 2020-02-12T15:09:12.931 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.q41vyXOxnI 2020-02-12T15:09:13.063 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.q41vyXOxnI is 56B 2020-02-12T15:09:13.114 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.q41vyXOxnI 2020-02-12T15:09:13.130 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:13.184 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.V4yFWceey3 2020-02-12T15:09:13.184 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/mds/ceph-b/keyring /tmp/tmp.V4yFWceey3 2020-02-12T15:09:13.253 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.V4yFWceey3 2020-02-12T15:09:13.380 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.V4yFWceey3 is 56B 2020-02-12T15:09:13.427 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.V4yFWceey3 2020-02-12T15:09:13.442 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:13.497 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.taXp8XK4jB 2020-02-12T15:09:13.498 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.taXp8XK4jB 2020-02-12T15:09:13.566 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.taXp8XK4jB 2020-02-12T15:09:13.693 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.taXp8XK4jB is 56B 2020-02-12T15:09:13.753 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.taXp8XK4jB 2020-02-12T15:09:13.767 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:13.820 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.EZJxdr86gr 2020-02-12T15:09:13.820 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.EZJxdr86gr 2020-02-12T15:09:13.886 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.EZJxdr86gr 2020-02-12T15:09:14.012 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.EZJxdr86gr is 56B 2020-02-12T15:09:14.073 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.EZJxdr86gr 2020-02-12T15:09:14.087 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:14.141 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.batscqeOoU 2020-02-12T15:09:14.141 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.batscqeOoU 2020-02-12T15:09:14.208 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.batscqeOoU 2020-02-12T15:09:14.331 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.batscqeOoU is 56B 2020-02-12T15:09:14.380 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.batscqeOoU 2020-02-12T15:09:14.394 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:14.446 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.sPScmhd4ue 2020-02-12T15:09:14.447 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.sPScmhd4ue 2020-02-12T15:09:14.516 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.sPScmhd4ue 2020-02-12T15:09:14.640 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.sPScmhd4ue is 56B 2020-02-12T15:09:14.688 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.sPScmhd4ue 2020-02-12T15:09:14.722 DEBUG:teuthology.orchestra.remote:smithi180:/etc/ceph/ceph.client.0.keyring is 59B 2020-02-12T15:09:14.771 INFO:tasks.ceph:Adding keys to all mons... 2020-02-12T15:09:14.771 INFO:teuthology.orchestra.run.smithi105:> sudo tee -a /etc/ceph/ceph.keyring 2020-02-12T15:09:14.773 INFO:teuthology.orchestra.run.smithi180:> sudo tee -a /etc/ceph/ceph.keyring 2020-02-12T15:09:14.796 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.y] 2020-02-12T15:09:14.796 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD/FEReAf7aABAASQBz0HDmEr/SpXjYOjVDog== 2020-02-12T15:09:14.796 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.a] 2020-02-12T15:09:14.796 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD/FEReWwPwBxAArOWOYJWEFaZIMz69KzJllw== 2020-02-12T15:09:14.797 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.0] 2020-02-12T15:09:14.797 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAAFURefBWqHBAAN3ZTjWOxun9MzvNmPZPJxw== 2020-02-12T15:09:14.797 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.1] 2020-02-12T15:09:14.797 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQACFURe93W9NxAAA0oZDRUJHalFjSNORZz9Bg== 2020-02-12T15:09:14.797 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.2] 2020-02-12T15:09:14.797 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAFFUReH+8/FxAAX/P4bNu2RMjrfldO0s3pFg== 2020-02-12T15:09:14.797 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.3] 2020-02-12T15:09:14.798 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAHFUReanNVMhAASmcmD8fkqlXw3bw6hl7dVA== 2020-02-12T15:09:14.798 INFO:teuthology.orchestra.run.smithi105.stdout:[mgr.x] 2020-02-12T15:09:14.798 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD/FERexUmfBBAAMdW6nloj0sxCeAB7818xRg== 2020-02-12T15:09:14.798 INFO:teuthology.orchestra.run.smithi105.stdout:[mds.b] 2020-02-12T15:09:14.798 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD/FEReHcjNDBAAZ0I7iI1EwJkJk0e+OZTCSg== 2020-02-12T15:09:14.798 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.4] 2020-02-12T15:09:14.798 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQANFUReRqYZDBAAHleXfUwZ6Q6YTJvflakmDw== 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.5] 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAPFUReyLroKRAAWR4YLR9rJXeChFD6+uNjmA== 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.6] 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQASFUReWYLKCRAAMLFdYIA5kB3+AZAJHeFsXw== 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout:[osd.7] 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQAUFUReRgk1JRAAFnuB9HtyNRAlDJgDPrMzRA== 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout:[client.0] 2020-02-12T15:09:14.799 INFO:teuthology.orchestra.run.smithi105.stdout: key = AQD/FEReM6bcEBAArb32qspNe1tbpmA701pp8w== 2020-02-12T15:09:14.816 INFO:teuthology.orchestra.run.smithi180.stdout:[mgr.y] 2020-02-12T15:09:14.816 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQD/FEReAf7aABAASQBz0HDmEr/SpXjYOjVDog== 2020-02-12T15:09:14.816 INFO:teuthology.orchestra.run.smithi180.stdout:[mds.a] 2020-02-12T15:09:14.816 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQD/FEReWwPwBxAArOWOYJWEFaZIMz69KzJllw== 2020-02-12T15:09:14.817 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.0] 2020-02-12T15:09:14.817 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQAAFURefBWqHBAAN3ZTjWOxun9MzvNmPZPJxw== 2020-02-12T15:09:14.817 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.1] 2020-02-12T15:09:14.817 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQACFURe93W9NxAAA0oZDRUJHalFjSNORZz9Bg== 2020-02-12T15:09:14.817 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.2] 2020-02-12T15:09:14.817 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQAFFUReH+8/FxAAX/P4bNu2RMjrfldO0s3pFg== 2020-02-12T15:09:14.817 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.3] 2020-02-12T15:09:14.818 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQAHFUReanNVMhAASmcmD8fkqlXw3bw6hl7dVA== 2020-02-12T15:09:14.818 INFO:teuthology.orchestra.run.smithi180.stdout:[mgr.x] 2020-02-12T15:09:14.818 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQD/FERexUmfBBAAMdW6nloj0sxCeAB7818xRg== 2020-02-12T15:09:14.818 INFO:teuthology.orchestra.run.smithi180.stdout:[mds.b] 2020-02-12T15:09:14.818 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQD/FEReHcjNDBAAZ0I7iI1EwJkJk0e+OZTCSg== 2020-02-12T15:09:14.818 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.4] 2020-02-12T15:09:14.818 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQANFUReRqYZDBAAHleXfUwZ6Q6YTJvflakmDw== 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.5] 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQAPFUReyLroKRAAWR4YLR9rJXeChFD6+uNjmA== 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.6] 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQASFUReWYLKCRAAMLFdYIA5kB3+AZAJHeFsXw== 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout:[osd.7] 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQAUFUReRgk1JRAAFnuB9HtyNRAlDJgDPrMzRA== 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout:[client.0] 2020-02-12T15:09:14.819 INFO:teuthology.orchestra.run.smithi180.stdout: key = AQD/FEReM6bcEBAArb32qspNe1tbpmA701pp8w== 2020-02-12T15:09:14.820 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T15:09:14.844 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T15:09:14.910 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T15:09:14.913 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T15:09:14.964 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:14.966 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.014 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.031 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.078 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.110 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.165 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.186 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.234 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T15:09:15.236 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2020-02-12T15:09:15.260 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:15.279 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:15.283 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.325 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mds allow --cap osd 'allow *' --cap mgr 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.376 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.418 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.466 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.468 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.518 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.520 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.569 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.572 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2020-02-12T15:09:15.658 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-02-12T15:09:15.660 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2020-02-12T15:09:15.709 INFO:tasks.ceph:Running mkfs on mon nodes... 2020-02-12T15:09:15.710 INFO:teuthology.orchestra.run.smithi180:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2020-02-12T15:09:15.737 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-12T15:09:15.830 INFO:teuthology.orchestra.run.smithi180:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2020-02-12T15:09:15.857 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2020-02-12T15:09:15.884 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-12T15:09:15.982 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2020-02-12T15:09:16.009 INFO:teuthology.orchestra.run.smithi105:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2020-02-12T15:09:16.077 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2020-02-12T15:09:16.170 INFO:teuthology.orchestra.run.smithi105:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2020-02-12T15:09:16.197 INFO:teuthology.orchestra.run.smithi105:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:09:16.239 INFO:teuthology.orchestra.run.smithi180:> rm -- /home/ubuntu/cephtest/ceph.monmap 2020-02-12T15:09:16.253 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2020-02-12T15:09:16.253 INFO:tasks.ceph.mon.a:Restarting daemon 2020-02-12T15:09:16.254 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2020-02-12T15:09:16.295 INFO:tasks.ceph.mon.a:Started 2020-02-12T15:09:16.295 INFO:tasks.ceph.mon.b:Restarting daemon 2020-02-12T15:09:16.296 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2020-02-12T15:09:16.298 INFO:tasks.ceph.mon.b:Started 2020-02-12T15:09:16.298 INFO:tasks.ceph.mon.c:Restarting daemon 2020-02-12T15:09:16.298 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2020-02-12T15:09:16.300 INFO:tasks.ceph.mon.c:Started 2020-02-12T15:09:16.300 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2020-02-12T15:09:16.300 INFO:tasks.ceph.mgr.y:Restarting daemon 2020-02-12T15:09:16.301 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2020-02-12T15:09:16.302 INFO:tasks.ceph.mgr.y:Started 2020-02-12T15:09:16.303 INFO:tasks.ceph.mgr.x:Restarting daemon 2020-02-12T15:09:16.303 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2020-02-12T15:09:16.305 INFO:tasks.ceph.mgr.x:Started 2020-02-12T15:09:16.305 INFO:tasks.ceph:Setting crush tunables to default 2020-02-12T15:09:16.305 INFO:teuthology.orchestra.run.smithi180:> sudo ceph --cluster ceph osd crush tunables default 2020-02-12T15:09:21.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.421+0000 7fcaf05e1700 1 Processor -- start 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.421+0000 7fcaf05e1700 1 -- start start 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaf05e1700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaf05e1700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaf05e1700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae80a2b50 con 0x7fcae80a14b0 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaf05e1700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae807fb40 con 0x7fcae80a1890 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaf05e1700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae80a3f20 con 0x7fcae80a7050 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaef37f700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaef37f700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50302/0 (socket says 172.21.15.180:50302) 2020-02-12T15:09:21.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 learned_addr learned my addr 172.21.15.180:0/4043481432 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:21.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-12T15:09:21.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-12T15:09:21.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.422+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.200000 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-12T15:09:21.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-12T15:09:21.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:16.623+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.400000 2020-02-12T15:09:21.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T15:09:21.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-12T15:09:21.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-12T15:09:21.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.024+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 0.800000 2020-02-12T15:09:21.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T15:09:21.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-12T15:09:21.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:17.825+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 1.600000 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-12T15:09:21.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2020-02-12T15:09:21.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaee37d700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2020-02-12T15:09:21.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_read_frame_preamble_main read frame length and tag failed r=-1 ((1) Operation not permitted) 2020-02-12T15:09:21.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:19.427+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0)._fault waiting 3.200000 2020-02-12T15:09:21.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889601345 0 0) 0x7fcae80a2b50 con 0x7fcae80a14b0 2020-02-12T15:09:21.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcad4003230 con 0x7fcae80a14b0 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 <== mon.0 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1635152267 0 0) 0x7fcad4003230 con 0x7fcae80a14b0 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 msgr2=0x7fcae814ed20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.180:3300/0 conn(0x7fcae80a7050 0x7fcae814ed20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 msgr2=0x7fcae814c8b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 --2- 172.21.15.180:0/4043481432 >> v2:172.21.15.105:3300/0 conn(0x7fcae80a1890 0x7fcae814c8b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae807fde0 con 0x7fcae80a14b0 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 <== mon.0 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7fcae40016d0 con 0x7fcae80a14b0 2020-02-12T15:09:21.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 >> v1:172.21.15.105:6789/0 conn(0x7fcae80a14b0 legacy=0x7fcae80a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:21.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:21.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad40044d0 0x7fcad4004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:21.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4004db0 0x7fcad400b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:21.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae807fb40 con 0x7fcad40044d0 2020-02-12T15:09:21.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcae80a3f20 con 0x7fcad40037f0 2020-02-12T15:09:21.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcad400bb80 con 0x7fcad4004db0 2020-02-12T15:09:21.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaef37f700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4004db0 0x7fcad400b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.623+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad40044d0 0x7fcad4004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 -- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4004db0 msgr2=0x7fcad400b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fcad4004db0 0x7fcad400b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 -- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad40044d0 msgr2=0x7fcad4004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fcad40044d0 0x7fcad4004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 -- 172.21.15.180:0/4043481432 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcad4003230 con 0x7fcad40037f0 2020-02-12T15:09:21.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaef37f700 1 -- 172.21.15.180:0/4043481432 reap_dead start 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fcae40013e0 tx=0x7fcae80a40f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fcae40013e0 tx=0x7fcae80a40f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fcae40013e0 tx=0x7fcae80a40f0).ready entity=mon.1 client_cookie=c9e8d0e48034af26 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fcae40013e0 tx=0x7fcae80a40f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fcae40013e0 tx=0x7fcae80a40f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcae40018f0 con 0x7fcad40037f0 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaeeb7e700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 secure :-1 s=THROTTLE_DONE pgs=7 cs=0 l=1 rx=0x7fcae40013e0 tx=0x7fcae80a40f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcae4001a50 con 0x7fcad40037f0 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaedb7c700 1 -- 172.21.15.180:0/4043481432 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcae4001e30 con 0x7fcad40037f0 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 msgr2=0x7fcad4003c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.624+0000 7fcaf05e1700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 secure :-1 s=READY pgs=7 cs=0 l=1 rx=0x7fcae40013e0 tx=0x7fcae80a40f0).stop 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.625+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4043481432 shutdown_connections 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.625+0000 7fcaf05e1700 1 --2- 172.21.15.180:0/4043481432 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcad40037f0 0x7fcad4003c10 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.625+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4043481432 >> 172.21.15.180:0/4043481432 conn(0x7fcae805a530 msgr2=0x7fcae805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.625+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4043481432 shutdown_connections 2020-02-12T15:09:21.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.625+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4043481432 wait complete. 2020-02-12T15:09:21.648 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.627+0000 7fcaf05e1700 1 Processor -- start 2020-02-12T15:09:21.648 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.627+0000 7fcaf05e1700 1 -- start start 2020-02-12T15:09:21.648 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaf05e1700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fcae8124790 0x7fcae8066600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:21.648 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaf05e1700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae8138820 con 0x7fcae80a5050 2020-02-12T15:09:21.648 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaf05e1700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcae8065630 con 0x7fcad40037f0 2020-02-12T15:09:21.648 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaf05e1700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcae80658d0 con 0x7fcae8124790 2020-02-12T15:09:21.648 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fcae8124790 0x7fcae8066600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:21.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaeeb7e700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fcad40037f0 0x7fcae8137a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:41858/0 (socket says 172.21.15.180:41858) 2020-02-12T15:09:21.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaeeb7e700 1 -- 172.21.15.180:0/4137679339 learned_addr learned my addr 172.21.15.180:0/4137679339 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:21.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fcae8124790 0x7fcae8066600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50346/0 (socket says 172.21.15.180:50346) 2020-02-12T15:09:21.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 -- 172.21.15.180:0/4137679339 >> v1:172.21.15.180:6789/0 conn(0x7fcad40037f0 legacy=0x7fcae8137a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:21.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 -- 172.21.15.180:0/4137679339 >> v1:172.21.15.105:6789/0 conn(0x7fcae80a5050 legacy=0x7fcae8138110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:21.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 -- 172.21.15.180:0/4137679339 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcae8066160 con 0x7fcae8124790 2020-02-12T15:09:21.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> v2:172.21.15.180:3300/0 conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> v2:172.21.15.180:3300/0 conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.628+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:21.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcadf7fe700 1 -- 172.21.15.180:0/4137679339 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad80127a0 con 0x7fcae8124790 2020-02-12T15:09:21.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcadf7fe700 1 -- 172.21.15.180:0/4137679339 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcad8012900 con 0x7fcae8124790 2020-02-12T15:09:21.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcadf7fe700 1 -- 172.21.15.180:0/4137679339 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcad8012ce0 con 0x7fcae8124790 2020-02-12T15:09:21.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcae80a0bf0 con 0x7fcae8124790 2020-02-12T15:09:21.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcae8065320 con 0x7fcae8124790 2020-02-12T15:09:21.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.629+0000 7fcadf7fe700 1 -- 172.21.15.180:0/4137679339 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7fcad80146e0 con 0x7fcae8124790 2020-02-12T15:09:21.652 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.630+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.652 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.630+0000 7fcadf7fe700 1 -- 172.21.15.180:0/4137679339 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 754+0+0 (secure 0 0 0) 0x7fcad8012e40 con 0x7fcae8124790 2020-02-12T15:09:21.652 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.631+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcae80565b0 con 0x7fcae8124790 2020-02-12T15:09:21.652 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.633+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.652 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.633+0000 7fcadf7fe700 1 -- 172.21.15.180:0/4137679339 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fcad8014970 con 0x7fcae8124790 2020-02-12T15:09:21.717 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.713+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fcae805a080 con 0x7fcae8124790 2020-02-12T15:09:21.722 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.718+0000 7fcaee37d700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=THROTTLE_DONE pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:21.722 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.718+0000 7fcadf7fe700 1 -- 172.21.15.180:0/4137679339 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcad800a5b0 con 0x7fcae8124790 2020-02-12T15:09:21.723 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.719+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 msgr2=0x7fcae8066600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:21.723 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.719+0000 7fcaf05e1700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 secure :-1 s=READY pgs=9 cs=0 l=1 rx=0x7fcae8124340 tx=0x7fcad8010b80).stop 2020-02-12T15:09:21.723 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.719+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 shutdown_connections 2020-02-12T15:09:21.723 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.719+0000 7fcaf05e1700 1 --2- 172.21.15.180:0/4137679339 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fcae8124790 0x7fcae8066600 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:21.724 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.719+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 >> 172.21.15.180:0/4137679339 conn(0x7fcae805a530 msgr2=0x7fcae8127980 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:21.724 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.720+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 shutdown_connections 2020-02-12T15:09:21.724 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:21.720+0000 7fcaf05e1700 1 -- 172.21.15.180:0/4137679339 wait complete. 2020-02-12T15:09:21.724 INFO:teuthology.orchestra.run.smithi180.stderr:adjusted tunables profile to default 2020-02-12T15:09:21.733 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2020-02-12T15:09:21.734 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:21.748 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.8yuJiHvV6D 2020-02-12T15:09:21.748 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.8yuJiHvV6D 2020-02-12T15:09:21.817 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.8yuJiHvV6D 2020-02-12T15:09:21.940 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.8yuJiHvV6D is 37B 2020-02-12T15:09:21.988 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.8yuJiHvV6D 2020-02-12T15:09:22.002 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:22.055 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.KMtDaWtmd4 2020-02-12T15:09:22.055 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.KMtDaWtmd4 2020-02-12T15:09:22.122 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.KMtDaWtmd4 2020-02-12T15:09:22.246 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.KMtDaWtmd4 is 37B 2020-02-12T15:09:22.294 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.KMtDaWtmd4 2020-02-12T15:09:22.308 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:22.361 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.CrBtG2pwAA 2020-02-12T15:09:22.362 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.CrBtG2pwAA 2020-02-12T15:09:22.429 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.CrBtG2pwAA 2020-02-12T15:09:22.564 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.CrBtG2pwAA is 37B 2020-02-12T15:09:22.611 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.CrBtG2pwAA 2020-02-12T15:09:22.625 INFO:teuthology.orchestra.run.smithi180:> mktemp 2020-02-12T15:09:22.678 INFO:teuthology.orchestra.run.smithi180.stdout:/tmp/tmp.CmBcoxVeh2 2020-02-12T15:09:22.678 INFO:teuthology.orchestra.run.smithi180:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.CmBcoxVeh2 2020-02-12T15:09:22.754 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 0666 /tmp/tmp.CmBcoxVeh2 2020-02-12T15:09:22.878 DEBUG:teuthology.orchestra.remote:smithi180:/tmp/tmp.CmBcoxVeh2 is 37B 2020-02-12T15:09:22.932 INFO:teuthology.orchestra.run.smithi180:> rm -fr /tmp/tmp.CmBcoxVeh2 2020-02-12T15:09:22.947 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:22.962 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.HodppIYmyq 2020-02-12T15:09:22.962 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.HodppIYmyq 2020-02-12T15:09:23.033 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.HodppIYmyq 2020-02-12T15:09:23.164 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.HodppIYmyq is 37B 2020-02-12T15:09:23.240 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.HodppIYmyq 2020-02-12T15:09:23.254 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:23.307 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.PGwJvdfukP 2020-02-12T15:09:23.308 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.PGwJvdfukP 2020-02-12T15:09:23.377 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.PGwJvdfukP 2020-02-12T15:09:23.516 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.PGwJvdfukP is 37B 2020-02-12T15:09:23.563 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.PGwJvdfukP 2020-02-12T15:09:23.577 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:23.637 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.8Iv52m8HG0 2020-02-12T15:09:23.637 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.8Iv52m8HG0 2020-02-12T15:09:23.706 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.8Iv52m8HG0 2020-02-12T15:09:23.834 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.8Iv52m8HG0 is 37B 2020-02-12T15:09:23.882 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.8Iv52m8HG0 2020-02-12T15:09:23.896 INFO:teuthology.orchestra.run.smithi105:> mktemp 2020-02-12T15:09:23.950 INFO:teuthology.orchestra.run.smithi105.stdout:/tmp/tmp.pQYCx63q6f 2020-02-12T15:09:23.951 INFO:teuthology.orchestra.run.smithi105:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.pQYCx63q6f 2020-02-12T15:09:24.018 INFO:teuthology.orchestra.run.smithi105:> sudo chmod 0666 /tmp/tmp.pQYCx63q6f 2020-02-12T15:09:24.143 DEBUG:teuthology.orchestra.remote:smithi105:/tmp/tmp.pQYCx63q6f is 37B 2020-02-12T15:09:24.196 INFO:teuthology.orchestra.run.smithi105:> rm -fr /tmp/tmp.pQYCx63q6f 2020-02-12T15:09:24.210 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 4df100fd-8809-4246-a50a-3070bb4eebff 0 2020-02-12T15:09:24.362 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.357+0000 7f7bf1993700 1 Processor -- start 2020-02-12T15:09:24.362 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.357+0000 7f7bf1993700 1 -- start start 2020-02-12T15:09:24.362 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bf1993700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec14c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:24.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bf1993700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:24.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bf1993700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec0a2b50 con 0x7f7bec0a14b0 2020-02-12T15:09:24.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bf1993700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec0a7670 con 0x7f7bec0a1890 2020-02-12T15:09:24.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bf1993700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bec07fb40 con 0x7f7bec0a7050 2020-02-12T15:09:24.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44616/0 (socket says 172.21.15.105:44616) 2020-02-12T15:09:24.363 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 -- 172.21.15.105:0/3624321652 learned_addr learned my addr 172.21.15.105:0/3624321652 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7beaffd700 1 --2- 172.21.15.105:0/3624321652 >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec14c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 -- 172.21.15.105:0/3624321652 >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 msgr2=0x7f7bec14c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- 172.21.15.105:0/3624321652 >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec14c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 -- 172.21.15.105:0/3624321652 >> v1:172.21.15.180:6789/0 conn(0x7f7bec0a14b0 legacy=0x7f7bec0a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 -- 172.21.15.105:0/3624321652 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec07fde0 con 0x7f7bec0a7050 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7beaffd700 1 --2- 172.21.15.105:0/3624321652 >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7bdc002f30 tx=0x7f7bdc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.364 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7bdc002f30 tx=0x7f7bdc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f7bdc002f30 tx=0x7f7bdc0088e0).ready entity=mon.2 client_cookie=609917124312582 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f7bdc002f30 tx=0x7f7bdc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bea7fc700 1 -- 172.21.15.105:0/3624321652 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bdc011760 con 0x7f7bec0a7050 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.358+0000 7f7bebfff700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f7bdc002f30 tx=0x7f7bdc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bebfff700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 secure :-1 s=THROTTLE_DONE pgs=6 cs=0 l=1 rx=0x7f7bdc002f30 tx=0x7f7bdc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bea7fc700 1 -- 172.21.15.105:0/3624321652 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7bdc0118c0 con 0x7f7bec0a7050 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bea7fc700 1 -- 172.21.15.105:0/3624321652 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7bdc011ca0 con 0x7f7bec0a7050 2020-02-12T15:09:24.365 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 -- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 msgr2=0x7f7bec14ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 secure :-1 s=READY pgs=6 cs=0 l=1 rx=0x7f7bdc002f30 tx=0x7f7bdc0088e0).stop 2020-02-12T15:09:24.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 -- 172.21.15.105:0/3624321652 shutdown_connections 2020-02-12T15:09:24.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 --2- 172.21.15.105:0/3624321652 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7bec0a7050 0x7f7bec14ed20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 --2- 172.21.15.105:0/3624321652 >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec14c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.366 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 -- 172.21.15.105:0/3624321652 >> 172.21.15.105:0/3624321652 conn(0x7f7bec05a530 msgr2=0x7f7bec05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:24.368 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 -- 172.21.15.105:0/3624321652 shutdown_connections 2020-02-12T15:09:24.368 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.359+0000 7f7bf1993700 1 -- 172.21.15.105:0/3624321652 wait complete. 2020-02-12T15:09:24.368 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.360+0000 7f7bf1993700 1 Processor -- start 2020-02-12T15:09:24.372 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.360+0000 7f7bf1993700 1 -- start start 2020-02-12T15:09:24.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bf1993700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec07ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bf1993700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7bec0a7050 0x7f7bec125980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bf1993700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bec0a0800 con 0x7f7bec0a14b0 2020-02-12T15:09:24.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bf1993700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec0a0560 con 0x7f7bec0a7050 2020-02-12T15:09:24.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bf1993700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bec09e270 con 0x7f7bec0a1890 2020-02-12T15:09:24.373 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bebfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7bec0a7050 0x7f7bec125980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beaffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec07ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.375 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beb7fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f7bec0a14b0 0x7f7bec07e5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.105:59530/0 (socket says 172.21.15.105:59530) 2020-02-12T15:09:24.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bebfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7bec0a7050 0x7f7bec125980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46040/0 (socket says 172.21.15.105:46040) 2020-02-12T15:09:24.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beb7fe700 1 -- 172.21.15.105:0/710987017 learned_addr learned my addr 172.21.15.105:0/710987017 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-02-12T15:09:24.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beaffd700 1 -- 172.21.15.105:0/710987017 >> v2:172.21.15.105:3300/0 conn(0x7f7bec0a7050 msgr2=0x7f7bec125980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> v2:172.21.15.105:3300/0 conn(0x7f7bec0a7050 0x7f7bec125980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beaffd700 1 -- 172.21.15.105:0/710987017 >> v1:172.21.15.180:6789/0 conn(0x7f7bec0a14b0 legacy=0x7f7bec07e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 197147287 0 0) 0x7f7bec0a0800 con 0x7f7bec0a14b0 2020-02-12T15:09:24.376 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beaffd700 1 -- 172.21.15.105:0/710987017 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bec067180 con 0x7f7bec0a1890 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7bebfff700 1 --2- 172.21.15.105:0/710987017 >> v2:172.21.15.105:3300/0 conn(0x7f7bec0a7050 0x7f7bec125980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.361+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> v2:172.21.15.180:3300/0 conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be0005e90 con 0x7f7bec0a1890 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.377 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7be0007160 con 0x7f7bec0a1890 2020-02-12T15:09:24.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bec124da0 con 0x7f7bec0a1890 2020-02-12T15:09:24.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7be0007540 con 0x7f7bec0a1890 2020-02-12T15:09:24.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bec09d140 con 0x7f7bec0a1890 2020-02-12T15:09:24.378 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.379 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 1) v1 ==== 349+0+0 (secure 0 0 0) 0x7f7be000e510 con 0x7f7bec0a1890 2020-02-12T15:09:24.379 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.379 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.362+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 754+0+0 (secure 0 0 0) 0x7f7be0007e40 con 0x7f7bec0a1890 2020-02-12T15:09:24.379 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.363+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bec0565b0 con 0x7f7bec0a1890 2020-02-12T15:09:24.380 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.365+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.380 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.365+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f7be000a0c0 con 0x7f7bec0a1890 2020-02-12T15:09:24.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.440+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.443 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.441+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f7be000e7a0 con 0x7f7bec0a1890 2020-02-12T15:09:24.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.458+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4df100fd-8809-4246-a50a-3070bb4eebff", "id": 0} v 0) v1 -- 0x7f7bec0a02f0 con 0x7f7bec0a1890 2020-02-12T15:09:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.462+0000 7f7beaffd700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.464 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.462+0000 7f7bd3fff700 1 -- 172.21.15.105:0/710987017 <== mon.1 v2:172.21.15.180:3300/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4df100fd-8809-4246-a50a-3070bb4eebff", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7be0008890 con 0x7f7bec0a1890 2020-02-12T15:09:24.465 INFO:teuthology.orchestra.run.smithi105.stdout:0 2020-02-12T15:09:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.463+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 msgr2=0x7f7bec07ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.463+0000 7f7bf1993700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f7be0002f30 tx=0x7f7be0010a90).stop 2020-02-12T15:09:24.466 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.464+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 shutdown_connections 2020-02-12T15:09:24.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.464+0000 7f7bf1993700 1 --2- 172.21.15.105:0/710987017 >> v2:172.21.15.105:3300/0 conn(0x7f7bec0a7050 0x7f7bec125980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.464+0000 7f7bf1993700 1 --2- 172.21.15.105:0/710987017 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7bec0a1890 0x7f7bec07ecd0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.464+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 >> 172.21.15.105:0/710987017 conn(0x7f7bec05a530 msgr2=0x7f7bec0a9170 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:24.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.464+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 shutdown_connections 2020-02-12T15:09:24.467 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.464+0000 7f7bf1993700 1 -- 172.21.15.105:0/710987017 wait complete. 2020-02-12T15:09:24.475 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 28d21319-600f-477f-9281-588b2f1d929c 1 2020-02-12T15:09:24.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.579+0000 7f2b7da99700 1 Processor -- start 2020-02-12T15:09:24.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.579+0000 7f2b7da99700 1 -- start start 2020-02-12T15:09:24.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b7da99700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:24.584 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b7da99700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2b780a7050 0x7f2b7814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:24.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b7da99700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b780a2b50 con 0x7f2b780a14b0 2020-02-12T15:09:24.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b7da99700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b780a7670 con 0x7f2b780a7050 2020-02-12T15:09:24.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b7da99700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7807fb40 con 0x7f2b780a1890 2020-02-12T15:09:24.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44644/0 (socket says 172.21.15.105:44644) 2020-02-12T15:09:24.585 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 -- 172.21.15.105:0/2139248242 learned_addr learned my addr 172.21.15.105:0/2139248242 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b7c837700 1 --2- 172.21.15.105:0/2139248242 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a7050 0x7f2b7814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 -- 172.21.15.105:0/2139248242 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a7050 msgr2=0x7f2b7814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/2139248242 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a7050 0x7f2b7814ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 -- 172.21.15.105:0/2139248242 >> v1:172.21.15.180:6789/0 conn(0x7f2b780a14b0 legacy=0x7f2b780a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 -- 172.21.15.105:0/2139248242 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7807fde0 con 0x7f2b780a1890 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b7c837700 1 --2- 172.21.15.105:0/2139248242 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a7050 0x7f2b7814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2b780a22c0 tx=0x7f2b600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.586 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2b780a22c0 tx=0x7f2b600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b600088e0).ready entity=mon.2 client_cookie=e3cf34fce206424c server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.580+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b777fe700 1 -- 172.21.15.105:0/2139248242 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b60011720 con 0x7f2b780a1890 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b777fe700 1 -- 172.21.15.105:0/2139248242 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b60011880 con 0x7f2b780a1890 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b777fe700 1 -- 172.21.15.105:0/2139248242 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b60011c20 con 0x7f2b780a1890 2020-02-12T15:09:24.587 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 -- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 msgr2=0x7f2b7814c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b600088e0).stop 2020-02-12T15:09:24.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 -- 172.21.15.105:0/2139248242 shutdown_connections 2020-02-12T15:09:24.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 --2- 172.21.15.105:0/2139248242 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a7050 0x7f2b7814ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 --2- 172.21.15.105:0/2139248242 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2b780a1890 0x7f2b7814c8b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 -- 172.21.15.105:0/2139248242 >> 172.21.15.105:0/2139248242 conn(0x7f2b7805a530 msgr2=0x7f2b7805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:24.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 -- 172.21.15.105:0/2139248242 shutdown_connections 2020-02-12T15:09:24.588 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.581+0000 7f2b7da99700 1 -- 172.21.15.105:0/2139248242 wait complete. 2020-02-12T15:09:24.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.582+0000 7f2b7da99700 1 Processor -- start 2020-02-12T15:09:24.589 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.582+0000 7f2b7da99700 1 -- start start 2020-02-12T15:09:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b7da99700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2b780a14b0 0x7f2b7809d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b7da99700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2b780a1890 0x7f2b7809cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b7da99700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b78122c70 con 0x7f2b780a7050 2020-02-12T15:09:24.592 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b7da99700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b78122530 con 0x7f2b780a1890 2020-02-12T15:09:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b7da99700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b781227d0 con 0x7f2b780a14b0 2020-02-12T15:09:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2b780a1890 0x7f2b7809cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2b780a1890 0x7f2b7809cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46068/0 (socket says 172.21.15.105:46068) 2020-02-12T15:09:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b77fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2b780a14b0 0x7f2b7809d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 -- 172.21.15.105:0/1230709788 learned_addr learned my addr 172.21.15.105:0/1230709788 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 -- 172.21.15.105:0/1230709788 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a14b0 msgr2=0x7f2b7809d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.593 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a14b0 0x7f2b7809d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 -- 172.21.15.105:0/1230709788 >> v1:172.21.15.180:6789/0 conn(0x7f2b780a7050 legacy=0x7f2b781311a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 -- 172.21.15.105:0/1230709788 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78120820 con 0x7f2b780a1890 2020-02-12T15:09:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> v2:172.21.15.105:3300/0 conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> v2:172.21.15.105:3300/0 conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.594 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b757fa700 1 -- 172.21.15.105:0/1230709788 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b60007340 con 0x7f2b780a1890 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b757fa700 1 -- 172.21.15.105:0/1230709788 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b600074a0 con 0x7f2b780a1890 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b757fa700 1 -- 172.21.15.105:0/1230709788 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b600058b0 con 0x7f2b780a1890 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.583+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b78067180 con 0x7f2b780a1890 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.584+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b780a0530 con 0x7f2b780a1890 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.584+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.595 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.584+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.584+0000 7f2b757fa700 1 -- 172.21.15.105:0/1230709788 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f2b60005b20 con 0x7f2b780a1890 2020-02-12T15:09:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.584+0000 7f2b757fa700 1 -- 172.21.15.105:0/1230709788 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 869+0+0 (secure 0 0 0) 0x7f2b60029c30 con 0x7f2b780a1890 2020-02-12T15:09:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.584+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b780565b0 con 0x7f2b780a1890 2020-02-12T15:09:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.586+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.596 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.587+0000 7f2b757fa700 1 -- 172.21.15.105:0/1230709788 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f2b60005db0 con 0x7f2b780a1890 2020-02-12T15:09:24.671 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.669+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "28d21319-600f-477f-9281-588b2f1d929c", "id": 1} v 0) v1 -- 0x7f2b780a9e50 con 0x7f2b780a1890 2020-02-12T15:09:24.676 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.674+0000 7f2b6ffff700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=THROTTLE_DONE pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.676 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.674+0000 7f2b757fa700 1 -- 172.21.15.105:0/1230709788 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "28d21319-600f-477f-9281-588b2f1d929c", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f2b600090c0 con 0x7f2b780a1890 2020-02-12T15:09:24.676 INFO:teuthology.orchestra.run.smithi105.stdout:1 2020-02-12T15:09:24.677 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 msgr2=0x7f2b7809cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.678 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 secure :-1 s=READY pgs=10 cs=0 l=1 rx=0x7f2b780a22c0 tx=0x7f2b7807fce0).stop 2020-02-12T15:09:24.678 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 shutdown_connections 2020-02-12T15:09:24.678 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 --2- 172.21.15.105:0/1230709788 >> v2:172.21.15.180:3300/0 conn(0x7f2b780a14b0 0x7f2b7809d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.678 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 --2- 172.21.15.105:0/1230709788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2b780a1890 0x7f2b7809cc40 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.678 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 >> 172.21.15.105:0/1230709788 conn(0x7f2b7805a530 msgr2=0x7f2b780a5de0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:24.678 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 shutdown_connections 2020-02-12T15:09:24.679 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.675+0000 7f2b7da99700 1 -- 172.21.15.105:0/1230709788 wait complete. 2020-02-12T15:09:24.687 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 9e54fd0f-70fd-4edc-8fc5-fee610a01d5a 2 2020-02-12T15:09:24.792 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.787+0000 7f27d4bf6700 1 Processor -- start 2020-02-12T15:09:24.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.787+0000 7f27d4bf6700 1 -- start start 2020-02-12T15:09:24.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27d4bf6700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27d00a14b0 0x7f27d00a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:24.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27d4bf6700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00a1890 0x7f27d00a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:24.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27d4bf6700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f27d00a7050 0x7f27d00a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:24.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27d4bf6700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00a7670 con 0x7f27d00a14b0 2020-02-12T15:09:24.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27d4bf6700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d00a2b50 con 0x7f27d00a7050 2020-02-12T15:09:24.793 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27d4bf6700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d007fde0 con 0x7f27d00a1890 2020-02-12T15:09:24.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27ced9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27d00a14b0 0x7f27d00a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27ce59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00a1890 0x7f27d00a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27ced9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f27d00a14b0 0x7f27d00a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46072/0 (socket says 172.21.15.105:46072) 2020-02-12T15:09:24.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27ced9d700 1 -- 172.21.15.105:0/348631538 learned_addr learned my addr 172.21.15.105:0/348631538 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:24.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27ce59c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00a1890 0x7f27d00a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44654/0 (socket says 172.21.15.105:44654) 2020-02-12T15:09:24.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.788+0000 7f27cf59e700 1 --2- 172.21.15.105:0/348631538 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a7050 0x7f27d00a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.794 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 -- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00a1890 msgr2=0x7f27d00a5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00a1890 0x7f27d00a5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 -- 172.21.15.105:0/348631538 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a7050 msgr2=0x7f27d00a2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a7050 0x7f27d00a2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 -- 172.21.15.105:0/348631538 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d007fb40 con 0x7f27d00a14b0 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> v2:172.21.15.105:3300/0 conn(0x7f27d00a14b0 0x7f27d00a4cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f27c0002f30 tx=0x7f27c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> v2:172.21.15.105:3300/0 conn(0x7f27d00a14b0 0x7f27d00a4cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f27c0002f30 tx=0x7f27c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d00a14b0 0x7f27d00a4cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f27c0002f30 tx=0x7f27c0007a40).ready entity=mon.0 client_cookie=4475bd5409ec031a server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:24.795 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d00a14b0 0x7f27d00a4cd0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f27c0002f30 tx=0x7f27c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27cdd9b700 1 -- 172.21.15.105:0/348631538 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c000f620 con 0x7f27d00a14b0 2020-02-12T15:09:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d00a14b0 0x7f27d00a4cd0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f27c0002f30 tx=0x7f27c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27ced9d700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d00a14b0 0x7f27d00a4cd0 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f27c0002f30 tx=0x7f27c0007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27cdd9b700 1 -- 172.21.15.105:0/348631538 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c000f780 con 0x7f27d00a14b0 2020-02-12T15:09:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27cdd9b700 1 -- 172.21.15.105:0/348631538 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c00118c0 con 0x7f27d00a14b0 2020-02-12T15:09:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 -- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d00a14b0 msgr2=0x7f27d00a4cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.796 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d00a14b0 0x7f27d00a4cd0 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f27c0002f30 tx=0x7f27c0007a40).stop 2020-02-12T15:09:24.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 -- 172.21.15.105:0/348631538 shutdown_connections 2020-02-12T15:09:24.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 --2- 172.21.15.105:0/348631538 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a7050 0x7f27d00a2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27d00a14b0 0x7f27d00a4cd0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 --2- 172.21.15.105:0/348631538 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27d00a1890 0x7f27d00a5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:24.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 -- 172.21.15.105:0/348631538 >> 172.21.15.105:0/348631538 conn(0x7f27d005a530 msgr2=0x7f27d005a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:24.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 -- 172.21.15.105:0/348631538 shutdown_connections 2020-02-12T15:09:24.797 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.789+0000 7f27d4bf6700 1 -- 172.21.15.105:0/348631538 wait complete. 2020-02-12T15:09:24.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.790+0000 7f27d4bf6700 1 Processor -- start 2020-02-12T15:09:24.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27d4bf6700 1 -- start start 2020-02-12T15:09:24.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27d4bf6700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f27d00a14b0 0x7f27d0066700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27d4bf6700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d005b2f0 con 0x7f27d00a1890 2020-02-12T15:09:24.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27d4bf6700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d0064050 con 0x7f27d00a7050 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27d4bf6700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d007f3d0 con 0x7f27d00a14b0 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27ce59c700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f27d00a1890 0x7f27d007e650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40086/0 (socket says 172.21.15.105:40086) 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27ce59c700 1 -- 172.21.15.105:0/3956168788 learned_addr learned my addr 172.21.15.105:0/3956168788 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27ced9d700 1 --2- 172.21.15.105:0/3956168788 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a14b0 0x7f27d0066700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3773838205 0 0) 0x7f27d005b2f0 con 0x7f27d00a1890 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.791+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27b4003230 con 0x7f27d00a1890 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 4086566022 0 0) 0x7f27b4003230 con 0x7f27d00a1890 2020-02-12T15:09:24.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 --> v1:172.21.15.105:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f27d005b2f0 con 0x7f27d00a1890 2020-02-12T15:09:24.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f27c4001490 con 0x7f27d00a1890 2020-02-12T15:09:24.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a14b0 msgr2=0x7f27d0066700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 --2- 172.21.15.105:0/3956168788 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a14b0 0x7f27d0066700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 >> v1:172.21.15.180:6789/0 conn(0x7f27d00a7050 legacy=0x7f27d013b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 >> v1:172.21.15.105:6789/0 conn(0x7f27d00a1890 legacy=0x7f27d007e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f27b40037f0 0x7f27b4003bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.804 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b40040a0 0x7f27b4004550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400b880 con 0x7f27b4004af0 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400b9f0 con 0x7f27b40037f0 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27b400bbb0 con 0x7f27b40040a0 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27ced9d700 1 --2- 172.21.15.105:0/3956168788 >> v2:172.21.15.180:3300/0 conn(0x7f27d00a14b0 0x7f27d0066700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27ce59c700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b40040a0 0x7f27b4004550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.805 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27ced9d700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f27b40037f0 0x7f27b4003bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 -- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b40040a0 msgr2=0x7f27b4004550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f27b40040a0 0x7f27b4004550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 -- 172.21.15.105:0/3956168788 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f27b40037f0 msgr2=0x7f27b4003bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f27b40037f0 0x7f27b4003bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d00642f0 con 0x7f27b4004af0 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d00637f0 con 0x7f27b4004af0 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d0063ba0 con 0x7f27b4004af0 2020-02-12T15:09:24.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 -- 172.21.15.105:0/3956168788 reap_dead start 2020-02-12T15:09:24.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:24.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c800eea0 con 0x7f27b4004af0 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c8005a40 con 0x7f27b4004af0 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.792+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c8005da0 con 0x7f27b4004af0 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.793+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.793+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.793+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f27c8010160 con 0x7f27b4004af0 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.793+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 984+0+0 (secure 0 0 0) 0x7f27c8028650 con 0x7f27b4004af0 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.793+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27a8003340 con 0x7f27b4004af0 2020-02-12T15:09:24.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.795+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.809 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.795+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f27c8001a80 con 0x7f27b4004af0 2020-02-12T15:09:24.880 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.878+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9e54fd0f-70fd-4edc-8fc5-fee610a01d5a", "id": 2} v 0) v1 -- 0x7f27a8002200 con 0x7f27b4004af0 2020-02-12T15:09:24.883 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.881+0000 7f27cf59e700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:24.883 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.881+0000 7f27bf7fe700 1 -- 172.21.15.105:0/3956168788 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9e54fd0f-70fd-4edc-8fc5-fee610a01d5a", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f27c800d0a0 con 0x7f27b4004af0 2020-02-12T15:09:24.883 INFO:teuthology.orchestra.run.smithi105.stdout:2 2020-02-12T15:09:24.884 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.882+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 msgr2=0x7f27b4004fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:24.884 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.882+0000 7f27d4bf6700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7f27c8007ca0 tx=0x7f27c8011040).stop 2020-02-12T15:09:24.884 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.882+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 shutdown_connections 2020-02-12T15:09:24.884 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.882+0000 7f27d4bf6700 1 --2- 172.21.15.105:0/3956168788 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f27b4004af0 0x7f27b4004fa0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:24.885 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.882+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 >> 172.21.15.105:0/3956168788 conn(0x7f27d005a530 msgr2=0x7f27d009ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:24.885 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.882+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 shutdown_connections 2020-02-12T15:09:24.885 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.882+0000 7f27d4bf6700 1 -- 172.21.15.105:0/3956168788 wait complete. 2020-02-12T15:09:24.894 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 92456651-4a29-4c77-831c-f41578383662 3 2020-02-12T15:09:25.000 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.995+0000 7f3de442c700 1 Processor -- start 2020-02-12T15:09:25.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.995+0000 7f3de442c700 1 -- start start 2020-02-12T15:09:25.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de442c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a14b0 0x7f3ddc0a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de442c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de442c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc0a2f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de442c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0a7670 con 0x7f3ddc0a14b0 2020-02-12T15:09:25.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de442c700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc0a2b50 con 0x7f3ddc0a7050 2020-02-12T15:09:25.001 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de442c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc07fde0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de29c9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a14b0 0x7f3ddc0a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44670/0 (socket says 172.21.15.105:44670) 2020-02-12T15:09:25.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 -- 172.21.15.105:0/399061802 learned_addr learned my addr 172.21.15.105:0/399061802 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:25.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de31ca700 1 --2- 172.21.15.105:0/399061802 >> v2:172.21.15.180:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc0a2f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 -- 172.21.15.105:0/399061802 >> v2:172.21.15.180:3300/0 conn(0x7f3ddc0a7050 msgr2=0x7f3ddc0a2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.002 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> v2:172.21.15.180:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc0a2f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 -- 172.21.15.105:0/399061802 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a14b0 msgr2=0x7f3ddc0a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a14b0 0x7f3ddc0a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 -- 172.21.15.105:0/399061802 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc07fb40 con 0x7f3ddc0a1890 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de31ca700 1 --2- 172.21.15.105:0/399061802 >> v2:172.21.15.180:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc0a2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de29c9700 1 --2- 172.21.15.105:0/399061802 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a14b0 0x7f3ddc0a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.003 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.996+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).ready entity=mon.2 client_cookie=79c053d41c7fbe0f server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de19c7700 1 -- 172.21.15.105:0/399061802 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dcc011670 con 0x7f3ddc0a1890 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de21c8700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 secure :-1 s=THROTTLE_DONE pgs=11 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de19c7700 1 -- 172.21.15.105:0/399061802 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc0117d0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de19c7700 1 -- 172.21.15.105:0/399061802 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dcc011b70 con 0x7f3ddc0a1890 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 -- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 msgr2=0x7f3ddc0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.004 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 secure :-1 s=READY pgs=11 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).stop 2020-02-12T15:09:25.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 -- 172.21.15.105:0/399061802 shutdown_connections 2020-02-12T15:09:25.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 --2- 172.21.15.105:0/399061802 >> v2:172.21.15.180:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc0a2f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 --2- 172.21.15.105:0/399061802 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a14b0 0x7f3ddc0a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 --2- 172.21.15.105:0/399061802 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc0a5130 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 -- 172.21.15.105:0/399061802 >> 172.21.15.105:0/399061802 conn(0x7f3ddc05a530 msgr2=0x7f3ddc05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 -- 172.21.15.105:0/399061802 shutdown_connections 2020-02-12T15:09:25.005 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.997+0000 7f3de442c700 1 -- 172.21.15.105:0/399061802 wait complete. 2020-02-12T15:09:25.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.998+0000 7f3de442c700 1 Processor -- start 2020-02-12T15:09:25.006 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.998+0000 7f3de442c700 1 -- start start 2020-02-12T15:09:25.008 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de442c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de442c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc1217b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de442c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ddc121c10 con 0x7f3ddc0a14b0 2020-02-12T15:09:25.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de442c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ddc1213c0 con 0x7f3ddc0a7050 2020-02-12T15:09:25.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de442c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ddc134700 con 0x7f3ddc0a1890 2020-02-12T15:09:25.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de29c9700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3ddc0a14b0 0x7f3ddc09f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40102/0 (socket says 172.21.15.105:40102) 2020-02-12T15:09:25.009 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de29c9700 1 -- 172.21.15.105:0/1450609436 learned_addr learned my addr 172.21.15.105:0/1450609436 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-02-12T15:09:25.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de31ca700 1 --2- 172.21.15.105:0/1450609436 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc1217b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 -- 172.21.15.105:0/1450609436 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a7050 msgr2=0x7f3ddc1217b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc1217b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 -- 172.21.15.105:0/1450609436 >> v1:172.21.15.105:6789/0 conn(0x7f3ddc0a14b0 legacy=0x7f3ddc09f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 -- 172.21.15.105:0/1450609436 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ddc09d300 con 0x7f3ddc0a1890 2020-02-12T15:09:25.010 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3dd37fe700 1 -- 172.21.15.105:0/1450609436 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dcc00f910 con 0x7f3ddc0a1890 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3dd37fe700 1 -- 172.21.15.105:0/1450609436 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dcc011e60 con 0x7f3ddc0a1890 2020-02-12T15:09:25.011 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ddc09ff30 con 0x7f3ddc0a1890 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:24.999+0000 7f3dd37fe700 1 -- 172.21.15.105:0/1450609436 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3dcc007340 con 0x7f3ddc0a1890 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.000+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ddc09f8c0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.000+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.000+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.000+0000 7f3dd37fe700 1 -- 172.21.15.105:0/1450609436 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f3dcc0074a0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.000+0000 7f3dd37fe700 1 -- 172.21.15.105:0/1450609436 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1099+0+0 (secure 0 0 0) 0x7f3dcc06ccc0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.001+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ddc0565b0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.012 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.003+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.013 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.003+0000 7f3dd37fe700 1 -- 172.21.15.105:0/1450609436 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f3dcc0056c0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.089 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.087+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "92456651-4a29-4c77-831c-f41578383662", "id": 3} v 0) v1 -- 0x7f3ddc09c7c0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.095+0000 7f3de21c8700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=THROTTLE_DONE pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.097 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.095+0000 7f3dd37fe700 1 -- 172.21.15.105:0/1450609436 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "92456651-4a29-4c77-831c-f41578383662", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3dcc00ace0 con 0x7f3ddc0a1890 2020-02-12T15:09:25.097 INFO:teuthology.orchestra.run.smithi105.stdout:3 2020-02-12T15:09:25.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 msgr2=0x7f3ddc1342a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.098 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 secure :-1 s=READY pgs=12 cs=0 l=1 rx=0x7f3dcc002f30 tx=0x7f3dcc007a40).stop 2020-02-12T15:09:25.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 shutdown_connections 2020-02-12T15:09:25.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 --2- 172.21.15.105:0/1450609436 >> v2:172.21.15.105:3300/0 conn(0x7f3ddc0a7050 0x7f3ddc1217b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 --2- 172.21.15.105:0/1450609436 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3ddc0a1890 0x7f3ddc1342a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 >> 172.21.15.105:0/1450609436 conn(0x7f3ddc05a530 msgr2=0x7f3ddc0a8120 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 shutdown_connections 2020-02-12T15:09:25.099 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.096+0000 7f3de442c700 1 -- 172.21.15.105:0/1450609436 wait complete. 2020-02-12T15:09:25.108 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new c4f6127f-eb03-4fd1-a750-64069fc04f5a 4 2020-02-12T15:09:25.219 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.210+0000 7fb9ae3ab700 1 Processor -- start 2020-02-12T15:09:25.219 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.210+0000 7fb9ae3ab700 1 -- start start 2020-02-12T15:09:25.219 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9ae3ab700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fb9a80a1890 0x7fb9a814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.219 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9ae3ab700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a80a2b50 con 0x7fb9a80a7050 2020-02-12T15:09:25.219 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9ae3ab700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a807fde0 con 0x7fb9a80a14b0 2020-02-12T15:09:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9ae3ab700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a807fb40 con 0x7fb9a80a1890 2020-02-12T15:09:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9ad149700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fb9a80a7050 0x7fb9a814ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40112/0 (socket says 172.21.15.105:40112) 2020-02-12T15:09:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9ad149700 1 -- 172.21.15.105:0/2513170365 learned_addr learned my addr 172.21.15.105:0/2513170365 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-02-12T15:09:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> v2:172.21.15.180:3300/0 conn(0x7fb9a80a1890 0x7fb9a814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 449849911 0 0) 0x7fb9a80a2b50 con 0x7fb9a80a7050 2020-02-12T15:09:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb990003230 con 0x7fb9a80a7050 2020-02-12T15:09:25.220 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 <== mon.0 v1:172.21.15.105:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2549012079 0 0) 0x7fb990003230 con 0x7fb9a80a7050 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 >> v2:172.21.15.180:3300/0 conn(0x7fb9a80a1890 msgr2=0x7fb9a814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9a77fe700 1 --2- 172.21.15.105:0/2513170365 >> v2:172.21.15.180:3300/0 conn(0x7fb9a80a1890 0x7fb9a814c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.211+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 >> v1:172.21.15.180:6789/0 conn(0x7fb9a80a14b0 legacy=0x7fb9a80a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 --> v1:172.21.15.105:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80a3f20 con 0x7fb9a80a7050 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 <== mon.0 v1:172.21.15.105:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7fb9a0001a50 con 0x7fb9a80a7050 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 >> v1:172.21.15.105:6789/0 conn(0x7fb9a80a7050 legacy=0x7fb9a814ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb990003720 0x7fb990003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.221 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb990004db0 0x7fb99000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a807fb40 con 0x7fb990003720 2020-02-12T15:09:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9900041c0 con 0x7fb990004db0 2020-02-12T15:09:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb99004fb90 con 0x7fb9900044d0 2020-02-12T15:09:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9ac948700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb990003720 0x7fb990003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.222 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9ad149700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb990004db0 0x7fb99000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 -- 172.21.15.105:0/2513170365 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb990004db0 msgr2=0x7fb99000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb990004db0 0x7fb99000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 -- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb990003720 msgr2=0x7fb990003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb990003720 0x7fb990003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 -- 172.21.15.105:0/2513170365 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990003230 con 0x7fb9900044d0 2020-02-12T15:09:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9ad149700 1 -- 172.21.15.105:0/2513170365 reap_dead start 2020-02-12T15:09:25.223 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9ac948700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fb990003720 0x7fb990003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:25.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb9900054a0 tx=0x7fb99c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb9900054a0 tx=0x7fb99c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fb9900054a0 tx=0x7fb99c010080).ready entity=mon.2 client_cookie=25a49d329e06f202 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb9900054a0 tx=0x7fb99c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb9900054a0 tx=0x7fb99c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb99c008d50 con 0x7fb9900044d0 2020-02-12T15:09:25.224 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 secure :-1 s=THROTTLE_DONE pgs=13 cs=0 l=1 rx=0x7fb9900054a0 tx=0x7fb99c010080).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb99c0108c0 con 0x7fb9900044d0 2020-02-12T15:09:25.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9a77fe700 1 -- 172.21.15.105:0/2513170365 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb99c010c60 con 0x7fb9900044d0 2020-02-12T15:09:25.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 msgr2=0x7fb990004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.212+0000 7fb9ae3ab700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 secure :-1 s=READY pgs=13 cs=0 l=1 rx=0x7fb9900054a0 tx=0x7fb99c010080).stop 2020-02-12T15:09:25.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.213+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/2513170365 shutdown_connections 2020-02-12T15:09:25.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.213+0000 7fb9ae3ab700 1 --2- 172.21.15.105:0/2513170365 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb990004950 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.225 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.213+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/2513170365 >> 172.21.15.105:0/2513170365 conn(0x7fb9a805a530 msgr2=0x7fb9a805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.213+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/2513170365 shutdown_connections 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.213+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/2513170365 wait complete. 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.214+0000 7fb9ae3ab700 1 Processor -- start 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.214+0000 7fb9ae3ab700 1 -- start start 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.214+0000 7fb9ae3ab700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ae3ab700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fb9a809d240 0x7fb9a809d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ae3ab700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9a805b050 con 0x7fb9a809faa0 2020-02-12T15:09:25.226 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ae3ab700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9a809af90 con 0x7fb9a809d240 2020-02-12T15:09:25.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ae3ab700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a809bb80 con 0x7fb9900044d0 2020-02-12T15:09:25.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44694/0 (socket says 172.21.15.105:44694) 2020-02-12T15:09:25.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 -- 172.21.15.105:0/188113130 learned_addr learned my addr 172.21.15.105:0/188113130 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:25.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9a7fff700 1 --2- 172.21.15.105:0/188113130 >> v2:172.21.15.180:3300/0 conn(0x7fb9a809d240 0x7fb9a809d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 -- 172.21.15.105:0/188113130 >> v2:172.21.15.180:3300/0 conn(0x7fb9a809d240 msgr2=0x7fb9a809d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.227 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> v2:172.21.15.180:3300/0 conn(0x7fb9a809d240 0x7fb9a809d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 -- 172.21.15.105:0/188113130 >> v1:172.21.15.180:6789/0 conn(0x7fb9a809faa0 legacy=0x7fb9a8134790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 -- 172.21.15.105:0/188113130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9a80a4800 con 0x7fb9900044d0 2020-02-12T15:09:25.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.228 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9a57fa700 1 -- 172.21.15.105:0/188113130 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb998003540 con 0x7fb9900044d0 2020-02-12T15:09:25.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9a57fa700 1 -- 172.21.15.105:0/188113130 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9980036a0 con 0x7fb9900044d0 2020-02-12T15:09:25.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a809db20 con 0x7fb9900044d0 2020-02-12T15:09:25.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9a57fa700 1 -- 172.21.15.105:0/188113130 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb998003a80 con 0x7fb9900044d0 2020-02-12T15:09:25.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.215+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a8099ca0 con 0x7fb9900044d0 2020-02-12T15:09:25.229 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.216+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.216+0000 7fb9a57fa700 1 -- 172.21.15.105:0/188113130 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7fb9980064e0 con 0x7fb9900044d0 2020-02-12T15:09:25.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.216+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.216+0000 7fb9a57fa700 1 -- 172.21.15.105:0/188113130 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1214+0+0 (secure 0 0 0) 0x7fb998028b10 con 0x7fb9900044d0 2020-02-12T15:09:25.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.216+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a80565b0 con 0x7fb9900044d0 2020-02-12T15:09:25.230 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.218+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.231 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.218+0000 7fb9a57fa700 1 -- 172.21.15.105:0/188113130 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7fb998003cf0 con 0x7fb9900044d0 2020-02-12T15:09:25.303 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.301+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c4f6127f-eb03-4fd1-a750-64069fc04f5a", "id": 4} v 0) v1 -- 0x7fb9a81232b0 con 0x7fb9900044d0 2020-02-12T15:09:25.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.307+0000 7fb9ac948700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=THROTTLE_DONE pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.309 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.307+0000 7fb9a57fa700 1 -- 172.21.15.105:0/188113130 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c4f6127f-eb03-4fd1-a750-64069fc04f5a", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb9980102d0 con 0x7fb9900044d0 2020-02-12T15:09:25.309 INFO:teuthology.orchestra.run.smithi105.stdout:4 2020-02-12T15:09:25.310 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 msgr2=0x7fb9a809b720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 secure :-1 s=READY pgs=14 cs=0 l=1 rx=0x7fb9a81246c0 tx=0x7fb998010c80).stop 2020-02-12T15:09:25.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 shutdown_connections 2020-02-12T15:09:25.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 --2- 172.21.15.105:0/188113130 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fb9900044d0 0x7fb9a809b720 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 --2- 172.21.15.105:0/188113130 >> v2:172.21.15.180:3300/0 conn(0x7fb9a809d240 0x7fb9a809d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 >> 172.21.15.105:0/188113130 conn(0x7fb9a805a530 msgr2=0x7fb9a80aa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 shutdown_connections 2020-02-12T15:09:25.311 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.308+0000 7fb9ae3ab700 1 -- 172.21.15.105:0/188113130 wait complete. 2020-02-12T15:09:25.320 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new 0555444c-f7af-429e-8386-d1b9c43ece8c 5 2020-02-12T15:09:25.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cbcf9f700 1 Processor -- start 2020-02-12T15:09:25.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cbcf9f700 1 -- start start 2020-02-12T15:09:25.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cbcf9f700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f8cb80a1890 0x7f8cb814c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cbcf9f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cbcf9f700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb80a2b50 con 0x7f8cb80a14b0 2020-02-12T15:09:25.426 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cbcf9f700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb80a7670 con 0x7f8cb80a1890 2020-02-12T15:09:25.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cbcf9f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb807fb40 con 0x7f8cb80a7050 2020-02-12T15:09:25.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cb759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.427 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cb759e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44700/0 (socket says 172.21.15.105:44700) 2020-02-12T15:09:25.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.421+0000 7f8cb759e700 1 -- 172.21.15.105:0/3087593314 learned_addr learned my addr 172.21.15.105:0/3087593314 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:25.432 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cae59c700 1 --2- 172.21.15.105:0/3087593314 >> v2:172.21.15.180:3300/0 conn(0x7f8cb80a1890 0x7f8cb814c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.441 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 -- 172.21.15.105:0/3087593314 >> v2:172.21.15.180:3300/0 conn(0x7f8cb80a1890 msgr2=0x7f8cb814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.441 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 --2- 172.21.15.105:0/3087593314 >> v2:172.21.15.180:3300/0 conn(0x7f8cb80a1890 0x7f8cb814c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.441 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 -- 172.21.15.105:0/3087593314 >> v1:172.21.15.180:6789/0 conn(0x7f8cb80a14b0 legacy=0x7f8cb80a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 -- 172.21.15.105:0/3087593314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb807fde0 con 0x7f8cb80a7050 2020-02-12T15:09:25.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f8cb805fbb0 tx=0x7f8cb0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f8cb805fbb0 tx=0x7f8cb0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.442 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f8cb805fbb0 tx=0x7f8cb0008c60).ready entity=mon.2 client_cookie=dc2c1ae6b6876e1b server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f8cb805fbb0 tx=0x7f8cb0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb659c700 1 -- 172.21.15.105:0/3087593314 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb000a160 con 0x7f8cb80a7050 2020-02-12T15:09:25.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f8cb805fbb0 tx=0x7f8cb0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb759e700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 secure :-1 s=THROTTLE_DONE pgs=15 cs=0 l=1 rx=0x7f8cb805fbb0 tx=0x7f8cb0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb659c700 1 -- 172.21.15.105:0/3087593314 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cb000a2c0 con 0x7f8cb80a7050 2020-02-12T15:09:25.449 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cb659c700 1 -- 172.21.15.105:0/3087593314 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8cb000a660 con 0x7f8cb80a7050 2020-02-12T15:09:25.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 msgr2=0x7f8cb814ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 secure :-1 s=READY pgs=15 cs=0 l=1 rx=0x7f8cb805fbb0 tx=0x7f8cb0008c60).stop 2020-02-12T15:09:25.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/3087593314 shutdown_connections 2020-02-12T15:09:25.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/3087593314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a7050 0x7f8cb814ed20 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/3087593314 >> v2:172.21.15.180:3300/0 conn(0x7f8cb80a1890 0x7f8cb814c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.422+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/3087593314 >> 172.21.15.105:0/3087593314 conn(0x7f8cb805a530 msgr2=0x7f8cb805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.450 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.423+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/3087593314 shutdown_connections 2020-02-12T15:09:25.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.423+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/3087593314 wait complete. 2020-02-12T15:09:25.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cbcf9f700 1 Processor -- start 2020-02-12T15:09:25.451 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cbcf9f700 1 -- start start 2020-02-12T15:09:25.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cbcf9f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cbcf9f700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cb80a7050 0x7f8cb8132180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cbcf9f700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb807f360 con 0x7f8cb80a1890 2020-02-12T15:09:25.454 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cbcf9f700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb8066740 con 0x7f8cb80a7050 2020-02-12T15:09:25.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cbcf9f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb80669e0 con 0x7f8cb80a14b0 2020-02-12T15:09:25.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cb6d9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cb759e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cb80a7050 0x7f8cb8132180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.455 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cb6d9d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44704/0 (socket says 172.21.15.105:44704) 2020-02-12T15:09:25.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cb759e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8cb80a7050 0x7f8cb8132180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46124/0 (socket says 172.21.15.105:46124) 2020-02-12T15:09:25.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.424+0000 7f8cb6d9d700 1 -- 172.21.15.105:0/544872200 learned_addr learned my addr 172.21.15.105:0/544872200 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:25.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 -- 172.21.15.105:0/544872200 >> v2:172.21.15.105:3300/0 conn(0x7f8cb80a7050 msgr2=0x7f8cb8132180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> v2:172.21.15.105:3300/0 conn(0x7f8cb80a7050 0x7f8cb8132180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.456 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 -- 172.21.15.105:0/544872200 >> v1:172.21.15.180:6789/0 conn(0x7f8cb80a1890 legacy=0x7f8cb807e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 -- 172.21.15.105:0/544872200 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb8066510 con 0x7f8cb80a14b0 2020-02-12T15:09:25.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.457 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca800cc20 con 0x7f8cb80a14b0 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca800cd80 con 0x7f8cb80a14b0 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cb805fbf0 con 0x7f8cb80a14b0 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8ca800e350 con 0x7f8cb80a14b0 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb807eeb0 con 0x7f8cb80a14b0 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 2) v1 ==== 22494+0+0 (secure 0 0 0) 0x7f8ca800e5c0 con 0x7f8cb80a14b0 2020-02-12T15:09:25.458 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.425+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.426+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1329+0+0 (secure 0 0 0) 0x7f8ca8028810 con 0x7f8cb80a14b0 2020-02-12T15:09:25.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.426+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb8131ff0 con 0x7f8cb80a14b0 2020-02-12T15:09:25.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.428+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.428+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67678 (secure 0 0 0) 0x7f8ca8010310 con 0x7f8cb80a14b0 2020-02-12T15:09:25.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.447+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.448+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f8ca8006d30 con 0x7f8cb80a14b0 2020-02-12T15:09:25.459 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.448+0000 7f8caffff700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8c9c0396d0 0x7f8c9c03bae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.448+0000 7f8cae59c700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8c9c0396d0 0x7f8c9c03bae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.460 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.448+0000 7f8cae59c700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8c9c0396d0 0x7f8c9c03bae0 crc :-1 s=READY pgs=3 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.518 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.516+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "0555444c-f7af-429e-8386-d1b9c43ece8c", "id": 5} v 0) v1 -- 0x7f8cb80565b0 con 0x7f8cb80a14b0 2020-02-12T15:09:25.526 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.524+0000 7f8cb6d9d700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=THROTTLE_DONE pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.526 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.524+0000 7f8caffff700 1 -- 172.21.15.105:0/544872200 <== mon.2 v2:172.21.15.105:3301/0 8 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0555444c-f7af-429e-8386-d1b9c43ece8c", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8ca80308a0 con 0x7f8cb80a14b0 2020-02-12T15:09:25.527 INFO:teuthology.orchestra.run.smithi105.stdout:5 2020-02-12T15:09:25.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8c9c0396d0 msgr2=0x7f8c9c03bae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8c9c0396d0 0x7f8c9c03bae0 crc :-1 s=READY pgs=3 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 msgr2=0x7f8cb8065ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.528 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 secure :-1 s=READY pgs=16 cs=0 l=1 rx=0x7f8ca80023d0 tx=0x7f8ca8010990).stop 2020-02-12T15:09:25.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 shutdown_connections 2020-02-12T15:09:25.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8c9c0396d0 0x7f8c9c03bae0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/544872200 >> v2:172.21.15.105:3300/0 conn(0x7f8cb80a7050 0x7f8cb8132180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 --2- 172.21.15.105:0/544872200 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8cb80a14b0 0x7f8cb8065ff0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 >> 172.21.15.105:0/544872200 conn(0x7f8cb805a530 msgr2=0x7f8cb80698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.529 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 shutdown_connections 2020-02-12T15:09:25.530 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.525+0000 7f8cbcf9f700 1 -- 172.21.15.105:0/544872200 wait complete. 2020-02-12T15:09:25.537 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new de4e35a2-4f35-47e5-84e7-a98c47c621f2 6 2020-02-12T15:09:25.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.638+0000 7f001889b700 1 Processor -- start 2020-02-12T15:09:25.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.638+0000 7f001889b700 1 -- start start 2020-02-12T15:09:25.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001889b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00140a14b0 0x7f00140a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001889b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.651 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001889b700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00140a2b50 con 0x7f00140a7050 2020-02-12T15:09:25.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001889b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00140a7670 con 0x7f00140a14b0 2020-02-12T15:09:25.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001889b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001407fb40 con 0x7f00140a1890 2020-02-12T15:09:25.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f0012d9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00140a14b0 0x7f00140a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f0012d9d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f00140a14b0 0x7f00140a4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.105:46138/0 (socket says 172.21.15.105:46138) 2020-02-12T15:09:25.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f0012d9d700 1 -- 172.21.15.105:0/571440914 learned_addr learned my addr 172.21.15.105:0/571440914 (peer_addr_for_me v2:172.21.15.105:0/0) 2020-02-12T15:09:25.652 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.105:44720/0 (socket says 172.21.15.105:44720) 2020-02-12T15:09:25.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 -- 172.21.15.105:0/571440914 >> v2:172.21.15.105:3300/0 conn(0x7f00140a14b0 msgr2=0x7f00140a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 --2- 172.21.15.105:0/571440914 >> v2:172.21.15.105:3300/0 conn(0x7f00140a14b0 0x7f00140a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 -- 172.21.15.105:0/571440914 >> v1:172.21.15.180:6789/0 conn(0x7f00140a7050 legacy=0x7f00140a2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 -- 172.21.15.105:0/571440914 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001407fde0 con 0x7f00140a1890 2020-02-12T15:09:25.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f0012d9d700 1 --2- 172.21.15.105:0/571440914 >> v2:172.21.15.105:3300/0 conn(0x7f00140a14b0 0x7f00140a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:25.653 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0008002f30 tx=0x7f00080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.654 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.639+0000 7f001259c700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0008002f30 tx=0x7f00080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.654 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001259c700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f0008002f30 tx=0x7f00080088e0).ready entity=mon.2 client_cookie=579f3fead1bf1b68 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.654 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001259c700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f0008002f30 tx=0x7f00080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.654 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f0011d9b700 1 -- 172.21.15.105:0/571440914 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0008008e40 con 0x7f00140a1890 2020-02-12T15:09:25.654 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001259c700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f0008002f30 tx=0x7f00080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.655 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001259c700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 secure :-1 s=THROTTLE_DONE pgs=17 cs=0 l=1 rx=0x7f0008002f30 tx=0x7f00080088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.655 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f0011d9b700 1 -- 172.21.15.105:0/571440914 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00080115f0 con 0x7f00140a1890 2020-02-12T15:09:25.655 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f0011d9b700 1 -- 172.21.15.105:0/571440914 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f00080119d0 con 0x7f00140a1890 2020-02-12T15:09:25.655 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 -- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 msgr2=0x7f00140a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.655 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 secure :-1 s=READY pgs=17 cs=0 l=1 rx=0x7f0008002f30 tx=0x7f00080088e0).stop 2020-02-12T15:09:25.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 -- 172.21.15.105:0/571440914 shutdown_connections 2020-02-12T15:09:25.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 --2- 172.21.15.105:0/571440914 >> v2:172.21.15.105:3300/0 conn(0x7f00140a14b0 0x7f00140a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 --2- 172.21.15.105:0/571440914 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a1890 0x7f00140a5130 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 -- 172.21.15.105:0/571440914 >> 172.21.15.105:0/571440914 conn(0x7f001405a530 msgr2=0x7f001405a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 -- 172.21.15.105:0/571440914 shutdown_connections 2020-02-12T15:09:25.656 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.640+0000 7f001889b700 1 -- 172.21.15.105:0/571440914 wait complete. 2020-02-12T15:09:25.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.641+0000 7f001889b700 1 Processor -- start 2020-02-12T15:09:25.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.641+0000 7f001889b700 1 -- start start 2020-02-12T15:09:25.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001889b700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f00140a14b0 0x7f0014064860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001889b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001889b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0014063ec0 con 0x7f00140a1890 2020-02-12T15:09:25.657 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001889b700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00140a5a90 con 0x7f00140a14b0 2020-02-12T15:09:25.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001889b700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0014064120 con 0x7f00140a7050 2020-02-12T15:09:25.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001259c700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f00140a1890 0x7f00141322f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40154/0 (socket says 172.21.15.105:40154) 2020-02-12T15:09:25.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001259c700 1 -- 172.21.15.105:0/2968554811 learned_addr learned my addr 172.21.15.105:0/2968554811 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-02-12T15:09:25.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f0012d9d700 1 --2- 172.21.15.105:0/2968554811 >> v2:172.21.15.180:3300/0 conn(0x7f00140a14b0 0x7f0014064860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1316089458 0 0) 0x7f0014063ec0 con 0x7f00140a1890 2020-02-12T15:09:25.658 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efff8003230 con 0x7f00140a1890 2020-02-12T15:09:25.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001359e700 1 -- 172.21.15.105:0/2968554811 >> v2:172.21.15.180:3300/0 conn(0x7f00140a14b0 msgr2=0x7f0014064860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> v2:172.21.15.180:3300/0 conn(0x7f00140a14b0 0x7f0014064860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001359e700 1 -- 172.21.15.105:0/2968554811 >> v1:172.21.15.105:6789/0 conn(0x7f00140a1890 legacy=0x7f00141322f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001359e700 1 -- 172.21.15.105:0/2968554811 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00140643c0 con 0x7f00140a7050 2020-02-12T15:09:25.659 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.642+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f000c002220 con 0x7f00140a7050 2020-02-12T15:09:25.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.660 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f000c002380 con 0x7f00140a7050 2020-02-12T15:09:25.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0014063a50 con 0x7f00140a7050 2020-02-12T15:09:25.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f000c0027a0 con 0x7f00140a7050 2020-02-12T15:09:25.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00140a5050 con 0x7f00140a7050 2020-02-12T15:09:25.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.643+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.644+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f000c002a10 con 0x7f00140a7050 2020-02-12T15:09:25.661 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.644+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.644+0000 7f00037fe700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7efff8039eb0 0x7efff803c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.644+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1444+0+0 (secure 0 0 0) 0x7f000c013060 con 0x7f00140a7050 2020-02-12T15:09:25.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.644+0000 7f0012d9d700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7efff8039eb0 0x7efff803c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.644+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0014099ef0 con 0x7f00140a7050 2020-02-12T15:09:25.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.644+0000 7f0012d9d700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7efff8039eb0 0x7efff803c370 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.662 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.648+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.663 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.648+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f000c02f3e0 con 0x7f00140a7050 2020-02-12T15:09:25.798 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.796+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "de4e35a2-4f35-47e5-84e7-a98c47c621f2", "id": 6} v 0) v1 -- 0x7f00140565b0 con 0x7f00140a7050 2020-02-12T15:09:25.802 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.800+0000 7f001359e700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=THROTTLE_DONE pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.803 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.800+0000 7f00037fe700 1 -- 172.21.15.105:0/2968554811 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "de4e35a2-4f35-47e5-84e7-a98c47c621f2", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f000c031ed0 con 0x7f00140a7050 2020-02-12T15:09:25.803 INFO:teuthology.orchestra.run.smithi105.stdout:6 2020-02-12T15:09:25.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7efff8039eb0 msgr2=0x7efff803c370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.806 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7efff8039eb0 0x7efff803c370 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 msgr2=0x7f00140635f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 secure :-1 s=READY pgs=18 cs=0 l=1 rx=0x7f00140a22c0 tx=0x7f000c010ba0).stop 2020-02-12T15:09:25.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 shutdown_connections 2020-02-12T15:09:25.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7efff8039eb0 0x7efff803c370 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 --2- 172.21.15.105:0/2968554811 >> v2:172.21.15.180:3300/0 conn(0x7f00140a14b0 0x7f0014064860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 --2- 172.21.15.105:0/2968554811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f00140a7050 0x7f00140635f0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.807 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 >> 172.21.15.105:0/2968554811 conn(0x7f001405a530 msgr2=0x7f001409ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 shutdown_connections 2020-02-12T15:09:25.808 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.802+0000 7f001889b700 1 -- 172.21.15.105:0/2968554811 wait complete. 2020-02-12T15:09:25.814 INFO:teuthology.orchestra.run.smithi105:> sudo ceph --cluster ceph osd new f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5 7 2020-02-12T15:09:25.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.917+0000 7f37b2253700 1 Processor -- start 2020-02-12T15:09:25.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.917+0000 7f37b2253700 1 -- start start 2020-02-12T15:09:25.922 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37b2253700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f37ac0a14b0 0x7f37ac0a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37b2253700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:25.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37b2253700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac0a2b50 con 0x7f37ac0a7050 2020-02-12T15:09:25.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37b2253700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37ac0a7670 con 0x7f37ac0a14b0 2020-02-12T15:09:25.923 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37b2253700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac07fb40 con 0x7f37ac0a1890 2020-02-12T15:09:25.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37abfff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f37ac0a14b0 0x7f37ac0a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37a3fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37b0ff1700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f37ac0a7050 0x7f37ac0a2f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40164/0 (socket says 172.21.15.105:40164) 2020-02-12T15:09:25.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37b0ff1700 1 -- 172.21.15.105:0/3982845160 learned_addr learned my addr 172.21.15.105:0/3982845160 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-02-12T15:09:25.924 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37a3fff700 1 -- 172.21.15.105:0/3982845160 >> v2:172.21.15.105:3300/0 conn(0x7f37ac0a14b0 msgr2=0x7f37ac0a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37a3fff700 1 --2- 172.21.15.105:0/3982845160 >> v2:172.21.15.105:3300/0 conn(0x7f37ac0a14b0 0x7f37ac0a4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37a3fff700 1 -- 172.21.15.105:0/3982845160 >> v1:172.21.15.105:6789/0 conn(0x7f37ac0a7050 legacy=0x7f37ac0a2f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37a3fff700 1 -- 172.21.15.105:0/3982845160 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac07fde0 con 0x7f37ac0a1890 2020-02-12T15:09:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.918+0000 7f37a3fff700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3794002f30 tx=0x7f37940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37a3fff700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3794002f30 tx=0x7f37940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.925 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37a3fff700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f3794002f30 tx=0x7f37940088e0).ready entity=mon.2 client_cookie=454f3412908bd28a server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37a3fff700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3794002f30 tx=0x7f37940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37a3fff700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3794002f30 tx=0x7f37940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37ab7fe700 1 -- 172.21.15.105:0/3982845160 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3794008e40 con 0x7f37ac0a1890 2020-02-12T15:09:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37a3fff700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 secure :-1 s=THROTTLE_DONE pgs=19 cs=0 l=1 rx=0x7f3794002f30 tx=0x7f37940088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37ab7fe700 1 -- 172.21.15.105:0/3982845160 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37940115f0 con 0x7f37ac0a1890 2020-02-12T15:09:25.926 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37ab7fe700 1 -- 172.21.15.105:0/3982845160 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37940119d0 con 0x7f37ac0a1890 2020-02-12T15:09:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 -- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 msgr2=0x7f37ac0a5130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 secure :-1 s=READY pgs=19 cs=0 l=1 rx=0x7f3794002f30 tx=0x7f37940088e0).stop 2020-02-12T15:09:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 -- 172.21.15.105:0/3982845160 shutdown_connections 2020-02-12T15:09:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 --2- 172.21.15.105:0/3982845160 >> v2:172.21.15.105:3300/0 conn(0x7f37ac0a14b0 0x7f37ac0a4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 --2- 172.21.15.105:0/3982845160 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a1890 0x7f37ac0a5130 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:25.927 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 -- 172.21.15.105:0/3982845160 >> 172.21.15.105:0/3982845160 conn(0x7f37ac05a530 msgr2=0x7f37ac05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:25.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 -- 172.21.15.105:0/3982845160 shutdown_connections 2020-02-12T15:09:25.928 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.919+0000 7f37b2253700 1 -- 172.21.15.105:0/3982845160 wait complete. 2020-02-12T15:09:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.920+0000 7f37b2253700 1 Processor -- start 2020-02-12T15:09:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.920+0000 7f37b2253700 1 -- start start 2020-02-12T15:09:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b2253700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.932 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b2253700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac063f30 con 0x7f37ac0a14b0 2020-02-12T15:09:25.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b2253700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37ac064160 con 0x7f37ac0a1890 2020-02-12T15:09:25.933 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b2253700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37ac064400 con 0x7f37ac0a7050 2020-02-12T15:09:25.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37abfff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f37ac0a14b0 0x7f37ac066a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.105:40166/0 (socket says 172.21.15.105:40166) 2020-02-12T15:09:25.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b0ff1700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37abfff700 1 -- 172.21.15.105:0/2807759280 learned_addr learned my addr 172.21.15.105:0/2807759280 (peer_addr_for_me v1:172.21.15.105:0/0) 2020-02-12T15:09:25.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4054837318 0 0) 0x7f37ac063f30 con 0x7f37ac0a14b0 2020-02-12T15:09:25.934 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3790003230 con 0x7f37ac0a14b0 2020-02-12T15:09:25.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b0ff1700 1 -- 172.21.15.105:0/2807759280 >> v1:172.21.15.180:6789/0 conn(0x7f37ac0a1890 legacy=0x7f37ac07e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b0ff1700 1 -- 172.21.15.105:0/2807759280 >> v1:172.21.15.105:6789/0 conn(0x7f37ac0a14b0 legacy=0x7f37ac066a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:25.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b0ff1700 1 -- 172.21.15.105:0/2807759280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37ac0639c0 con 0x7f37ac0a7050 2020-02-12T15:09:25.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.921+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.935 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a4012210 con 0x7f37ac0a7050 2020-02-12T15:09:25.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.936 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37a40123b0 con 0x7f37ac0a7050 2020-02-12T15:09:25.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37ac062110 con 0x7f37ac0a7050 2020-02-12T15:09:25.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f37a40127d0 con 0x7f37ac0a7050 2020-02-12T15:09:25.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37ac067310 con 0x7f37ac0a7050 2020-02-12T15:09:25.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.922+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.923+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7f37a4012a40 con 0x7f37ac0a7050 2020-02-12T15:09:25.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.923+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.937 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.923+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37ac064880 con 0x7f37ac0a7050 2020-02-12T15:09:25.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.923+0000 7f37a97fa700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3790039ea0 0x7f379003c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:25.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.923+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1559+0+0 (secure 0 0 0) 0x7f37a4049c10 con 0x7f37ac0a7050 2020-02-12T15:09:25.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.923+0000 7f37abfff700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3790039ea0 0x7f379003c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:25.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.923+0000 7f37abfff700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3790039ea0 0x7f379003c360 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:25.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.926+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:25.938 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:25.926+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f37ac064880 con 0x7f37ac0a7050 2020-02-12T15:09:26.079 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.077+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd new", "uuid": "f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5", "id": 7} v 0) v1 -- 0x7f37ac064880 con 0x7f37ac0a7050 2020-02-12T15:09:26.083 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.081+0000 7f37b0ff1700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=THROTTLE_DONE pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:26.084 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.081+0000 7f37a97fa700 1 -- 172.21.15.105:0/2807759280 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f37ac064880 con 0x7f37ac0a7050 2020-02-12T15:09:26.084 INFO:teuthology.orchestra.run.smithi105.stdout:7 2020-02-12T15:09:26.086 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.083+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3790039ea0 msgr2=0x7f379003c360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:26.086 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.083+0000 7f37b2253700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3790039ea0 0x7f379003c360 crc :-1 s=READY pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:26.086 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.083+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 msgr2=0x7f37ac066190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:26.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.083+0000 7f37b2253700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 secure :-1 s=READY pgs=20 cs=0 l=1 rx=0x7f37ac064840 tx=0x7f37a4010bb0).stop 2020-02-12T15:09:26.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.084+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 shutdown_connections 2020-02-12T15:09:26.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.084+0000 7f37b2253700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3790039ea0 0x7f379003c360 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:26.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.084+0000 7f37b2253700 1 --2- 172.21.15.105:0/2807759280 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f37ac0a7050 0x7f37ac066190 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:26.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.084+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 >> 172.21.15.105:0/2807759280 conn(0x7f37ac05a530 msgr2=0x7f37ac09ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:26.087 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.084+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 shutdown_connections 2020-02-12T15:09:26.088 INFO:teuthology.orchestra.run.smithi105.stderr:2020-02-12T15:09:26.084+0000 7f37b2253700 1 -- 172.21.15.105:0/2807759280 wait complete. 2020-02-12T15:09:26.096 INFO:tasks.ceph.osd.0:Restarting daemon 2020-02-12T15:09:26.096 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2020-02-12T15:09:26.099 INFO:tasks.ceph.osd.0:Started 2020-02-12T15:09:26.099 INFO:tasks.ceph.osd.1:Restarting daemon 2020-02-12T15:09:26.099 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2020-02-12T15:09:26.101 INFO:tasks.ceph.osd.1:Started 2020-02-12T15:09:26.102 INFO:tasks.ceph.osd.2:Restarting daemon 2020-02-12T15:09:26.102 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2020-02-12T15:09:26.105 INFO:tasks.ceph.osd.2:Started 2020-02-12T15:09:26.105 INFO:tasks.ceph.osd.3:Restarting daemon 2020-02-12T15:09:26.105 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2020-02-12T15:09:26.108 INFO:tasks.ceph.osd.3:Started 2020-02-12T15:09:26.108 INFO:tasks.ceph.osd.4:Restarting daemon 2020-02-12T15:09:26.108 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2020-02-12T15:09:26.111 INFO:tasks.ceph.osd.4:Started 2020-02-12T15:09:26.111 INFO:tasks.ceph.osd.5:Restarting daemon 2020-02-12T15:09:26.111 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2020-02-12T15:09:26.114 INFO:tasks.ceph.osd.5:Started 2020-02-12T15:09:26.114 INFO:tasks.ceph.osd.6:Restarting daemon 2020-02-12T15:09:26.114 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2020-02-12T15:09:26.116 INFO:tasks.ceph.osd.6:Started 2020-02-12T15:09:26.116 INFO:tasks.ceph.osd.7:Restarting daemon 2020-02-12T15:09:26.117 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2020-02-12T15:09:26.119 INFO:tasks.ceph.osd.7:Started 2020-02-12T15:09:26.120 INFO:tasks.ceph:Waiting for OSDs to come up 2020-02-12T15:09:26.702 INFO:tasks.ceph.osd.0.smithi180.stderr:2020-02-12T15:09:26.698+0000 7f068bdc4ec0 -1 Falling back to public interface 2020-02-12T15:09:26.705 INFO:tasks.ceph.osd.5.smithi105.stderr:2020-02-12T15:09:26.703+0000 7fe69a736ec0 -1 Falling back to public interface 2020-02-12T15:09:26.710 INFO:tasks.ceph.osd.6.smithi105.stderr:2020-02-12T15:09:26.708+0000 7fc0e4d78ec0 -1 Falling back to public interface 2020-02-12T15:09:26.714 INFO:tasks.ceph.osd.1.smithi180.stderr:2020-02-12T15:09:26.710+0000 7f579e0d4ec0 -1 Falling back to public interface 2020-02-12T15:09:26.720 INFO:tasks.ceph.osd.2.smithi180.stderr:2020-02-12T15:09:26.716+0000 7f81bec71ec0 -1 Falling back to public interface 2020-02-12T15:09:26.726 INFO:tasks.ceph.osd.4.smithi105.stderr:2020-02-12T15:09:26.724+0000 7fcef9227ec0 -1 Falling back to public interface 2020-02-12T15:09:26.730 INFO:tasks.ceph.osd.7.smithi105.stderr:2020-02-12T15:09:26.728+0000 7fe51fc7eec0 -1 Falling back to public interface 2020-02-12T15:09:26.732 INFO:tasks.ceph.osd.3.smithi180.stderr:2020-02-12T15:09:26.728+0000 7f52be4abec0 -1 Falling back to public interface 2020-02-12T15:09:26.928 INFO:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-02-12T15:09:27.055 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.048+0000 7ffbc3cd2700 1 Processor -- start 2020-02-12T15:09:27.056 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.048+0000 7ffbc3cd2700 1 -- start start 2020-02-12T15:09:27.056 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc3cd2700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ffbbc0a6e80 0x7ffbbc0a5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:27.056 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc3cd2700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc14e830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:27.056 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc3cd2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc0a5230 con 0x7ffbbc0a1440 2020-02-12T15:09:27.057 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc3cd2700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc0a6990 con 0x7ffbbc0a6e80 2020-02-12T15:09:27.057 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc3cd2700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc09a290 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.057 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc2a70700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc14e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:27.057 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc2a70700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc14e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50390/0 (socket says 172.21.15.180:50390) 2020-02-12T15:09:27.057 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc2a70700 1 -- 172.21.15.180:0/3424681844 learned_addr learned my addr 172.21.15.180:0/3424681844 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:27.058 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc226f700 1 --2- 172.21.15.180:0/3424681844 >> v2:172.21.15.105:3300/0 conn(0x7ffbbc0a6e80 0x7ffbbc0a5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:27.058 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc2a70700 1 -- 172.21.15.180:0/3424681844 >> v2:172.21.15.105:3300/0 conn(0x7ffbbc0a6e80 msgr2=0x7ffbbc0a5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:27.058 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/3424681844 >> v2:172.21.15.105:3300/0 conn(0x7ffbbc0a6e80 0x7ffbbc0a5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:27.058 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc2a70700 1 -- 172.21.15.180:0/3424681844 >> v1:172.21.15.105:6789/0 conn(0x7ffbbc0a1440 legacy=0x7ffbbc0a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:27.058 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.049+0000 7ffbc2a70700 1 -- 172.21.15.180:0/3424681844 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0a54d0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.059 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/3424681844 >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc14e830 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ffbb40032b0 tx=0x7ffbb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.059 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/3424681844 >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc14e830 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ffbb40032b0 tx=0x7ffbb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.059 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/3424681844 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc14e830 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7ffbb40032b0 tx=0x7ffbb4007dc0).ready entity=mon.1 client_cookie=d5336498ed58ca68 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:27.059 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/3424681844 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc14e830 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ffbb40032b0 tx=0x7ffbb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.060 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/3424681844 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc14e830 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ffbb40032b0 tx=0x7ffbb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.060 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc126d700 1 -- 172.21.15.180:0/3424681844 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbb400a160 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.060 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/3424681844 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc14e830 secure :-1 s=THROTTLE_DONE pgs=33 cs=0 l=1 rx=0x7ffbb40032b0 tx=0x7ffbb4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.060 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc126d700 1 -- 172.21.15.180:0/3424681844 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbb400a2c0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.060 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc126d700 1 -- 172.21.15.180:0/3424681844 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbb400a6a0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.060 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/3424681844 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 msgr2=0x7ffbbc14e830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:27.061 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/3424681844 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc14e830 secure :-1 s=READY pgs=33 cs=0 l=1 rx=0x7ffbb40032b0 tx=0x7ffbb4007dc0).stop 2020-02-12T15:09:27.061 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/3424681844 shutdown_connections 2020-02-12T15:09:27.061 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/3424681844 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc14e830 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:27.061 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/3424681844 >> v2:172.21.15.105:3300/0 conn(0x7ffbbc0a6e80 0x7ffbbc0a5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:27.061 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/3424681844 >> 172.21.15.180:0/3424681844 conn(0x7ffbbc05a5b0 msgr2=0x7ffbbc05ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:27.061 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/3424681844 shutdown_connections 2020-02-12T15:09:27.062 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.050+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/3424681844 wait complete. 2020-02-12T15:09:27.064 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.052+0000 7ffbc3cd2700 1 Processor -- start 2020-02-12T15:09:27.065 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.052+0000 7ffbc3cd2700 1 -- start start 2020-02-12T15:09:27.065 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc3cd2700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc063350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:27.065 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc3cd2700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbbc0a6e80 0x7ffbbc061e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:27.065 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc3cd2700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffbbc0637b0 con 0x7ffbbc0a1440 2020-02-12T15:09:27.065 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc3cd2700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffbbc064e80 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.066 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc3cd2700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffbbc065120 con 0x7ffbbc0a6e80 2020-02-12T15:09:27.066 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc226f700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7ffbbc0a1440 0x7ffbbc07daa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.180:36486/0 (socket says 172.21.15.180:36486) 2020-02-12T15:09:27.066 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc226f700 1 -- 172.21.15.180:0/2259120412 learned_addr learned my addr 172.21.15.180:0/2259120412 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:27.066 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc063350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:27.066 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc2a70700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbbc0a6e80 0x7ffbbc061e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:27.066 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 244057706 0 0) 0x7ffbb8001ec0 con 0x7ffbbc0a1440 2020-02-12T15:09:27.066 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffba4003230 con 0x7ffbbc0a1440 2020-02-12T15:09:27.067 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 -- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbbc0a6e80 msgr2=0x7ffbbc061e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:27.067 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbbc0a6e80 0x7ffbbc061e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:27.067 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 -- 172.21.15.180:0/2259120412 >> v1:172.21.15.105:6789/0 conn(0x7ffbbc0a1440 legacy=0x7ffbbc07daa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:27.067 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 -- 172.21.15.180:0/2259120412 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffbbc0653c0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.067 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.067 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> v2:172.21.15.180:3300/0 conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.068 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:27.068 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.068 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.069 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbac00cc00 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.069 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.070 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffbac011e90 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.070 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.053+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffbbc064b70 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.070 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.054+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ffbac010e20 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.070 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.054+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffbbc07e1b0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.070 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.054+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.070 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.055+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 3) v1 ==== 45077+0+0 (secure 0 0 0) 0x7ffbac0064e0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.071 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.055+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.071 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.055+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffbbc0565b0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.071 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.055+0000 7ffbb2ffd700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ffba403c100 0x7ffba403e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:27.071 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.055+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1674+0+0 (secure 0 0 0) 0x7ffbac049270 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.071 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.055+0000 7ffbc226f700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ffba403c100 0x7ffba403e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:27.071 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.055+0000 7ffbc226f700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ffba403c100 0x7ffba403e5c0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:27.072 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.062+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.072 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.062+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ffbac02e780 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.204 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.200+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ffbbc05e320 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.204 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.201+0000 7ffbc1a6e700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=THROTTLE_DONE pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:27.205 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.201+0000 7ffbb2ffd700 1 -- 172.21.15.180:0/2259120412 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+6849 (secure 0 0 0) 0x7ffbac00aae0 con 0x7ffbbc0a64e0 2020-02-12T15:09:27.205 INFO:teuthology.misc.health.smithi180.stdout: 2020-02-12T15:09:27.205 INFO:teuthology.misc.health.smithi180.stdout:{"epoch":10,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:26.078874+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:27.206 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ffba403c100 msgr2=0x7ffba403e5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:27.207 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ffba403c100 0x7ffba403e5c0 crc :-1 s=READY pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:27.207 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 msgr2=0x7ffbbc063350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:27.207 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 secure :-1 s=READY pgs=34 cs=0 l=1 rx=0x7ffbbc0a2620 tx=0x7ffbac0108e0).stop 2020-02-12T15:09:27.207 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 shutdown_connections 2020-02-12T15:09:27.207 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ffba403c100 0x7ffba403e5c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:27.207 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ffbbc0a6e80 0x7ffbbc061e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:27.208 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 --2- 172.21.15.180:0/2259120412 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ffbbc0a64e0 0x7ffbbc063350 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:27.208 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 >> 172.21.15.180:0/2259120412 conn(0x7ffbbc05a5b0 msgr2=0x7ffbbc0a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:27.208 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 shutdown_connections 2020-02-12T15:09:27.208 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:27.202+0000 7ffbc3cd2700 1 -- 172.21.15.180:0/2259120412 wait complete. 2020-02-12T15:09:27.215 DEBUG:teuthology.misc:0 of 8 OSDs are up 2020-02-12T15:09:27.764 INFO:tasks.ceph.osd.5.smithi105.stderr:2020-02-12T15:09:27.762+0000 7fe69a736ec0 -1 osd.5 0 log_to_monitors {default=true} 2020-02-12T15:09:27.766 INFO:tasks.ceph.osd.0.smithi180.stderr:2020-02-12T15:09:27.763+0000 7f068bdc4ec0 -1 osd.0 0 log_to_monitors {default=true} 2020-02-12T15:09:27.782 INFO:tasks.ceph.osd.1.smithi180.stderr:2020-02-12T15:09:27.779+0000 7f579e0d4ec0 -1 osd.1 0 log_to_monitors {default=true} 2020-02-12T15:09:27.789 INFO:tasks.ceph.osd.6.smithi105.stderr:2020-02-12T15:09:27.787+0000 7fc0e4d78ec0 -1 osd.6 0 log_to_monitors {default=true} 2020-02-12T15:09:27.791 INFO:tasks.ceph.osd.2.smithi180.stderr:2020-02-12T15:09:27.788+0000 7f81bec71ec0 -1 osd.2 0 log_to_monitors {default=true} 2020-02-12T15:09:27.800 INFO:tasks.ceph.osd.4.smithi105.stderr:2020-02-12T15:09:27.798+0000 7fcef9227ec0 -1 osd.4 0 log_to_monitors {default=true} 2020-02-12T15:09:27.802 INFO:tasks.ceph.osd.3.smithi180.stderr:2020-02-12T15:09:27.798+0000 7f52be4abec0 -1 osd.3 0 log_to_monitors {default=true} 2020-02-12T15:09:27.809 INFO:tasks.ceph.osd.7.smithi105.stderr:2020-02-12T15:09:27.807+0000 7fe51fc7eec0 -1 osd.7 0 log_to_monitors {default=true} 2020-02-12T15:09:29.507 INFO:tasks.ceph.osd.1.smithi180.stderr:2020-02-12T15:09:29.504+0000 7f578689f700 -1 osd.1 0 waiting for initial osdmap 2020-02-12T15:09:29.509 INFO:tasks.ceph.osd.3.smithi180.stderr:2020-02-12T15:09:29.506+0000 7f52a6c76700 -1 osd.3 0 waiting for initial osdmap 2020-02-12T15:09:29.510 INFO:tasks.ceph.osd.6.smithi105.stderr:2020-02-12T15:09:29.508+0000 7fc0cd543700 -1 osd.6 0 waiting for initial osdmap 2020-02-12T15:09:29.511 INFO:tasks.ceph.osd.0.smithi180.stderr:2020-02-12T15:09:29.506+0000 7f067458f700 -1 osd.0 0 waiting for initial osdmap 2020-02-12T15:09:29.511 INFO:tasks.ceph.osd.2.smithi180.stderr:2020-02-12T15:09:29.508+0000 7f81a743c700 -1 osd.2 0 waiting for initial osdmap 2020-02-12T15:09:29.512 INFO:tasks.ceph.osd.4.smithi105.stderr:2020-02-12T15:09:29.509+0000 7fcee19f2700 -1 osd.4 0 waiting for initial osdmap 2020-02-12T15:09:29.512 INFO:tasks.ceph.osd.7.smithi105.stderr:2020-02-12T15:09:29.510+0000 7fe508449700 -1 osd.7 0 waiting for initial osdmap 2020-02-12T15:09:29.513 INFO:tasks.ceph.osd.5.smithi105.stderr:2020-02-12T15:09:29.511+0000 7fe682f01700 -1 osd.5 0 waiting for initial osdmap 2020-02-12T15:09:34.022 INFO:teuthology.orchestra.run.smithi180:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2020-02-12T15:09:34.132 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.122+0000 7fad9fde9700 1 Processor -- start 2020-02-12T15:09:34.132 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.122+0000 7fad9fde9700 1 -- start start 2020-02-12T15:09:34.132 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9fde9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 0x7fad98150af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:34.132 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9fde9700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad9807fdd0 con 0x7fad980a6ef0 2020-02-12T15:09:34.133 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9fde9700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad981487a0 con 0x7fad9807f4e0 2020-02-12T15:09:34.133 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9fde9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980a5200 con 0x7fad9807f940 2020-02-12T15:09:34.133 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9db85700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fad9807f4e0 0x7fad9814d3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42130/0 (socket says 172.21.15.180:42130) 2020-02-12T15:09:34.133 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9db85700 1 -- 172.21.15.180:0/2955419441 learned_addr learned my addr 172.21.15.180:0/2955419441 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:34.133 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2959921613 0 0) 0x7fad981487a0 con 0x7fad9807f4e0 2020-02-12T15:09:34.133 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad84003230 con 0x7fad9807f4e0 2020-02-12T15:09:34.133 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9eb87700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 0x7fad98150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.134 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2160725474 0 0) 0x7fad84003230 con 0x7fad9807f4e0 2020-02-12T15:09:34.134 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 msgr2=0x7fad98150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:34.134 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 0x7fad98150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:34.134 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 >> v1:172.21.15.105:6789/0 conn(0x7fad980a6ef0 legacy=0x7fad98148090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.134 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980a66d0 con 0x7fad9807f4e0 2020-02-12T15:09:34.134 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7fad880016d0 con 0x7fad9807f4e0 2020-02-12T15:09:34.134 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 >> v1:172.21.15.180:6789/0 conn(0x7fad9807f4e0 legacy=0x7fad9814d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.135 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:34.135 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad84004090 0x7fad84004570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:34.135 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 0x7fad84004b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:34.135 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad980a5200 con 0x7fad84004090 2020-02-12T15:09:34.135 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad84004fe0 con 0x7fad84003750 2020-02-12T15:09:34.135 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad840051a0 con 0x7fad9807f940 2020-02-12T15:09:34.135 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9eb87700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 0x7fad84004b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9db85700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad84004090 0x7fad84004570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 -- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 msgr2=0x7fad84004b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9807f940 0x7fad84004b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 -- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad84004090 msgr2=0x7fad84004570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fad84004090 0x7fad84004570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 -- 172.21.15.180:0/2955419441 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad84003230 con 0x7fad84003750 2020-02-12T15:09:34.136 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fad9805a9e0 tx=0x7fad9400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.137 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fad9805a9e0 tx=0x7fad9400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.137 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fad9805a9e0 tx=0x7fad9400fd20).ready entity=mon.1 client_cookie=6cbd28f0baa29ecd server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:34.137 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fad9805a9e0 tx=0x7fad9400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.137 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fad9805a9e0 tx=0x7fad9400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.137 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad94003540 con 0x7fad84003750 2020-02-12T15:09:34.137 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9e386700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 secure :-1 s=THROTTLE_DONE pgs=45 cs=0 l=1 rx=0x7fad9805a9e0 tx=0x7fad9400fd20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.137 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad940036a0 con 0x7fad84003750 2020-02-12T15:09:34.138 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9d384700 1 -- 172.21.15.180:0/2955419441 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad94003aa0 con 0x7fad84003750 2020-02-12T15:09:34.138 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9fde9700 1 -- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 msgr2=0x7fad84003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.138 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9fde9700 1 --2- 172.21.15.180:0/2955419441 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad84003750 0x7fad84003b70 secure :-1 s=READY pgs=45 cs=0 l=1 rx=0x7fad9805a9e0 tx=0x7fad9400fd20).stop 2020-02-12T15:09:34.138 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.124+0000 7fad9eb87700 1 -- 172.21.15.180:0/2955419441 reap_dead start 2020-02-12T15:09:34.138 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.125+0000 7fad9fde9700 1 -- 172.21.15.180:0/2955419441 shutdown_connections 2020-02-12T15:09:34.138 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.125+0000 7fad9fde9700 1 -- 172.21.15.180:0/2955419441 >> 172.21.15.180:0/2955419441 conn(0x7fad9805acf0 msgr2=0x7fad9805b100 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:34.138 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.125+0000 7fad9fde9700 1 -- 172.21.15.180:0/2955419441 shutdown_connections 2020-02-12T15:09:34.139 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.125+0000 7fad9fde9700 1 -- 172.21.15.180:0/2955419441 wait complete. 2020-02-12T15:09:34.139 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.126+0000 7fad9fde9700 1 Processor -- start 2020-02-12T15:09:34.139 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.126+0000 7fad9fde9700 1 -- start start 2020-02-12T15:09:34.139 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fad98123c70 0x7fad98061610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:34.139 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9809eb00 0x7fad9809ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:34.139 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fad981205d0 0x7fad98120a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:34.139 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad9809e990 con 0x7fad98123c70 2020-02-12T15:09:34.140 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad980a75b0 con 0x7fad981205d0 2020-02-12T15:09:34.140 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad980a47e0 con 0x7fad9809eb00 2020-02-12T15:09:34.140 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fad981205d0 0x7fad98120a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.140 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fad981205d0 0x7fad98120a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50630/0 (socket says 172.21.15.180:50630) 2020-02-12T15:09:34.140 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 -- 172.21.15.180:0/3444972147 learned_addr learned my addr 172.21.15.180:0/3444972147 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:34.140 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 -- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9809eb00 msgr2=0x7fad9809ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.141 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9db85700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9809eb00 0x7fad9809ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.141 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9e386700 1 --2- 172.21.15.180:0/3444972147 >> v2:172.21.15.105:3300/0 conn(0x7fad98123c70 0x7fad98061610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.141 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9809eb00 0x7fad9809ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.141 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 -- 172.21.15.180:0/3444972147 >> v2:172.21.15.105:3300/0 conn(0x7fad98123c70 msgr2=0x7fad98061610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.141 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> v2:172.21.15.105:3300/0 conn(0x7fad98123c70 0x7fad98061610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.141 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 -- 172.21.15.180:0/3444972147 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad980a0480 con 0x7fad981205d0 2020-02-12T15:09:34.142 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> v2:172.21.15.180:3300/0 conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.142 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> v2:172.21.15.180:3300/0 conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.142 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:34.142 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.142 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.142 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad8effd700 1 -- 172.21.15.180:0/3444972147 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad90005e20 con 0x7fad981205d0 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad8effd700 1 -- 172.21.15.180:0/3444972147 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad90012890 con 0x7fad981205d0 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad8effd700 1 -- 172.21.15.180:0/3444972147 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fad90012c30 con 0x7fad981205d0 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad98066460 con 0x7fad981205d0 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.127+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad9809fd40 con 0x7fad981205d0 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.128+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.128+0000 7fad8effd700 1 -- 172.21.15.180:0/3444972147 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fad90008700 con 0x7fad981205d0 2020-02-12T15:09:34.143 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.128+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.144 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.129+0000 7fad8effd700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fad80039ca0 0x7fad8003c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:34.144 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.129+0000 7fad8effd700 1 -- 172.21.15.180:0/3444972147 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7fad90049c50 con 0x7fad981205d0 2020-02-12T15:09:34.144 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.129+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad980a01a0 con 0x7fad981205d0 2020-02-12T15:09:34.144 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.129+0000 7fad9e386700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fad80039ca0 0x7fad8003c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.145 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.129+0000 7fad9e386700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fad80039ca0 0x7fad8003c160 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:34.145 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.133+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.145 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.133+0000 7fad8effd700 1 -- 172.21.15.180:0/3444972147 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fad9002f320 con 0x7fad981205d0 2020-02-12T15:09:34.272 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.269+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fad980565b0 con 0x7fad981205d0 2020-02-12T15:09:34.273 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.270+0000 7fad9eb87700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=THROTTLE_DONE pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.273 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.270+0000 7fad8effd700 1 -- 172.21.15.180:0/3444972147 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10487 (secure 0 0 0) 0x7fad90031df0 con 0x7fad981205d0 2020-02-12T15:09:34.274 INFO:teuthology.misc.health.smithi180.stdout: 2020-02-12T15:09:34.274 INFO:teuthology.misc.health.smithi180.stdout:{"epoch":14,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:31.515730+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:34.275 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fad80039ca0 msgr2=0x7fad8003c160 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.275 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fad80039ca0 0x7fad8003c160 crc :-1 s=READY pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.275 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 msgr2=0x7fad98120a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.275 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 secure :-1 s=READY pgs=46 cs=0 l=1 rx=0x7fad880010d0 tx=0x7fad90010e40).stop 2020-02-12T15:09:34.276 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 shutdown_connections 2020-02-12T15:09:34.276 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fad80039ca0 0x7fad8003c160 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.276 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fad981205d0 0x7fad98120a20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.276 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 --2- 172.21.15.180:0/3444972147 >> v2:172.21.15.105:3300/0 conn(0x7fad98123c70 0x7fad98061610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.276 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 --2- 172.21.15.180:0/3444972147 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fad9809eb00 0x7fad9809ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.276 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 >> 172.21.15.180:0/3444972147 conn(0x7fad9805acf0 msgr2=0x7fad9805b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:34.276 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 shutdown_connections 2020-02-12T15:09:34.277 INFO:teuthology.misc.health.smithi180.stderr:2020-02-12T15:09:34.271+0000 7fad9fde9700 1 -- 172.21.15.180:0/3444972147 wait complete. 2020-02-12T15:09:34.284 DEBUG:teuthology.misc:8 of 8 OSDs are up 2020-02-12T15:09:34.284 INFO:tasks.ceph:Creating RBD pool 2020-02-12T15:09:34.285 INFO:teuthology.orchestra.run.smithi180:> sudo ceph --cluster ceph osd pool create rbd 8 2020-02-12T15:09:34.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc89dea8700 1 Processor -- start 2020-02-12T15:09:34.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc89dea8700 1 -- start start 2020-02-12T15:09:34.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc89dea8700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fc8980a7050 0x7fc89814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:34.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc89dea8700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8980a2b50 con 0x7fc8980a1890 2020-02-12T15:09:34.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc89dea8700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc89807fde0 con 0x7fc8980a14b0 2020-02-12T15:09:34.406 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc89dea8700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc89807fb40 con 0x7fc8980a7050 2020-02-12T15:09:34.406 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc89cc46700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fc8980a7050 0x7fc89814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.406 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc897fff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fc8980a14b0 0x7fc8980a4cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42148/0 (socket says 172.21.15.180:42148) 2020-02-12T15:09:34.406 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.399+0000 7fc897fff700 1 -- 172.21.15.180:0/1150117811 learned_addr learned my addr 172.21.15.180:0/1150117811 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:34.406 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 -- 172.21.15.180:0/1150117811 >> v1:172.21.15.180:6789/0 conn(0x7fc8980a14b0 legacy=0x7fc8980a4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.406 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 -- 172.21.15.180:0/1150117811 >> v1:172.21.15.105:6789/0 conn(0x7fc8980a1890 legacy=0x7fc89814c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:34.406 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 -- 172.21.15.180:0/1150117811 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980a3f20 con 0x7fc8980a7050 2020-02-12T15:09:34.407 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 --2- 172.21.15.180:0/1150117811 >> v2:172.21.15.180:3300/0 conn(0x7fc8980a7050 0x7fc89814ffe0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fc8980a2e20 tx=0x7fc890008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.407 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 --2- 172.21.15.180:0/1150117811 >> v2:172.21.15.180:3300/0 conn(0x7fc8980a7050 0x7fc89814ffe0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fc8980a2e20 tx=0x7fc890008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.407 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 --2- 172.21.15.180:0/1150117811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a7050 0x7fc89814ffe0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fc8980a2e20 tx=0x7fc890008c60).ready entity=mon.1 client_cookie=523eef307a98507b server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:34.407 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 --2- 172.21.15.180:0/1150117811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a7050 0x7fc89814ffe0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fc8980a2e20 tx=0x7fc890008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.407 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc8977fe700 1 -- 172.21.15.180:0/1150117811 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc89000a160 con 0x7fc8980a7050 2020-02-12T15:09:34.407 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 --2- 172.21.15.180:0/1150117811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a7050 0x7fc89814ffe0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fc8980a2e20 tx=0x7fc890008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.407 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc8977fe700 1 -- 172.21.15.180:0/1150117811 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc89000a2c0 con 0x7fc8980a7050 2020-02-12T15:09:34.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89cc46700 1 --2- 172.21.15.180:0/1150117811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a7050 0x7fc89814ffe0 secure :-1 s=THROTTLE_DONE pgs=48 cs=0 l=1 rx=0x7fc8980a2e20 tx=0x7fc890008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc8977fe700 1 -- 172.21.15.180:0/1150117811 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc89000a6a0 con 0x7fc8980a7050 2020-02-12T15:09:34.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89dea8700 1 -- 172.21.15.180:0/1150117811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a7050 msgr2=0x7fc89814ffe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89dea8700 1 --2- 172.21.15.180:0/1150117811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a7050 0x7fc89814ffe0 secure :-1 s=READY pgs=48 cs=0 l=1 rx=0x7fc8980a2e20 tx=0x7fc890008c60).stop 2020-02-12T15:09:34.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89dea8700 1 -- 172.21.15.180:0/1150117811 shutdown_connections 2020-02-12T15:09:34.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89dea8700 1 --2- 172.21.15.180:0/1150117811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a7050 0x7fc89814ffe0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89dea8700 1 -- 172.21.15.180:0/1150117811 >> 172.21.15.180:0/1150117811 conn(0x7fc89805a530 msgr2=0x7fc89805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:34.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89dea8700 1 -- 172.21.15.180:0/1150117811 shutdown_connections 2020-02-12T15:09:34.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.400+0000 7fc89dea8700 1 -- 172.21.15.180:0/1150117811 wait complete. 2020-02-12T15:09:34.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.401+0000 7fc89dea8700 1 Processor -- start 2020-02-12T15:09:34.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc89dea8700 1 -- start start 2020-02-12T15:09:34.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc89dea8700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fc8980a14b0 0x7fc898120ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:34.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc89dea8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8980a1890 0x7fc898062260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:34.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc89dea8700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc898062990 con 0x7fc8980a7050 2020-02-12T15:09:34.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc89dea8700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc898062c30 con 0x7fc8980a14b0 2020-02-12T15:09:34.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc89dea8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc898062ed0 con 0x7fc8980a1890 2020-02-12T15:09:34.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fc8980a14b0 0x7fc898120ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fc8980a14b0 0x7fc898120ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50640/0 (socket says 172.21.15.180:50640) 2020-02-12T15:09:34.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 -- 172.21.15.180:0/687263801 learned_addr learned my addr 172.21.15.180:0/687263801 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:34.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 -- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8980a1890 msgr2=0x7fc898062260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8980a1890 0x7fc898062260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:34.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 -- 172.21.15.180:0/687263801 >> v1:172.21.15.105:6789/0 conn(0x7fc8980a7050 legacy=0x7fc898134740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:34.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 -- 172.21.15.180:0/687263801 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980626c0 con 0x7fc8980a14b0 2020-02-12T15:09:34.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> v2:172.21.15.180:3300/0 conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.402+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> v2:172.21.15.180:3300/0 conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:34.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc8957fa700 1 -- 172.21.15.180:0/687263801 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc888005ca0 con 0x7fc8980a14b0 2020-02-12T15:09:34.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc8957fa700 1 -- 172.21.15.180:0/687263801 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888005e00 con 0x7fc8980a14b0 2020-02-12T15:09:34.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8980a83e0 con 0x7fc8980a14b0 2020-02-12T15:09:34.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc8957fa700 1 -- 172.21.15.180:0/687263801 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc8880062b0 con 0x7fc8980a14b0 2020-02-12T15:09:34.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc898135090 con 0x7fc8980a14b0 2020-02-12T15:09:34.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc8957fa700 1 -- 172.21.15.180:0/687263801 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fc8880064e0 con 0x7fc8980a14b0 2020-02-12T15:09:34.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.403+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.404+0000 7fc8957fa700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fc87c039bf0 0x7fc87c03c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:34.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.404+0000 7fc8957fa700 1 -- 172.21.15.180:0/687263801 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4500+0+0 (secure 0 0 0) 0x7fc888049a60 con 0x7fc8980a14b0 2020-02-12T15:09:34.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.404+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc898134460 con 0x7fc8980a14b0 2020-02-12T15:09:34.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.404+0000 7fc88ffff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fc87c039bf0 0x7fc87c03c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:34.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.404+0000 7fc88ffff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fc87c039bf0 0x7fc87c03c0b0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:34.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.407+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:34.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.407+0000 7fc8957fa700 1 -- 172.21.15.180:0/687263801 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fc88802f090 con 0x7fc8980a14b0 2020-02-12T15:09:34.546 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:34.542+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7fc8980565b0 con 0x7fc8980a14b0 2020-02-12T15:09:35.333 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.329+0000 7fc897fff700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=THROTTLE_DONE pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.333 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.329+0000 7fc8957fa700 1 -- 172.21.15.180:0/687263801 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v15) v1 ==== 109+0+0 (secure 0 0 0) 0x7fc888031ba0 con 0x7fc8980a14b0 2020-02-12T15:09:35.335 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fc87c039bf0 msgr2=0x7fc87c03c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:35.335 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fc87c039bf0 0x7fc87c03c0b0 crc :-1 s=READY pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:35.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 msgr2=0x7fc898120ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:35.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 secure :-1 s=READY pgs=49 cs=0 l=1 rx=0x7fc8980a4d60 tx=0x7fc888010a60).stop 2020-02-12T15:09:35.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 shutdown_connections 2020-02-12T15:09:35.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fc87c039bf0 0x7fc87c03c0b0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:35.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fc8980a14b0 0x7fc898120ef0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:35.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 --2- 172.21.15.180:0/687263801 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fc8980a1890 0x7fc898062260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:35.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 >> 172.21.15.180:0/687263801 conn(0x7fc89805a530 msgr2=0x7fc89809ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:35.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 shutdown_connections 2020-02-12T15:09:35.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.332+0000 7fc89dea8700 1 -- 172.21.15.180:0/687263801 wait complete. 2020-02-12T15:09:35.337 INFO:teuthology.orchestra.run.smithi180.stderr:pool 'rbd' created 2020-02-12T15:09:35.347 INFO:teuthology.orchestra.run.smithi180:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2020-02-12T15:09:35.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 Processor -- start 2020-02-12T15:09:35.512 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 -- start start 2020-02-12T15:09:35.512 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff400a1590 0x7eff400a7770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:35.512 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff400a3920 0x7eff400a59d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:35.512 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7eff400a5e30 0x7eff4007f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:35.512 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400a2ff0 con 0x7eff400a1590 2020-02-12T15:09:35.513 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400a3250 con 0x7eff400a5e30 2020-02-12T15:09:35.513 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff400a34f0 con 0x7eff400a3920 2020-02-12T15:09:35.513 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7eff400a5e30 0x7eff4007f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:35.513 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7eff400a5e30 0x7eff4007f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50648/0 (socket says 172.21.15.180:50648) 2020-02-12T15:09:35.513 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 -- 172.21.15.180:0/1362752029 learned_addr learned my addr 172.21.15.180:0/1362752029 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:35.513 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46561700 1 --2- 172.21.15.180:0/1362752029 >> v2:172.21.15.105:3300/0 conn(0x7eff400a1590 0x7eff400a7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:35.513 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 -- 172.21.15.180:0/1362752029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff400a3920 msgr2=0x7eff400a59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:35.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff45d60700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff400a3920 0x7eff400a59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:35.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff400a3920 0x7eff400a59d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:35.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 -- 172.21.15.180:0/1362752029 >> v2:172.21.15.105:3300/0 conn(0x7eff400a1590 msgr2=0x7eff400a7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:35.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> v2:172.21.15.105:3300/0 conn(0x7eff400a1590 0x7eff400a7770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:35.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 -- 172.21.15.180:0/1362752029 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff400a62c0 con 0x7eff400a5e30 2020-02-12T15:09:35.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46561700 1 --2- 172.21.15.180:0/1362752029 >> v2:172.21.15.105:3300/0 conn(0x7eff400a1590 0x7eff400a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:35.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff45d60700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff400a3920 0x7eff400a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:35.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> v2:172.21.15.180:3300/0 conn(0x7eff400a5e30 0x7eff4007f060 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7eff380032b0 tx=0x7eff38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> v2:172.21.15.180:3300/0 conn(0x7eff400a5e30 0x7eff4007f060 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7eff380032b0 tx=0x7eff38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a5e30 0x7eff4007f060 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7eff380032b0 tx=0x7eff38007dc0).ready entity=mon.1 client_cookie=502d92e47f58bc64 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:35.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a5e30 0x7eff4007f060 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7eff380032b0 tx=0x7eff38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff4555f700 1 -- 172.21.15.180:0/1362752029 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3800a160 con 0x7eff400a5e30 2020-02-12T15:09:35.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a5e30 0x7eff4007f060 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7eff380032b0 tx=0x7eff38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff46d62700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a5e30 0x7eff4007f060 secure :-1 s=THROTTLE_DONE pgs=50 cs=0 l=1 rx=0x7eff380032b0 tx=0x7eff38007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff4555f700 1 -- 172.21.15.180:0/1362752029 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3800a2c0 con 0x7eff400a5e30 2020-02-12T15:09:35.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff4555f700 1 -- 172.21.15.180:0/1362752029 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3800a660 con 0x7eff400a5e30 2020-02-12T15:09:35.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 -- 172.21.15.180:0/1362752029 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a5e30 msgr2=0x7eff4007f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:35.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.458+0000 7eff47fc4700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a5e30 0x7eff4007f060 secure :-1 s=READY pgs=50 cs=0 l=1 rx=0x7eff380032b0 tx=0x7eff38007dc0).stop 2020-02-12T15:09:35.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.459+0000 7eff47fc4700 1 -- 172.21.15.180:0/1362752029 shutdown_connections 2020-02-12T15:09:35.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.459+0000 7eff47fc4700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a5e30 0x7eff4007f060 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:35.517 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.459+0000 7eff47fc4700 1 --2- 172.21.15.180:0/1362752029 >> v2:172.21.15.105:3300/0 conn(0x7eff400a1590 0x7eff400a7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:35.517 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.459+0000 7eff47fc4700 1 --2- 172.21.15.180:0/1362752029 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7eff400a3920 0x7eff400a59d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:35.517 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.459+0000 7eff47fc4700 1 -- 172.21.15.180:0/1362752029 >> 172.21.15.180:0/1362752029 conn(0x7eff4005a530 msgr2=0x7eff4005a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:35.517 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.459+0000 7eff47fc4700 1 -- 172.21.15.180:0/1362752029 shutdown_connections 2020-02-12T15:09:35.517 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.459+0000 7eff47fc4700 1 -- 172.21.15.180:0/1362752029 wait complete. 2020-02-12T15:09:35.518 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.460+0000 7eff47fc4700 1 Processor -- start 2020-02-12T15:09:35.520 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.460+0000 7eff47fc4700 1 -- start start 2020-02-12T15:09:35.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.460+0000 7eff47fc4700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7eff400a1590 0x7eff4008e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:35.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.460+0000 7eff47fc4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7eff400a5e30 0x7eff40064210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:35.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.460+0000 7eff47fc4700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff401320f0 con 0x7eff400a3920 2020-02-12T15:09:35.528 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.460+0000 7eff47fc4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff40065340 con 0x7eff400a5e30 2020-02-12T15:09:35.528 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.460+0000 7eff47fc4700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff400a8c00 con 0x7eff400a1590 2020-02-12T15:09:35.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7eff400a1590 0x7eff4008e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:35.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7eff400a1590 0x7eff4008e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50652/0 (socket says 172.21.15.180:50652) 2020-02-12T15:09:35.536 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 -- 172.21.15.180:0/2553089512 learned_addr learned my addr 172.21.15.180:0/2553089512 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:35.537 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff45d60700 1 --1- 172.21.15.180:0/2553089512 >> v1:172.21.15.180:6789/0 conn(0x7eff400a3920 0x7eff40132590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42168/0 (socket says 172.21.15.180:42168) 2020-02-12T15:09:35.537 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46d62700 1 --2- 172.21.15.180:0/2553089512 >> v2:172.21.15.105:3300/0 conn(0x7eff400a5e30 0x7eff40064210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:35.537 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 -- 172.21.15.180:0/2553089512 >> v2:172.21.15.105:3300/0 conn(0x7eff400a5e30 msgr2=0x7eff40064210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:35.537 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> v2:172.21.15.105:3300/0 conn(0x7eff400a5e30 0x7eff40064210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:35.538 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 -- 172.21.15.180:0/2553089512 >> v1:172.21.15.180:6789/0 conn(0x7eff400a3920 legacy=0x7eff40132590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:35.538 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4109558256 0 0) 0x7eff401320f0 con 0x7eff400a3920 2020-02-12T15:09:35.538 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 -- 172.21.15.180:0/2553089512 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff40132ca0 con 0x7eff400a1590 2020-02-12T15:09:35.538 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46d62700 1 --2- 172.21.15.180:0/2553089512 >> v2:172.21.15.105:3300/0 conn(0x7eff400a5e30 0x7eff40064210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:35.538 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> v2:172.21.15.180:3300/0 conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.539 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> v2:172.21.15.180:3300/0 conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.539 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:35.539 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.539 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3c007160 con 0x7eff400a1590 2020-02-12T15:09:35.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff3c0072c0 con 0x7eff400a1590 2020-02-12T15:09:35.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7eff3c0059c0 con 0x7eff400a1590 2020-02-12T15:09:35.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff40066a60 con 0x7eff400a1590 2020-02-12T15:09:35.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.461+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff400a8540 con 0x7eff400a1590 2020-02-12T15:09:35.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.462+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.462+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7eff3c005c30 con 0x7eff400a1590 2020-02-12T15:09:35.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.462+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.462+0000 7eff36ffd700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7eff28039ad0 0x7eff2803bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:35.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.462+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4842+0+0 (secure 0 0 0) 0x7eff3c049960 con 0x7eff400a1590 2020-02-12T15:09:35.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.462+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff40132ef0 con 0x7eff400a1590 2020-02-12T15:09:35.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.462+0000 7eff45d60700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7eff28039ad0 0x7eff2803bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:35.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.463+0000 7eff45d60700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7eff28039ad0 0x7eff2803bf90 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:35.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.466+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:35.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.466+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7eff3c0330c0 con 0x7eff400a1590 2020-02-12T15:09:35.606 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:35.603+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff40065480 con 0x7eff400a1590 2020-02-12T15:09:36.334 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.331+0000 7eff46561700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=THROTTLE_DONE pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.334 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.332+0000 7eff36ffd700 1 -- 172.21.15.180:0/2553089512 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v16) v1 ==== 173+0+0 (secure 0 0 0) 0x7eff40065480 con 0x7eff400a1590 2020-02-12T15:09:36.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.334+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7eff28039ad0 msgr2=0x7eff2803bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.334+0000 7eff47fc4700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7eff28039ad0 0x7eff2803bf90 crc :-1 s=READY pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.334+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 msgr2=0x7eff4008e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.334+0000 7eff47fc4700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 secure :-1 s=READY pgs=52 cs=0 l=1 rx=0x7eff3c002f30 tx=0x7eff40042fb0).stop 2020-02-12T15:09:36.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.335+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 shutdown_connections 2020-02-12T15:09:36.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.335+0000 7eff47fc4700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7eff28039ad0 0x7eff2803bf90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.335+0000 7eff47fc4700 1 --2- 172.21.15.180:0/2553089512 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7eff400a1590 0x7eff4008e9e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.335+0000 7eff47fc4700 1 --2- 172.21.15.180:0/2553089512 >> v2:172.21.15.105:3300/0 conn(0x7eff400a5e30 0x7eff40064210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.335+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 >> 172.21.15.180:0/2553089512 conn(0x7eff4005a530 msgr2=0x7eff4007f270 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:36.339 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.335+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 shutdown_connections 2020-02-12T15:09:36.339 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.335+0000 7eff47fc4700 1 -- 172.21.15.180:0/2553089512 wait complete. 2020-02-12T15:09:36.339 INFO:teuthology.orchestra.run.smithi180.stderr:enabled application 'rbd' on pool 'rbd' 2020-02-12T15:09:36.349 INFO:tasks.ceph:Setting up CephFS filesystem... 2020-02-12T15:09:36.350 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:36.457 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.455+0000 7f1c86b4d700 1 Processor -- start 2020-02-12T15:09:36.458 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.455+0000 7f1c86b4d700 1 -- start start 2020-02-12T15:09:36.460 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c86b4d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f1c8009e9b0 0x7f1c80139780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:36.460 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c86b4d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800a78f0 con 0x7f1c800aac00 2020-02-12T15:09:36.460 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c86b4d700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c801392e0 con 0x7f1c80139be0 2020-02-12T15:09:36.460 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c86b4d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8013a060 con 0x7f1c8009e9b0 2020-02-12T15:09:36.461 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f1c8009e9b0 0x7f1c80139780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.461 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c850ea700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f1c80139be0 0x7f1c8012f670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42178/0 (socket says 172.21.15.180:42178) 2020-02-12T15:09:36.461 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c850ea700 1 -- 172.21.15.180:0/3417564036 learned_addr learned my addr 172.21.15.180:0/3417564036 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:36.461 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 -- 172.21.15.180:0/3417564036 >> v1:172.21.15.180:6789/0 conn(0x7f1c80139be0 legacy=0x7f1c8012f670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.461 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 -- 172.21.15.180:0/3417564036 >> v1:172.21.15.105:6789/0 conn(0x7f1c800aac00 legacy=0x7f1c800a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.461 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7f7fe700 1 -- 172.21.15.180:0/3417564036 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3125501823 0 0) 0x7f1c801392e0 con 0x7f1c80139be0 2020-02-12T15:09:36.461 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 -- 172.21.15.180:0/3417564036 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800a7b90 con 0x7f1c8009e9b0 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3417564036 >> v2:172.21.15.180:3300/0 conn(0x7f1c8009e9b0 0x7f1c80139780 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1c74002f30 tx=0x7f1c740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3417564036 >> v2:172.21.15.180:3300/0 conn(0x7f1c8009e9b0 0x7f1c80139780 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1c74002f30 tx=0x7f1c740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3417564036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c8009e9b0 0x7f1c80139780 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f1c74002f30 tx=0x7f1c740088e0).ready entity=mon.1 client_cookie=f2807a3857b208b7 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3417564036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c8009e9b0 0x7f1c80139780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f1c74002f30 tx=0x7f1c740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.456+0000 7f1c7f7fe700 1 -- 172.21.15.180:0/3417564036 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c74008e40 con 0x7f1c8009e9b0 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3417564036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c8009e9b0 0x7f1c80139780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f1c74002f30 tx=0x7f1c740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3417564036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c8009e9b0 0x7f1c80139780 secure :-1 s=THROTTLE_DONE pgs=54 cs=0 l=1 rx=0x7f1c74002f30 tx=0x7f1c740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.462 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c7f7fe700 1 -- 172.21.15.180:0/3417564036 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c740116a0 con 0x7f1c8009e9b0 2020-02-12T15:09:36.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c7f7fe700 1 -- 172.21.15.180:0/3417564036 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c74011ac0 con 0x7f1c8009e9b0 2020-02-12T15:09:36.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3417564036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c8009e9b0 msgr2=0x7f1c80139780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c86b4d700 1 --2- 172.21.15.180:0/3417564036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c8009e9b0 0x7f1c80139780 secure :-1 s=READY pgs=54 cs=0 l=1 rx=0x7f1c74002f30 tx=0x7f1c740088e0).stop 2020-02-12T15:09:36.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3417564036 shutdown_connections 2020-02-12T15:09:36.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c86b4d700 1 --2- 172.21.15.180:0/3417564036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c8009e9b0 0x7f1c80139780 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3417564036 >> 172.21.15.180:0/3417564036 conn(0x7f1c8009d450 msgr2=0x7f1c8009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:36.463 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3417564036 shutdown_connections 2020-02-12T15:09:36.464 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.457+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3417564036 wait complete. 2020-02-12T15:09:36.464 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.458+0000 7f1c86b4d700 1 Processor -- start 2020-02-12T15:09:36.464 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.458+0000 7f1c86b4d700 1 -- start start 2020-02-12T15:09:36.467 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c86b4d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f1c8009e9b0 0x7f1c8012d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:36.467 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c86b4d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f1c800aac00 0x7f1c800660b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:36.467 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c86b4d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8012e8e0 con 0x7f1c80139be0 2020-02-12T15:09:36.468 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c86b4d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8012eb10 con 0x7f1c8009e9b0 2020-02-12T15:09:36.468 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c86b4d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c80067060 con 0x7f1c800aac00 2020-02-12T15:09:36.468 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f1c800aac00 0x7f1c800660b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.468 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f1c800aac00 0x7f1c800660b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50670/0 (socket says 172.21.15.180:50670) 2020-02-12T15:09:36.468 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 -- 172.21.15.180:0/3122984508 learned_addr learned my addr 172.21.15.180:0/3122984508 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:36.468 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 -- 172.21.15.180:0/3122984508 >> v2:172.21.15.105:3300/0 conn(0x7f1c8009e9b0 msgr2=0x7f1c8012d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.468 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c848e9700 1 --2- 172.21.15.180:0/3122984508 >> v2:172.21.15.105:3300/0 conn(0x7f1c8009e9b0 0x7f1c8012d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.469 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> v2:172.21.15.105:3300/0 conn(0x7f1c8009e9b0 0x7f1c8012d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.469 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 -- 172.21.15.180:0/3122984508 >> v1:172.21.15.105:6789/0 conn(0x7f1c80139be0 legacy=0x7f1c8012b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.469 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 -- 172.21.15.180:0/3122984508 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c80136e60 con 0x7f1c800aac00 2020-02-12T15:09:36.469 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c848e9700 1 --2- 172.21.15.180:0/3122984508 >> v2:172.21.15.105:3300/0 conn(0x7f1c8009e9b0 0x7f1c8012d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:36.469 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> v2:172.21.15.180:3300/0 conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.469 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> v2:172.21.15.180:3300/0 conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.470 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:36.470 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.470 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.470 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.470 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7dffb700 1 -- 172.21.15.180:0/3122984508 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c740070b0 con 0x7f1c800aac00 2020-02-12T15:09:36.470 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7dffb700 1 -- 172.21.15.180:0/3122984508 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c74007210 con 0x7f1c800aac00 2020-02-12T15:09:36.470 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c80067300 con 0x7f1c800aac00 2020-02-12T15:09:36.471 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c7dffb700 1 -- 172.21.15.180:0/3122984508 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1c74007570 con 0x7f1c800aac00 2020-02-12T15:09:36.471 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.459+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c80065560 con 0x7f1c800aac00 2020-02-12T15:09:36.471 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.460+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.471 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.460+0000 7f1c7dffb700 1 -- 172.21.15.180:0/3122984508 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f1c740056c0 con 0x7f1c800aac00 2020-02-12T15:09:36.471 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.460+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.471 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.460+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c800565b0 con 0x7f1c800aac00 2020-02-12T15:09:36.472 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.460+0000 7f1c7dffb700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f1c60039bf0 0x7f1c6003c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:36.472 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.460+0000 7f1c7dffb700 1 -- 172.21.15.180:0/3122984508 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1c7404a220 con 0x7f1c800aac00 2020-02-12T15:09:36.472 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.461+0000 7f1c848e9700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f1c60039bf0 0x7f1c6003c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.472 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.461+0000 7f1c848e9700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f1c60039bf0 0x7f1c6003c0b0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:36.472 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.464+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.472 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.464+0000 7f1c7dffb700 1 -- 172.21.15.180:0/3122984508 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f1c7402f910 con 0x7f1c800aac00 2020-02-12T15:09:36.603 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.601+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c8005e410 con 0x7f1c800aac00 2020-02-12T15:09:36.604 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.601+0000 7f1c7ffff700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=THROTTLE_DONE pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.604 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.601+0000 7f1c7dffb700 1 -- 172.21.15.180:0/3122984508 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+11874 (secure 0 0 0) 0x7f1c74032420 con 0x7f1c800aac00 2020-02-12T15:09:36.604 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:36.604 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":16,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:36.328582+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:36.606 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f1c60039bf0 msgr2=0x7f1c6003c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.606 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f1c60039bf0 0x7f1c6003c0b0 crc :-1 s=READY pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.606 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 msgr2=0x7f1c800660b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.606 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 secure :-1 s=READY pgs=55 cs=0 l=1 rx=0x7f1c800a3290 tx=0x7f1c800a7d20).stop 2020-02-12T15:09:36.606 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 shutdown_connections 2020-02-12T15:09:36.606 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f1c60039bf0 0x7f1c6003c0b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.607 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 --2- 172.21.15.180:0/3122984508 >> v2:172.21.15.105:3300/0 conn(0x7f1c8009e9b0 0x7f1c8012d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.607 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 --2- 172.21.15.180:0/3122984508 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1c800aac00 0x7f1c800660b0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.607 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 >> 172.21.15.180:0/3122984508 conn(0x7f1c8009d450 msgr2=0x7f1c800698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:36.607 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 shutdown_connections 2020-02-12T15:09:36.607 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.603+0000 7f1c86b4d700 1 -- 172.21.15.180:0/3122984508 wait complete. 2020-02-12T15:09:36.616 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:34.556683+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'16', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T15:09:36.616 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T15:09:36.724 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.722+0000 7f17c7dd0700 1 Processor -- start 2020-02-12T15:09:36.724 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.722+0000 7f17c7dd0700 1 -- start start 2020-02-12T15:09:36.731 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.722+0000 7f17c7dd0700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f17c00a5f50 0x7f17c0132150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:36.731 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.722+0000 7f17c7dd0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c00a22f0 con 0x7f17c00a2e40 2020-02-12T15:09:36.731 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.722+0000 7f17c7dd0700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c00a2590 con 0x7f17c00a15e0 2020-02-12T15:09:36.731 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.722+0000 7f17c7dd0700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c00a2830 con 0x7f17c00a5f50 2020-02-12T15:09:36.731 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c536b700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f17c00a15e0 0x7f17c0131a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42188/0 (socket says 172.21.15.180:42188) 2020-02-12T15:09:36.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c536b700 1 -- 172.21.15.180:0/511892009 learned_addr learned my addr 172.21.15.180:0/511892009 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:36.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1898187081 0 0) 0x7f17c00a2590 con 0x7f17c00a15e0 2020-02-12T15:09:36.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c636d700 1 --2- 172.21.15.180:0/511892009 >> v2:172.21.15.105:3300/0 conn(0x7f17c00a5f50 0x7f17c0132150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a8003230 con 0x7f17c00a15e0 2020-02-12T15:09:36.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1430817588 0 0) 0x7f17a8003230 con 0x7f17c00a15e0 2020-02-12T15:09:36.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 >> v2:172.21.15.105:3300/0 conn(0x7f17c00a5f50 msgr2=0x7f17c0132150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:36.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 --2- 172.21.15.180:0/511892009 >> v2:172.21.15.105:3300/0 conn(0x7f17c00a5f50 0x7f17c0132150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:36.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 >> v1:172.21.15.105:6789/0 conn(0x7f17c00a2e40 legacy=0x7f17c00a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c00a63b0 con 0x7f17c00a15e0 2020-02-12T15:09:36.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f17bc0016d0 con 0x7f17c00a15e0 2020-02-12T15:09:36.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 >> v1:172.21.15.180:6789/0 conn(0x7f17c00a15e0 legacy=0x7f17c0131a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:36.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17a80044d0 0x7f17a8004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:36.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17a8004db0 0x7f17a800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:36.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00a2830 con 0x7f17a8004db0 2020-02-12T15:09:36.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a80041c0 con 0x7f17a8003720 2020-02-12T15:09:36.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a800bb80 con 0x7f17a80044d0 2020-02-12T15:09:36.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c636d700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17a8004db0 0x7f17a800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.723+0000 7f17c536b700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17a80044d0 0x7f17a8004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 -- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17a80044d0 msgr2=0x7f17a8004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17a80044d0 0x7f17a8004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 -- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17a8004db0 msgr2=0x7f17a800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f17a8004db0 0x7f17a800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 -- 172.21.15.180:0/511892009 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a8003230 con 0x7f17a8003720 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c636d700 1 -- 172.21.15.180:0/511892009 reap_dead start 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c536b700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17a80044d0 0x7f17a8004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f17a80054a0 tx=0x7f17b000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f17a80054a0 tx=0x7f17b000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f17a80054a0 tx=0x7f17b000fd50).ready entity=mon.1 client_cookie=ec0c8fdca9432f80 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:36.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f17a80054a0 tx=0x7f17b000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b0003540 con 0x7f17a8003720 2020-02-12T15:09:36.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f17a80054a0 tx=0x7f17b000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 secure :-1 s=THROTTLE_DONE pgs=57 cs=0 l=1 rx=0x7f17a80054a0 tx=0x7f17b000fd50).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b00036a0 con 0x7f17a8003720 2020-02-12T15:09:36.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c4b6a700 1 -- 172.21.15.180:0/511892009 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b0003a40 con 0x7f17a8003720 2020-02-12T15:09:36.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c7dd0700 1 -- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 msgr2=0x7f17a8003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c7dd0700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 secure :-1 s=READY pgs=57 cs=0 l=1 rx=0x7f17a80054a0 tx=0x7f17b000fd50).stop 2020-02-12T15:09:36.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c7dd0700 1 -- 172.21.15.180:0/511892009 shutdown_connections 2020-02-12T15:09:36.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c7dd0700 1 --2- 172.21.15.180:0/511892009 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17a8003720 0x7f17a8003b40 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c7dd0700 1 -- 172.21.15.180:0/511892009 >> 172.21.15.180:0/511892009 conn(0x7f17c005a530 msgr2=0x7f17c005a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:36.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c7dd0700 1 -- 172.21.15.180:0/511892009 shutdown_connections 2020-02-12T15:09:36.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.724+0000 7f17c7dd0700 1 -- 172.21.15.180:0/511892009 wait complete. 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.725+0000 7f17c7dd0700 1 Processor -- start 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.725+0000 7f17c7dd0700 1 -- start start 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c7dd0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17c00a4dd0 0x7f17c01434d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c7dd0700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f17c0143930 0x7f17c014de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c7dd0700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17c005ecf0 con 0x7f17a8003720 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c7dd0700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17c008fdb0 con 0x7f17c0143930 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c7dd0700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c00a49a0 con 0x7f17c00a4dd0 2020-02-12T15:09:36.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f17c0143930 0x7f17c014de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.739 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f17c0143930 0x7f17c014de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50688/0 (socket says 172.21.15.180:50688) 2020-02-12T15:09:36.739 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c5b6c700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f17a8003720 0x7f17c00666c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.180:36776/0 (socket says 172.21.15.180:36776) 2020-02-12T15:09:36.739 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 -- 172.21.15.180:0/1063191811 learned_addr learned my addr 172.21.15.180:0/1063191811 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:36.739 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c536b700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17c00a4dd0 0x7f17c01434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.739 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510829941 0 0) 0x7f17c005ecf0 con 0x7f17a8003720 2020-02-12T15:09:36.739 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a0002fe0 con 0x7f17a8003720 2020-02-12T15:09:36.739 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 -- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17c00a4dd0 msgr2=0x7f17c01434d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17c00a4dd0 0x7f17c01434d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 -- 172.21.15.180:0/1063191811 >> v1:172.21.15.105:6789/0 conn(0x7f17a8003720 legacy=0x7f17c00666c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 -- 172.21.15.180:0/1063191811 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0066dd0 con 0x7f17c0143930 2020-02-12T15:09:36.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> v2:172.21.15.180:3300/0 conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> v2:172.21.15.180:3300/0 conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:36.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b8005e20 con 0x7f17c0143930 2020-02-12T15:09:36.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.726+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b8008700 con 0x7f17c0143930 2020-02-12T15:09:36.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.727+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17c01358f0 con 0x7f17c0143930 2020-02-12T15:09:36.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.727+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f17b8008a60 con 0x7f17c0143930 2020-02-12T15:09:36.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.727+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17c008f080 con 0x7f17c0143930 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.727+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.727+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f17b8013060 con 0x7f17c0143930 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.727+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.727+0000 7f17aeffd700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f17a0039fa0 0x7f17a003c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.728+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f17b80495d0 con 0x7f17c0143930 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.728+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f17a0039fa0 0x7f17a003c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.728+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17c0067ab0 con 0x7f17c0143930 2020-02-12T15:09:36.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.728+0000 7f17c5b6c700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f17a0039fa0 0x7f17a003c460 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:36.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.731+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.731+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f17b802ec00 con 0x7f17c0143930 2020-02-12T15:09:36.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.867+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f17c008f210 con 0x7f17c0143930 2020-02-12T15:09:36.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.868+0000 7f17c636d700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=THROTTLE_DONE pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.868+0000 7f17aeffd700 1 -- 172.21.15.180:0/1063191811 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v16) v1 ==== 92+0+10 (secure 0 0 0) 0x7f17b8031710 con 0x7f17c0143930 2020-02-12T15:09:36.871 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:36.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f17a0039fa0 msgr2=0x7f17a003c460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f17a0039fa0 0x7f17a003c460 crc :-1 s=READY pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 msgr2=0x7f17c014de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 secure :-1 s=READY pgs=58 cs=0 l=1 rx=0x7f17c00a4ae0 tx=0x7f17b8010d90).stop 2020-02-12T15:09:36.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 shutdown_connections 2020-02-12T15:09:36.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f17a0039fa0 0x7f17a003c460 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f17c0143930 0x7f17c014de40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 --2- 172.21.15.180:0/1063191811 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f17c00a4dd0 0x7f17c01434d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 >> 172.21.15.180:0/1063191811 conn(0x7f17c005a530 msgr2=0x7f17c01335a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:36.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 shutdown_connections 2020-02-12T15:09:36.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.869+0000 7f17c7dd0700 1 -- 172.21.15.180:0/1063191811 wait complete. 2020-02-12T15:09:36.882 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early --format=json-pretty osd lspools 2020-02-12T15:09:36.987 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.984+0000 7f776196d700 1 Processor -- start 2020-02-12T15:09:36.987 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.984+0000 7f776196d700 1 -- start start 2020-02-12T15:09:36.993 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776196d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:36.993 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776196d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f775c0a5fa0 0x7f775c0a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:36.994 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776196d700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c0a3b30 con 0x7f775c0a6820 2020-02-12T15:09:36.994 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776196d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f775c0a23b0 con 0x7f775c0a5fa0 2020-02-12T15:09:36.994 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776196d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c0a2650 con 0x7f775c0a5bc0 2020-02-12T15:09:36.994 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776116c700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f775c0a6820 0x7f775c0a6cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42208/0 (socket says 172.21.15.180:42208) 2020-02-12T15:09:36.994 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776116c700 1 -- 172.21.15.180:0/2567349500 learned_addr learned my addr 172.21.15.180:0/2567349500 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:36.994 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.994 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f775bfff700 1 --2- 172.21.15.180:0/2567349500 >> v2:172.21.15.105:3300/0 conn(0x7f775c0a5fa0 0x7f775c0a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.995 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.985+0000 7f775b7fe700 1 -- 172.21.15.180:0/2567349500 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 114881566 0 0) 0x7f775c0a3b30 con 0x7f775c0a6820 2020-02-12T15:09:36.995 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f775b7fe700 1 -- 172.21.15.180:0/2567349500 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7748003230 con 0x7f775c0a6820 2020-02-12T15:09:36.995 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 -- 172.21.15.180:0/2567349500 >> v2:172.21.15.105:3300/0 conn(0x7f775c0a5fa0 msgr2=0x7f775c0a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:36.995 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> v2:172.21.15.105:3300/0 conn(0x7f775c0a5fa0 0x7f775c0a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:36.995 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 -- 172.21.15.180:0/2567349500 >> v1:172.21.15.180:6789/0 conn(0x7f775c0a6820 legacy=0x7f775c0a6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.995 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f775b7fe700 1 -- 172.21.15.180:0/2567349500 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 606844985 0 0) 0x7f7748003230 con 0x7f775c0a6820 2020-02-12T15:09:36.995 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 -- 172.21.15.180:0/2567349500 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0a2af0 con 0x7f775c0a5bc0 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f775bfff700 1 --2- 172.21.15.180:0/2567349500 >> v2:172.21.15.105:3300/0 conn(0x7f775c0a5fa0 0x7f775c0a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f775c0a3f90 tx=0x7f7754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f775c0a3f90 tx=0x7f7754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f775c0a3f90 tx=0x7f7754008c60).ready entity=mon.2 client_cookie=d0887e32200b76d8 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f775c0a3f90 tx=0x7f7754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f775b7fe700 1 -- 172.21.15.180:0/2567349500 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774c0016d0 con 0x7f775c0a5bc0 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f775c0a3f90 tx=0x7f7754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.996 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f775b7fe700 1 -- 172.21.15.180:0/2567349500 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7754011a80 con 0x7f775c0a5bc0 2020-02-12T15:09:36.997 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776096b700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 secure :-1 s=THROTTLE_DONE pgs=27 cs=0 l=1 rx=0x7f775c0a3f90 tx=0x7f7754008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:36.997 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f775b7fe700 1 -- 172.21.15.180:0/2567349500 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7754011de0 con 0x7f775c0a5bc0 2020-02-12T15:09:36.997 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776196d700 1 -- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 msgr2=0x7f775c0a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:36.997 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.986+0000 7f776196d700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 secure :-1 s=READY pgs=27 cs=0 l=1 rx=0x7f775c0a3f90 tx=0x7f7754008c60).stop 2020-02-12T15:09:36.997 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 -- 172.21.15.180:0/2567349500 shutdown_connections 2020-02-12T15:09:36.997 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 --2- 172.21.15.180:0/2567349500 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a5bc0 0x7f775c0a1460 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:36.997 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 --2- 172.21.15.180:0/2567349500 >> v2:172.21.15.105:3300/0 conn(0x7f775c0a5fa0 0x7f775c0a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:36.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 -- 172.21.15.180:0/2567349500 >> 172.21.15.180:0/2567349500 conn(0x7f775c05a530 msgr2=0x7f775c05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:36.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 -- 172.21.15.180:0/2567349500 shutdown_connections 2020-02-12T15:09:36.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 -- 172.21.15.180:0/2567349500 wait complete. 2020-02-12T15:09:36.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 Processor -- start 2020-02-12T15:09:36.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.987+0000 7f776196d700 1 -- start start 2020-02-12T15:09:36.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f776196d700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:36.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f776196d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c064c40 con 0x7f775c0a5fa0 2020-02-12T15:09:36.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f776196d700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775c063780 con 0x7f775c0a5bc0 2020-02-12T15:09:36.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f776196d700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775c142e40 con 0x7f775c0a6820 2020-02-12T15:09:36.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f776096b700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f775c0a5bc0 0x7f775c063070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42210/0 (socket says 172.21.15.180:42210) 2020-02-12T15:09:36.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f776096b700 1 -- 172.21.15.180:0/3342092191 learned_addr learned my addr 172.21.15.180:0/3342092191 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:36.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:36.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1998347973 0 0) 0x7f775c0a2af0 con 0x7f775c0a5bc0 2020-02-12T15:09:36.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.988+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f773c002fe0 con 0x7f775c0a5bc0 2020-02-12T15:09:37.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1096109158 0 0) 0x7f775c064c40 con 0x7f775c0a5fa0 2020-02-12T15:09:37.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f775c0a2af0 con 0x7f775c0a5fa0 2020-02-12T15:09:37.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1227646506 0 0) 0x7f773c002fe0 con 0x7f775c0a5bc0 2020-02-12T15:09:37.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f775c064c40 con 0x7f775c0a5bc0 2020-02-12T15:09:37.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f7754003270 con 0x7f775c0a5bc0 2020-02-12T15:09:37.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 -- 172.21.15.180:0/3342092191 >> v1:172.21.15.180:6789/0 conn(0x7f775c0a5bc0 legacy=0x7f775c063070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 -- 172.21.15.180:0/3342092191 >> v1:172.21.15.105:6789/0 conn(0x7f775c0a5fa0 legacy=0x7f775c14a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 -- 172.21.15.180:0/3342092191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775c0a8e60 con 0x7f775c0a6820 2020-02-12T15:09:37.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:37.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774c00c920 con 0x7f775c0a6820 2020-02-12T15:09:37.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774c00ca80 con 0x7f775c0a6820 2020-02-12T15:09:37.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775c064e70 con 0x7f775c0a6820 2020-02-12T15:09:37.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f774c00cde0 con 0x7f775c0a6820 2020-02-12T15:09:37.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.989+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775c064180 con 0x7f775c0a6820 2020-02-12T15:09:37.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f774c0044f0 con 0x7f775c0a6820 2020-02-12T15:09:37.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f775c0a7a10 con 0x7f775c0a6820 2020-02-12T15:09:37.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f7759ffb700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f773c03a2b0 0x7f773c03c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:37.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f774c049330 con 0x7f775c0a6820 2020-02-12T15:09:37.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f776096b700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f773c03a2b0 0x7f773c03c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:37.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.990+0000 7f776096b700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f773c03a2b0 0x7f773c03c770 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:37.004 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.994+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.004 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:36.994+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f774c02e790 con 0x7f775c0a6820 2020-02-12T15:09:37.132 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.130+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f775c0565b0 con 0x7f775c0a6820 2020-02-12T15:09:37.133 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.131+0000 7f776116c700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=THROTTLE_DONE pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.134 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.131+0000 7f7759ffb700 1 -- 172.21.15.180:0/3342092191 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+64 (secure 0 0 0) 0x7f774c031450 con 0x7f775c0a6820 2020-02-12T15:09:37.134 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:37.134 INFO:teuthology.orchestra.run.smithi180.stdout:[ 2020-02-12T15:09:37.134 INFO:teuthology.orchestra.run.smithi180.stdout: { 2020-02-12T15:09:37.134 INFO:teuthology.orchestra.run.smithi180.stdout: "poolnum": 1, 2020-02-12T15:09:37.134 INFO:teuthology.orchestra.run.smithi180.stdout: "poolname": "rbd" 2020-02-12T15:09:37.135 INFO:teuthology.orchestra.run.smithi180.stdout: } 2020-02-12T15:09:37.135 INFO:teuthology.orchestra.run.smithi180.stdout:] 2020-02-12T15:09:37.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f773c03a2b0 msgr2=0x7f773c03c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f773c03a2b0 0x7f773c03c770 crc :-1 s=READY pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:37.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 msgr2=0x7f775c066ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 secure :-1 s=READY pgs=28 cs=0 l=1 rx=0x7f774c001930 tx=0x7f774c010b20).stop 2020-02-12T15:09:37.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 shutdown_connections 2020-02-12T15:09:37.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f773c03a2b0 0x7f773c03c770 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:37.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 --2- 172.21.15.180:0/3342092191 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f775c0a6820 0x7f775c066ac0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:37.137 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.132+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 >> 172.21.15.180:0/3342092191 conn(0x7f775c05a530 msgr2=0x7f775c05ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:37.137 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.133+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 shutdown_connections 2020-02-12T15:09:37.137 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.133+0000 7f776196d700 1 -- 172.21.15.180:0/3342092191 wait complete. 2020-02-12T15:09:37.145 INFO:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2020-02-12T15:09:37.145 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_metadata 8 2020-02-12T15:09:37.253 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.250+0000 7fd2c1692700 1 Processor -- start 2020-02-12T15:09:37.253 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.251+0000 7fd2c1692700 1 -- start start 2020-02-12T15:09:37.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.251+0000 7fd2c1692700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fd2bc0a2e40 0x7fd2bc0a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:37.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.251+0000 7fd2c1692700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:37.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.251+0000 7fd2c1692700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc0a22f0 con 0x7fd2bc138390 2020-02-12T15:09:37.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.251+0000 7fd2c1692700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0a2590 con 0x7fd2bc0a2e40 2020-02-12T15:09:37.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.251+0000 7fd2c1692700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc0a2830 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.251+0000 7fd2ba7fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:37.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2bb7fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fd2bc138390 0x7fd2bc138820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42218/0 (socket says 172.21.15.180:42218) 2020-02-12T15:09:37.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2bb7fe700 1 -- 172.21.15.180:0/1230594554 learned_addr learned my addr 172.21.15.180:0/1230594554 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:37.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2baffd700 1 --2- 172.21.15.180:0/1230594554 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc0a2e40 0x7fd2bc0a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:37.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 -- 172.21.15.180:0/1230594554 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc0a2e40 msgr2=0x7fd2bc0a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:37.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/1230594554 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc0a2e40 0x7fd2bc0a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:37.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2b9ffb700 1 -- 172.21.15.180:0/1230594554 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1589575594 0 0) 0x7fd2bc0a22f0 con 0x7fd2bc138390 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 -- 172.21.15.180:0/1230594554 >> v1:172.21.15.180:6789/0 conn(0x7fd2bc138390 legacy=0x7fd2bc138820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 -- 172.21.15.180:0/1230594554 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc0a63e0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2baffd700 1 --2- 172.21.15.180:0/1230594554 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc0a2e40 0x7fd2bc0a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/1230594554 >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/1230594554 >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/1230594554 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).ready entity=mon.1 client_cookie=f214016836846a82 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/1230594554 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2b9ffb700 1 -- 172.21.15.180:0/1230594554 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac011470 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/1230594554 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/1230594554 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 secure :-1 s=THROTTLE_DONE pgs=62 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2b9ffb700 1 -- 172.21.15.180:0/1230594554 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac0115d0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2b9ffb700 1 -- 172.21.15.180:0/1230594554 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac011970 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.261 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2c1692700 1 -- 172.21.15.180:0/1230594554 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 msgr2=0x7fd2bc0a0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.261 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.252+0000 7fd2c1692700 1 --2- 172.21.15.180:0/1230594554 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 secure :-1 s=READY pgs=62 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).stop 2020-02-12T15:09:37.261 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.253+0000 7fd2c1692700 1 -- 172.21.15.180:0/1230594554 shutdown_connections 2020-02-12T15:09:37.261 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.253+0000 7fd2c1692700 1 --2- 172.21.15.180:0/1230594554 >> v2:172.21.15.105:3300/0 conn(0x7fd2bc0a2e40 0x7fd2bc0a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:37.261 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.253+0000 7fd2c1692700 1 --2- 172.21.15.180:0/1230594554 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a0b10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:37.261 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.253+0000 7fd2c1692700 1 -- 172.21.15.180:0/1230594554 >> 172.21.15.180:0/1230594554 conn(0x7fd2bc05a530 msgr2=0x7fd2bc05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:37.261 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.253+0000 7fd2c1692700 1 -- 172.21.15.180:0/1230594554 shutdown_connections 2020-02-12T15:09:37.262 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.253+0000 7fd2c1692700 1 -- 172.21.15.180:0/1230594554 wait complete. 2020-02-12T15:09:37.262 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2c1692700 1 Processor -- start 2020-02-12T15:09:37.262 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2c1692700 1 -- start start 2020-02-12T15:09:37.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2c1692700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:37.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2c1692700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc138390 0x7fd2bc12fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:37.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2c1692700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2bc09dee0 con 0x7fd2bc0a2e40 2020-02-12T15:09:37.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2c1692700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2bc134380 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2c1692700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2bc134620 con 0x7fd2bc138390 2020-02-12T15:09:37.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2ba7fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:37.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2baffd700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fd2bc0a2e40 0x7fd2bc1434b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42222/0 (socket says 172.21.15.180:42222) 2020-02-12T15:09:37.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2baffd700 1 -- 172.21.15.180:0/2528417101 learned_addr learned my addr 172.21.15.180:0/2528417101 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:37.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2ba7fc700 1 -- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc138390 msgr2=0x7fd2bc12fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc138390 0x7fd2bc12fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:37.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2ba7fc700 1 -- 172.21.15.180:0/2528417101 >> v1:172.21.15.180:6789/0 conn(0x7fd2bc0a2e40 legacy=0x7fd2bc1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:37.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.254+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1301888719 0 0) 0x7fd2bc09dee0 con 0x7fd2bc0a2e40 2020-02-12T15:09:37.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 -- 172.21.15.180:0/2528417101 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2bc1348c0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> v2:172.21.15.180:3300/0 conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:37.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac00f780 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ac007150 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2bc133ee0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd2ac0074b0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2bc063720 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.255+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.256+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fd2ac0056c0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.256+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.256+0000 7fd2b3fff700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fd2a00399e0 0x7fd2a003bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:37.269 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.256+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2bc1341f0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.269 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.256+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd2ac049eb0 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.269 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.256+0000 7fd2baffd700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fd2a00399e0 0x7fd2a003bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:37.269 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.256+0000 7fd2baffd700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fd2a00399e0 0x7fd2a003bea0 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:37.269 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.259+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:37.269 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.259+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fd2ac02f580 con 0x7fd2bc0a5f50 2020-02-12T15:09:37.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:37.396+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8} v 0) v1 -- 0x7fd2bc067ab0 con 0x7fd2bc0a5f50 2020-02-12T15:09:38.401 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.399+0000 7fd2ba7fc700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=THROTTLE_DONE pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.402 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.399+0000 7fd2b3fff700 1 -- 172.21.15.180:0/2528417101 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num": 8}]=0 pool 'cephfs_metadata' created v18) v1 ==== 133+0+0 (secure 0 0 0) 0x7fd2ac032030 con 0x7fd2bc0a5f50 2020-02-12T15:09:38.404 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fd2a00399e0 msgr2=0x7fd2a003bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:38.404 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fd2a00399e0 0x7fd2a003bea0 crc :-1 s=READY pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:38.404 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 msgr2=0x7fd2bc0a5120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:38.404 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 secure :-1 s=READY pgs=64 cs=0 l=1 rx=0x7fd2ac002f30 tx=0x7fd2ac007a40).stop 2020-02-12T15:09:38.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 shutdown_connections 2020-02-12T15:09:38.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fd2a00399e0 0x7fd2a003bea0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:38.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fd2bc138390 0x7fd2bc12fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:38.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 --2- 172.21.15.180:0/2528417101 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fd2bc0a5f50 0x7fd2bc0a5120 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:38.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.401+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 >> 172.21.15.180:0/2528417101 conn(0x7fd2bc05a530 msgr2=0x7fd2bc0698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:38.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.402+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 shutdown_connections 2020-02-12T15:09:38.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.402+0000 7fd2c1692700 1 -- 172.21.15.180:0/2528417101 wait complete. 2020-02-12T15:09:38.406 INFO:teuthology.orchestra.run.smithi180.stderr:pool 'cephfs_metadata' created 2020-02-12T15:09:38.416 INFO:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2020-02-12T15:09:38.417 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd erasure-code-profile set cephfs_data m=2 k=2 crush-failure-domain=osd 2020-02-12T15:09:38.539 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.530+0000 7f5215e25700 1 Processor -- start 2020-02-12T15:09:38.539 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.530+0000 7f5215e25700 1 -- start start 2020-02-12T15:09:38.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f5215e25700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52100a3990 0x7f521012ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:38.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f5215e25700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f5210134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:38.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f5215e25700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52100a3f10 con 0x7f52100aac00 2020-02-12T15:09:38.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f5215e25700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52100a41b0 con 0x7f52100a3990 2020-02-12T15:09:38.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f5215e25700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52100a4450 con 0x7f521012ee90 2020-02-12T15:09:38.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f5210134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:38.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f5210134c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50718/0 (socket says 172.21.15.180:50718) 2020-02-12T15:09:38.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 -- 172.21.15.180:0/1929504078 learned_addr learned my addr 172.21.15.180:0/1929504078 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:38.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520f7fe700 1 --1- 172.21.15.180:0/1929504078 >> v1:172.21.15.180:6789/0 conn(0x7f52100aac00 0x7f52100a6520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42230/0 (socket says 172.21.15.180:42230) 2020-02-12T15:09:38.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520effd700 1 --2- 172.21.15.180:0/1929504078 >> v2:172.21.15.105:3300/0 conn(0x7f52100a3990 0x7f521012ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:38.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 -- 172.21.15.180:0/1929504078 >> v2:172.21.15.105:3300/0 conn(0x7f52100a3990 msgr2=0x7f521012ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:38.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- 172.21.15.180:0/1929504078 >> v2:172.21.15.105:3300/0 conn(0x7f52100a3990 0x7f521012ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:38.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 -- 172.21.15.180:0/1929504078 >> v1:172.21.15.180:6789/0 conn(0x7f52100aac00 legacy=0x7f52100a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:38.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520e7fc700 1 -- 172.21.15.180:0/1929504078 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674202853 0 0) 0x7f52100a3f10 con 0x7f52100aac00 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 -- 172.21.15.180:0/1929504078 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f521012f300 con 0x7f521012ee90 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- 172.21.15.180:0/1929504078 >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f5210134c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- 172.21.15.180:0/1929504078 >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f5210134c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- 172.21.15.180:0/1929504078 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f5210134c80 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).ready entity=mon.1 client_cookie=49188629adbf5612 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- 172.21.15.180:0/1929504078 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f5210134c80 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520e7fc700 1 -- 172.21.15.180:0/1929504078 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520800a160 con 0x7f521012ee90 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- 172.21.15.180:0/1929504078 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f5210134c80 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520e7fc700 1 -- 172.21.15.180:0/1929504078 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520800a2c0 con 0x7f521012ee90 2020-02-12T15:09:38.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520ffff700 1 --2- 172.21.15.180:0/1929504078 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f5210134c80 secure :-1 s=THROTTLE_DONE pgs=66 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f520e7fc700 1 -- 172.21.15.180:0/1929504078 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520800a620 con 0x7f521012ee90 2020-02-12T15:09:38.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f5215e25700 1 -- 172.21.15.180:0/1929504078 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 msgr2=0x7f5210134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:38.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.531+0000 7f5215e25700 1 --2- 172.21.15.180:0/1929504078 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f5210134c80 secure :-1 s=READY pgs=66 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).stop 2020-02-12T15:09:38.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.532+0000 7f5215e25700 1 -- 172.21.15.180:0/1929504078 shutdown_connections 2020-02-12T15:09:38.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.532+0000 7f5215e25700 1 --2- 172.21.15.180:0/1929504078 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f5210134c80 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:38.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.532+0000 7f5215e25700 1 --2- 172.21.15.180:0/1929504078 >> v2:172.21.15.105:3300/0 conn(0x7f52100a3990 0x7f521012ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:38.544 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.532+0000 7f5215e25700 1 -- 172.21.15.180:0/1929504078 >> 172.21.15.180:0/1929504078 conn(0x7f521009d450 msgr2=0x7f521009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:38.544 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.532+0000 7f5215e25700 1 -- 172.21.15.180:0/1929504078 shutdown_connections 2020-02-12T15:09:38.544 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.532+0000 7f5215e25700 1 -- 172.21.15.180:0/1929504078 wait complete. 2020-02-12T15:09:38.544 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.533+0000 7f5215e25700 1 Processor -- start 2020-02-12T15:09:38.544 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.533+0000 7f5215e25700 1 -- start start 2020-02-12T15:09:38.544 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f5215e25700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f52100aac00 0x7f52101197f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:38.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f5215e25700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f521012d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:38.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f5215e25700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5210131f80 con 0x7f52100a3990 2020-02-12T15:09:38.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f5215e25700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5210132220 con 0x7f52100aac00 2020-02-12T15:09:38.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f5215e25700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f521011c1e0 con 0x7f521012ee90 2020-02-12T15:09:38.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520f7fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f52100a3990 0x7f52101172c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42236/0 (socket says 172.21.15.180:42236) 2020-02-12T15:09:38.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520f7fe700 1 -- 172.21.15.180:0/2196038003 learned_addr learned my addr 172.21.15.180:0/2196038003 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:38.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f521012d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520effd700 1 --2- 172.21.15.180:0/2196038003 >> v2:172.21.15.105:3300/0 conn(0x7f52100aac00 0x7f52101197f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2875339841 0 0) 0x7f5210131f80 con 0x7f52100a3990 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f0002fe0 con 0x7f52100a3990 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 -- 172.21.15.180:0/2196038003 >> v2:172.21.15.105:3300/0 conn(0x7f52100aac00 msgr2=0x7f52101197f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> v2:172.21.15.105:3300/0 conn(0x7f52100aac00 0x7f52101197f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 -- 172.21.15.180:0/2196038003 >> v1:172.21.15.180:6789/0 conn(0x7f52100a3990 legacy=0x7f52101172c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 -- 172.21.15.180:0/2196038003 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5210130c80 con 0x7f521012ee90 2020-02-12T15:09:38.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> v2:172.21.15.180:3300/0 conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:38.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520800ae20 con 0x7f521012ee90 2020-02-12T15:09:38.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5208005c30 con 0x7f521012ee90 2020-02-12T15:09:38.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5210130f20 con 0x7f521012ee90 2020-02-12T15:09:38.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5208005e20 con 0x7f521012ee90 2020-02-12T15:09:38.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.534+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52101307e0 con 0x7f521012ee90 2020-02-12T15:09:38.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.535+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.558 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.535+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f5208007340 con 0x7f521012ee90 2020-02-12T15:09:38.558 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.535+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.558 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.535+0000 7f520cff9700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51f0039f60 0x7f51f003c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:38.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.535+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5207+0+0 (secure 0 0 0) 0x7f520804a670 con 0x7f521012ee90 2020-02-12T15:09:38.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.535+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5210130a90 con 0x7f521012ee90 2020-02-12T15:09:38.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.535+0000 7f520f7fe700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51f0039f60 0x7f51f003c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:38.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.536+0000 7f520f7fe700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51f0039f60 0x7f51f003c420 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:38.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.539+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:38.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.539+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f520802fd80 con 0x7f521012ee90 2020-02-12T15:09:38.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:38.686+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f52100565b0 con 0x7f521012ee90 2020-02-12T15:09:39.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.402+0000 7f520ffff700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.405 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.402+0000 7f520cff9700 1 -- 172.21.15.180:0/2196038003 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v19) v1 ==== 154+0+0 (secure 0 0 0) 0x7f5208032870 con 0x7f521012ee90 2020-02-12T15:09:39.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51f0039f60 msgr2=0x7f51f003c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51f0039f60 0x7f51f003c420 crc :-1 s=READY pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 msgr2=0x7f521012d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.408 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7f52080032b0 tx=0x7f5208007dc0).stop 2020-02-12T15:09:39.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 shutdown_connections 2020-02-12T15:09:39.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51f0039f60 0x7f51f003c420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 --2- 172.21.15.180:0/2196038003 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f521012ee90 0x7f521012d760 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 --2- 172.21.15.180:0/2196038003 >> v2:172.21.15.105:3300/0 conn(0x7f52100aac00 0x7f52101197f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.409 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 >> 172.21.15.180:0/2196038003 conn(0x7f521009d450 msgr2=0x7f521009d830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:39.410 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 shutdown_connections 2020-02-12T15:09:39.410 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.406+0000 7f5215e25700 1 -- 172.21.15.180:0/2196038003 wait complete. 2020-02-12T15:09:39.421 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool create cephfs_data 8 erasure cephfs_data 2020-02-12T15:09:39.558 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.532+0000 7f54dfb31700 1 Processor -- start 2020-02-12T15:09:39.558 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.532+0000 7f54dfb31700 1 -- start start 2020-02-12T15:09:39.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dfb31700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f54d80a1c60 0x7f54d80a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:39.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dfb31700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f54d8131900 0x7f54d8131d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:39.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dfb31700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d80a7300 con 0x7f54d8138350 2020-02-12T15:09:39.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dfb31700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d8137c10 con 0x7f54d80a1c60 2020-02-12T15:09:39.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dfb31700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d8137eb0 con 0x7f54d8131900 2020-02-12T15:09:39.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f54d8131900 0x7f54d8131d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:39.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f54d8131900 0x7f54d8131d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50734/0 (socket says 172.21.15.180:50734) 2020-02-12T15:09:39.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 -- 172.21.15.180:0/1475683256 learned_addr learned my addr 172.21.15.180:0/1475683256 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:39.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dd8cd700 1 --2- 172.21.15.180:0/1475683256 >> v2:172.21.15.105:3300/0 conn(0x7f54d80a1c60 0x7f54d80a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:39.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 -- 172.21.15.180:0/1475683256 >> v2:172.21.15.105:3300/0 conn(0x7f54d80a1c60 msgr2=0x7f54d80a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- 172.21.15.180:0/1475683256 >> v2:172.21.15.105:3300/0 conn(0x7f54d80a1c60 0x7f54d80a6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 -- 172.21.15.180:0/1475683256 >> v1:172.21.15.105:6789/0 conn(0x7f54d8138350 legacy=0x7f54d81311f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 -- 172.21.15.180:0/1475683256 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d80a7910 con 0x7f54d8131900 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- 172.21.15.180:0/1475683256 >> v2:172.21.15.180:3300/0 conn(0x7f54d8131900 0x7f54d8131d40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- 172.21.15.180:0/1475683256 >> v2:172.21.15.180:3300/0 conn(0x7f54d8131900 0x7f54d8131d40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- 172.21.15.180:0/1475683256 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54d8131900 0x7f54d8131d40 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).ready entity=mon.1 client_cookie=c1a21a3c6c4ba073 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- 172.21.15.180:0/1475683256 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54d8131900 0x7f54d8131d40 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dc8cb700 1 -- 172.21.15.180:0/1475683256 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000a160 con 0x7f54d8131900 2020-02-12T15:09:39.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- 172.21.15.180:0/1475683256 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54d8131900 0x7f54d8131d40 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54de0ce700 1 --2- 172.21.15.180:0/1475683256 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54d8131900 0x7f54d8131d40 secure :-1 s=THROTTLE_DONE pgs=69 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dc8cb700 1 -- 172.21.15.180:0/1475683256 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d000a2c0 con 0x7f54d8131900 2020-02-12T15:09:39.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dc8cb700 1 -- 172.21.15.180:0/1475683256 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000a6a0 con 0x7f54d8131900 2020-02-12T15:09:39.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dfb31700 1 -- 172.21.15.180:0/1475683256 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54d8131900 msgr2=0x7f54d8131d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.533+0000 7f54dfb31700 1 --2- 172.21.15.180:0/1475683256 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54d8131900 0x7f54d8131d40 secure :-1 s=READY pgs=69 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).stop 2020-02-12T15:09:39.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.534+0000 7f54dfb31700 1 -- 172.21.15.180:0/1475683256 shutdown_connections 2020-02-12T15:09:39.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.534+0000 7f54dfb31700 1 --2- 172.21.15.180:0/1475683256 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54d8131900 0x7f54d8131d40 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.534+0000 7f54dfb31700 1 --2- 172.21.15.180:0/1475683256 >> v2:172.21.15.105:3300/0 conn(0x7f54d80a1c60 0x7f54d80a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:39.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.534+0000 7f54dfb31700 1 -- 172.21.15.180:0/1475683256 >> 172.21.15.180:0/1475683256 conn(0x7f54d809d450 msgr2=0x7f54d809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:39.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.534+0000 7f54dfb31700 1 -- 172.21.15.180:0/1475683256 shutdown_connections 2020-02-12T15:09:39.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.534+0000 7f54dfb31700 1 -- 172.21.15.180:0/1475683256 wait complete. 2020-02-12T15:09:39.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.535+0000 7f54dfb31700 1 Processor -- start 2020-02-12T15:09:39.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.535+0000 7f54dfb31700 1 -- start start 2020-02-12T15:09:39.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.535+0000 7f54dfb31700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f54d8138350 0x7f54d8145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:39.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.535+0000 7f54dfb31700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d812d220 con 0x7f54d80a1c60 2020-02-12T15:09:39.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.535+0000 7f54dfb31700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54d812d4c0 con 0x7f54d8131900 2020-02-12T15:09:39.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.535+0000 7f54dfb31700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54d81452e0 con 0x7f54d8138350 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54dd0cc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f54d8131900 0x7f54d81457b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42250/0 (socket says 172.21.15.180:42250) 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54dd0cc700 1 -- 172.21.15.180:0/3283977502 learned_addr learned my addr 172.21.15.180:0/3283977502 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> v2:172.21.15.105:3300/0 conn(0x7f54d8138350 0x7f54d8145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3340108586 0 0) 0x7f54d812d4c0 con 0x7f54d8131900 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54b8002fe0 con 0x7f54d8131900 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3324406900 0 0) 0x7f54d812d220 con 0x7f54d80a1c60 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f54d812d4c0 con 0x7f54d80a1c60 2020-02-12T15:09:39.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3690427391 0 0) 0x7f54b8002fe0 con 0x7f54d8131900 2020-02-12T15:09:39.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f54d812d220 con 0x7f54d8131900 2020-02-12T15:09:39.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f54d40019c0 con 0x7f54d8131900 2020-02-12T15:09:39.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 >> v2:172.21.15.105:3300/0 conn(0x7f54d8138350 msgr2=0x7f54d8145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 --2- 172.21.15.180:0/3283977502 >> v2:172.21.15.105:3300/0 conn(0x7f54d8138350 0x7f54d8145ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 >> v1:172.21.15.180:6789/0 conn(0x7f54d8131900 legacy=0x7f54d81457b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 >> v1:172.21.15.105:6789/0 conn(0x7f54d80a1c60 legacy=0x7f54d812b610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b8004b20 0x7f54b8004f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:39.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b8003ab0 0x7f54b8003f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:39.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:39.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54d81452e0 con 0x7f54b8004b20 2020-02-12T15:09:39.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b800bbb0 con 0x7f54b8004370 2020-02-12T15:09:39.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b800bcf0 con 0x7f54b8003ab0 2020-02-12T15:09:39.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> v2:172.21.15.105:3300/0 conn(0x7f54d8138350 0x7f54d8145ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:39.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:39.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54dd8cd700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b8004b20 0x7f54b8004f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:39.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54dd0cc700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b8003ab0 0x7f54b8003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:39.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 -- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b8003ab0 msgr2=0x7f54b8003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b8003ab0 0x7f54b8003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 -- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b8004b20 msgr2=0x7f54b8004f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:39.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f54b8004b20 0x7f54b8004f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:39.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54d812d760 con 0x7f54b8004370 2020-02-12T15:09:39.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54d812da60 con 0x7f54b8004370 2020-02-12T15:09:39.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.536+0000 7f54dd0cc700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f54b8003ab0 0x7f54b8003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:39.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 -- 172.21.15.180:0/3283977502 reap_dead start 2020-02-12T15:09:39.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54d80a3f20 con 0x7f54b8004370 2020-02-12T15:09:39.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:39.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000aab0 con 0x7f54b8004370 2020-02-12T15:09:39.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54d0005a40 con 0x7f54b8004370 2020-02-12T15:09:39.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54d000ac10 con 0x7f54b8004370 2020-02-12T15:09:39.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f54d000f650 con 0x7f54b8004370 2020-02-12T15:09:39.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.537+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.538+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54d812e310 con 0x7f54b8004370 2020-02-12T15:09:39.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.538+0000 7f54c6ffd700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f54b803dd60 0x7f54b8040220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:39.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.538+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5463+0+0 (secure 0 0 0) 0x7f54d004a280 con 0x7f54b8004370 2020-02-12T15:09:39.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.538+0000 7f54dd8cd700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f54b803dd60 0x7f54b8040220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:39.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.538+0000 7f54dd8cd700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f54b803dd60 0x7f54b8040220 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:39.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.541+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:39.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.541+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f54d002f9d0 con 0x7f54b8004370 2020-02-12T15:09:39.678 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:39.676+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"} v 0) v1 -- 0x7f54d80565b0 con 0x7f54b8004370 2020-02-12T15:09:41.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.413+0000 7f54de0ce700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=THROTTLE_DONE pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.413+0000 7f54c6ffd700 1 -- 172.21.15.180:0/3283977502 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 8, "pool_type": "erasure", "erasure_code_profile": "cephfs_data"}]=0 pool 'cephfs_data' created v21) v1 ==== 188+0+0 (secure 0 0 0) 0x7f54d0032480 con 0x7f54b8004370 2020-02-12T15:09:41.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.415+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f54b803dd60 msgr2=0x7f54b8040220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.415+0000 7f54dfb31700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f54b803dd60 0x7f54b8040220 crc :-1 s=READY pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.415+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 msgr2=0x7f54b800b750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.415+0000 7f54dfb31700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 secure :-1 s=READY pgs=71 cs=0 l=1 rx=0x7f54d00032b0 tx=0x7f54d0007dc0).stop 2020-02-12T15:09:41.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.416+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 shutdown_connections 2020-02-12T15:09:41.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.416+0000 7f54dfb31700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f54b803dd60 0x7f54b8040220 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.416+0000 7f54dfb31700 1 --2- 172.21.15.180:0/3283977502 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f54b8004370 0x7f54b800b750 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.416+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 >> 172.21.15.180:0/3283977502 conn(0x7f54d809d450 msgr2=0x7f54d809d830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:41.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.416+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 shutdown_connections 2020-02-12T15:09:41.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.416+0000 7f54dfb31700 1 -- 172.21.15.180:0/3283977502 wait complete. 2020-02-12T15:09:41.421 INFO:teuthology.orchestra.run.smithi180.stderr:pool 'cephfs_data' created 2020-02-12T15:09:41.432 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool set cephfs_data allow_ec_overwrites true 2020-02-12T15:09:41.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.554+0000 7f830fcc4700 1 Processor -- start 2020-02-12T15:09:41.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.554+0000 7f830fcc4700 1 -- start start 2020-02-12T15:09:41.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.554+0000 7f830fcc4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83080a2e40 0x7f83080a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:41.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830fcc4700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080a22f0 con 0x7f83080a5f50 2020-02-12T15:09:41.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830fcc4700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080a2590 con 0x7f8308131a40 2020-02-12T15:09:41.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830fcc4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83080a2830 con 0x7f83080a2e40 2020-02-12T15:09:41.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830e261700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f8308131a40 0x7f8308131ed0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42268/0 (socket says 172.21.15.180:42268) 2020-02-12T15:09:41.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830e261700 1 -- 172.21.15.180:0/2854758814 learned_addr learned my addr 172.21.15.180:0/2854758814 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:41.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> v2:172.21.15.105:3300/0 conn(0x7f83080a2e40 0x7f83080a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1771393743 0 0) 0x7f83080a2590 con 0x7f8308131a40 2020-02-12T15:09:41.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82f0003230 con 0x7f8308131a40 2020-02-12T15:09:41.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3355686077 0 0) 0x7f82f0003230 con 0x7f8308131a40 2020-02-12T15:09:41.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 >> v2:172.21.15.105:3300/0 conn(0x7f83080a2e40 msgr2=0x7f83080a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:41.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 --2- 172.21.15.180:0/2854758814 >> v2:172.21.15.105:3300/0 conn(0x7f83080a2e40 0x7f83080a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:41.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 >> v1:172.21.15.105:6789/0 conn(0x7f83080a5f50 legacy=0x7f83080a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83080a63e0 con 0x7f8308131a40 2020-02-12T15:09:41.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f83040016d0 con 0x7f8308131a40 2020-02-12T15:09:41.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 >> v1:172.21.15.180:6789/0 conn(0x7f8308131a40 legacy=0x7f8308131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:41.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82f00044d0 0x7f82f0004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:41.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82f0004db0 0x7f82f000b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:41.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83080a2830 con 0x7f82f00044d0 2020-02-12T15:09:41.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82f00041c0 con 0x7f82f0003720 2020-02-12T15:09:41.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82f000bb80 con 0x7f82f0004db0 2020-02-12T15:09:41.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830d25f700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82f00044d0 0x7f82f0004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.555+0000 7f830e261700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82f0004db0 0x7f82f000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 -- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82f0004db0 msgr2=0x7f82f000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:41.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f82f0004db0 0x7f82f000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:41.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 -- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82f00044d0 msgr2=0x7f82f0004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:41.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82f00044d0 0x7f82f0004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:41.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830e261700 1 -- 172.21.15.180:0/2854758814 reap_dead start 2020-02-12T15:09:41.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 -- 172.21.15.180:0/2854758814 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82f0003230 con 0x7f82f0003720 2020-02-12T15:09:41.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830d25f700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82f00044d0 0x7f82f0004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:41.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f82f00054a0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f82f00054a0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f82f00054a0 tx=0x7f83000104b0).ready entity=mon.1 client_cookie=bc8f7aeeed64a4b1 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f82f00054a0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f82f00054a0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8300005c30 con 0x7f82f0003720 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830da60700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 secure :-1 s=THROTTLE_DONE pgs=73 cs=0 l=1 rx=0x7f82f00054a0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8300005d90 con 0x7f82f0003720 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830ca5e700 1 -- 172.21.15.180:0/2854758814 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83000112b0 con 0x7f82f0003720 2020-02-12T15:09:41.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830fcc4700 1 -- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 msgr2=0x7f82f0003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830fcc4700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 secure :-1 s=READY pgs=73 cs=0 l=1 rx=0x7f82f00054a0 tx=0x7f83000104b0).stop 2020-02-12T15:09:41.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830fcc4700 1 -- 172.21.15.180:0/2854758814 shutdown_connections 2020-02-12T15:09:41.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830fcc4700 1 --2- 172.21.15.180:0/2854758814 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82f0003720 0x7f82f0003b40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830fcc4700 1 -- 172.21.15.180:0/2854758814 >> 172.21.15.180:0/2854758814 conn(0x7f830805a530 msgr2=0x7f830805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:41.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830fcc4700 1 -- 172.21.15.180:0/2854758814 shutdown_connections 2020-02-12T15:09:41.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.556+0000 7f830fcc4700 1 -- 172.21.15.180:0/2854758814 wait complete. 2020-02-12T15:09:41.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.557+0000 7f830fcc4700 1 Processor -- start 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.557+0000 7f830fcc4700 1 -- start start 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830fcc4700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f8308145e30 0x7f830812ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830fcc4700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 0x7f83081303b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830fcc4700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83080623f0 con 0x7f82f0003720 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830fcc4700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83080ab030 con 0x7f8308145e30 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830fcc4700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8308062620 con 0x7f8308063470 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830da60700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f82f0003720 0x7f8308062d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42276/0 (socket says 172.21.15.180:42276) 2020-02-12T15:09:41.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830da60700 1 -- 172.21.15.180:0/79108422 learned_addr learned my addr 172.21.15.180:0/79108422 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830d25f700 1 --2- 172.21.15.180:0/79108422 >> v2:172.21.15.105:3300/0 conn(0x7f8308145e30 0x7f830812ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f830e261700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 0x7f83081303b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943129183 0 0) 0x7f83080623f0 con 0x7f82f0003720 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f82e8002fe0 con 0x7f82f0003720 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2566420246 0 0) 0x7f82e8002fe0 con 0x7f82f0003720 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f83080623f0 con 0x7f82f0003720 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f8300005e50 con 0x7f82f0003720 2020-02-12T15:09:41.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 msgr2=0x7f83081303b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 0x7f83081303b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 >> v2:172.21.15.105:3300/0 conn(0x7f8308145e30 msgr2=0x7f830812ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 --2- 172.21.15.180:0/79108422 >> v2:172.21.15.105:3300/0 conn(0x7f8308145e30 0x7f830812ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 >> v1:172.21.15.180:6789/0 conn(0x7f82f0003720 legacy=0x7f8308062d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:41.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.558+0000 7f82faffd700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8005210 0x7f82e8003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:41.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f82faffd700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 0x7f82e8003eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83080ab030 con 0x7f82e8005210 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8308062620 con 0x7f82e80049b0 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80043e0 con 0x7f8308063470 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830d25f700 1 --2- 172.21.15.180:0/79108422 >> v2:172.21.15.105:3300/0 conn(0x7f8308145e30 0x7f830812ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830e261700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 0x7f82e8003eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830d25f700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8005210 0x7f82e8003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 -- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 msgr2=0x7f82e8003eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f8308063470 0x7f82e8003eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 -- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8005210 msgr2=0x7f82e8003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:41.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8005210 0x7f82e8003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:41.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83080628c0 con 0x7f82e80049b0 2020-02-12T15:09:41.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830d25f700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f82e8005210 0x7f82e8003920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:41.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8308146780 con 0x7f82e80049b0 2020-02-12T15:09:41.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.580 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8308066c10 con 0x7f82e80049b0 2020-02-12T15:09:41.580 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.580 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:41.580 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.580 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83000079e0 con 0x7f82e80049b0 2020-02-12T15:09:41.580 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.580 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83000154c0 con 0x7f82e80049b0 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.559+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83000158a0 con 0x7f82e80049b0 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.560+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.560+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f8300015a00 con 0x7f82e80049b0 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.560+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.560+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8308067ab0 con 0x7f82e80049b0 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.560+0000 7f82faffd700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f82e8041d20 0x7f82e80441e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:41.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.560+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f830004afd0 con 0x7f82e80049b0 2020-02-12T15:09:41.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.560+0000 7f830d25f700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f82e8041d20 0x7f82e80441e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:41.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.561+0000 7f830d25f700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f82e8041d20 0x7f82e80441e0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:41.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.563+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:41.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.564+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f83000306c0 con 0x7f82e80049b0 2020-02-12T15:09:41.701 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:41.699+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7f8308146910 con 0x7f82e80049b0 2020-02-12T15:09:42.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.417+0000 7f830da60700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=THROTTLE_DONE pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.417+0000 7f82faffd700 1 -- 172.21.15.180:0/79108422 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 3 allow_ec_overwrites to true v22) v1 ==== 166+0+0 (secure 0 0 0) 0x7f83000331b0 con 0x7f82e80049b0 2020-02-12T15:09:42.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f82e8041d20 msgr2=0x7f82e80441e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f82e8041d20 0x7f82e80441e0 crc :-1 s=READY pgs=43 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 msgr2=0x7f82e8004d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 --2- 172.21.15.180:0/79108422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f82e80049b0 0x7f82e8004d90 secure :-1 s=READY pgs=75 cs=0 l=1 rx=0x7f83000086e0 tx=0x7f83000104b0).stop 2020-02-12T15:09:42.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830e261700 1 -- 172.21.15.180:0/79108422 reap_dead start 2020-02-12T15:09:42.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830e261700 1 -- 172.21.15.180:0/79108422 reap_dead start 2020-02-12T15:09:42.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 shutdown_connections 2020-02-12T15:09:42.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 >> 172.21.15.180:0/79108422 conn(0x7f830805a530 msgr2=0x7f83080698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:42.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 shutdown_connections 2020-02-12T15:09:42.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.421+0000 7f830fcc4700 1 -- 172.21.15.180:0/79108422 wait complete. 2020-02-12T15:09:42.426 INFO:teuthology.orchestra.run.smithi180.stderr:set pool 3 allow_ec_overwrites to true 2020-02-12T15:09:42.436 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs new cephfs cephfs_metadata cephfs_data --force 2020-02-12T15:09:42.550 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.547+0000 7f2ce288d700 1 Processor -- start 2020-02-12T15:09:42.550 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.547+0000 7f2ce288d700 1 -- start start 2020-02-12T15:09:42.552 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2ce288d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc0a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:42.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2ce288d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:42.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2ce288d700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc067100 con 0x7f2cdc13fb20 2020-02-12T15:09:42.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2ce288d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc0a70a0 con 0x7f2cdc0a1960 2020-02-12T15:09:42.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2ce288d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc0a7b80 con 0x7f2cdc0a33b0 2020-02-12T15:09:42.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2ce0e2a700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f2cdc13fb20 0x7f2cdc13ff50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42290/0 (socket says 172.21.15.180:42290) 2020-02-12T15:09:42.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2ce0e2a700 1 -- 172.21.15.180:0/153590046 learned_addr learned my addr 172.21.15.180:0/153590046 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:42.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cd3fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cdbfff700 1 --2- 172.21.15.180:0/153590046 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc0a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cdb7fe700 1 -- 172.21.15.180:0/153590046 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4283317716 0 0) 0x7f2cdc067100 con 0x7f2cdc13fb20 2020-02-12T15:09:42.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cdb7fe700 1 -- 172.21.15.180:0/153590046 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2cbc003230 con 0x7f2cdc13fb20 2020-02-12T15:09:42.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cd3fff700 1 -- 172.21.15.180:0/153590046 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 msgr2=0x7f2cdc0a1d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:42.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cd3fff700 1 --2- 172.21.15.180:0/153590046 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc0a1d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:42.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cd3fff700 1 -- 172.21.15.180:0/153590046 >> v1:172.21.15.180:6789/0 conn(0x7f2cdc13fb20 legacy=0x7f2cdc13ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cd3fff700 1 -- 172.21.15.180:0/153590046 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc0a6e70 con 0x7f2cdc0a33b0 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.548+0000 7f2cd3fff700 1 --2- 172.21.15.180:0/153590046 >> v2:172.21.15.180:3300/0 conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2cdc0a2650 tx=0x7f2cc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cd3fff700 1 --2- 172.21.15.180:0/153590046 >> v2:172.21.15.180:3300/0 conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2cdc0a2650 tx=0x7f2cc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cd3fff700 1 --2- 172.21.15.180:0/153590046 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f2cdc0a2650 tx=0x7f2cc40088e0).ready entity=mon.1 client_cookie=e9038a7f2ae8c6dc server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cd3fff700 1 --2- 172.21.15.180:0/153590046 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f2cdc0a2650 tx=0x7f2cc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cdb7fe700 1 -- 172.21.15.180:0/153590046 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cc4008e40 con 0x7f2cdc0a33b0 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cd3fff700 1 --2- 172.21.15.180:0/153590046 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f2cdc0a2650 tx=0x7f2cc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cd3fff700 1 --2- 172.21.15.180:0/153590046 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 secure :-1 s=THROTTLE_DONE pgs=77 cs=0 l=1 rx=0x7f2cdc0a2650 tx=0x7f2cc40088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cdb7fe700 1 -- 172.21.15.180:0/153590046 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cc4011500 con 0x7f2cdc0a33b0 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2cdb7fe700 1 -- 172.21.15.180:0/153590046 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cc40118e0 con 0x7f2cdc0a33b0 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 -- 172.21.15.180:0/153590046 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc0a33b0 msgr2=0x7f2cdc0a3840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 --2- 172.21.15.180:0/153590046 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 secure :-1 s=READY pgs=77 cs=0 l=1 rx=0x7f2cdc0a2650 tx=0x7f2cc40088e0).stop 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 -- 172.21.15.180:0/153590046 shutdown_connections 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 --2- 172.21.15.180:0/153590046 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc0a1d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 --2- 172.21.15.180:0/153590046 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc0a33b0 0x7f2cdc0a3840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 -- 172.21.15.180:0/153590046 >> 172.21.15.180:0/153590046 conn(0x7f2cdc05a530 msgr2=0x7f2cdc05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:42.556 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 -- 172.21.15.180:0/153590046 shutdown_connections 2020-02-12T15:09:42.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.549+0000 7f2ce288d700 1 -- 172.21.15.180:0/153590046 wait complete. 2020-02-12T15:09:42.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.550+0000 7f2ce288d700 1 Processor -- start 2020-02-12T15:09:42.557 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.550+0000 7f2ce288d700 1 -- start start 2020-02-12T15:09:42.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce288d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc149540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:42.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce288d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2cdc13fb20 0x7f2cdc0999d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:42.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce288d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cdc0a9570 con 0x7f2cdc0a33b0 2020-02-12T15:09:42.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce288d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc0a9810 con 0x7f2cdc0a1960 2020-02-12T15:09:42.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce288d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2cdc0a9ab0 con 0x7f2cdc13fb20 2020-02-12T15:09:42.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2cdc13fb20 0x7f2cdc0999d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2cdc13fb20 0x7f2cdc0999d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50784/0 (socket says 172.21.15.180:50784) 2020-02-12T15:09:42.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 -- 172.21.15.180:0/2992157856 learned_addr learned my addr 172.21.15.180:0/2992157856 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:42.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2cdbfff700 1 --2- 172.21.15.180:0/2992157856 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc149540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 -- 172.21.15.180:0/2992157856 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 msgr2=0x7f2cdc149540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc149540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 -- 172.21.15.180:0/2992157856 >> v1:172.21.15.105:6789/0 conn(0x7f2cdc0a33b0 legacy=0x7f2cdc0a8bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 -- 172.21.15.180:0/2992157856 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cdc1499a0 con 0x7f2cdc13fb20 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> v2:172.21.15.180:3300/0 conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> v2:172.21.15.180:3300/0 conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2cd9ffb700 1 -- 172.21.15.180:0/2992157856 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd4005e50 con 0x7f2cdc13fb20 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.562 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2cd9ffb700 1 -- 172.21.15.180:0/2992157856 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd4012500 con 0x7f2cdc13fb20 2020-02-12T15:09:42.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cdc0a0d90 con 0x7f2cdc13fb20 2020-02-12T15:09:42.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2cd9ffb700 1 -- 172.21.15.180:0/2992157856 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2cd4012920 con 0x7f2cdc13fb20 2020-02-12T15:09:42.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.551+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cdc0aa110 con 0x7f2cdc13fb20 2020-02-12T15:09:42.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.552+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.552+0000 7f2cd9ffb700 1 -- 172.21.15.180:0/2992157856 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2cd4012a80 con 0x7f2cdc13fb20 2020-02-12T15:09:42.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.552+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.553+0000 7f2cd9ffb700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2cc0039bf0 0x7f2cc003c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:42.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.553+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cdc067ab0 con 0x7f2cdc13fb20 2020-02-12T15:09:42.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.553+0000 7f2cd9ffb700 1 -- 172.21.15.180:0/2992157856 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5915+0+0 (secure 0 0 0) 0x7f2cd4049f90 con 0x7f2cdc13fb20 2020-02-12T15:09:42.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.553+0000 7f2cdbfff700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2cc0039bf0 0x7f2cc003c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.553+0000 7f2cdbfff700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2cc0039bf0 0x7f2cc003c0b0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:42.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.556+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.556+0000 7f2cd9ffb700 1 -- 172.21.15.180:0/2992157856 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f2cd402f620 con 0x7f2cdc13fb20 2020-02-12T15:09:42.738 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.736+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true} v 0) v1 -- 0x7f2cdc0565b0 con 0x7f2cdc13fb20 2020-02-12T15:09:42.739 INFO:tasks.ceph.mon.b.smithi105.stderr:2020-02-12T15:09:42.736+0000 7f33119eb700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2020-02-12T15:09:42.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.743+0000 7f2ce0e2a700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=THROTTLE_DONE pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.743+0000 7f2cd9ffb700 1 -- 172.21.15.180:0/2992157856 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data", "force": true}]=0 new fs with metadata pool 2 and data pool 3 v2) v1 ==== 187+0+0 (secure 0 0 0) 0x7f2cd4032130 con 0x7f2cdc13fb20 2020-02-12T15:09:42.747 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.744+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2cc0039bf0 msgr2=0x7f2cc003c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.747 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.744+0000 7f2ce288d700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2cc0039bf0 0x7f2cc003c0b0 crc :-1 s=READY pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.744+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 msgr2=0x7f2cdc0999d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.744+0000 7f2ce288d700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 secure :-1 s=READY pgs=78 cs=0 l=1 rx=0x7f2cd4001450 tx=0x7f2cd4010c70).stop 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.745+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 shutdown_connections 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.745+0000 7f2ce288d700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2cc0039bf0 0x7f2cc003c0b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.745+0000 7f2ce288d700 1 --2- 172.21.15.180:0/2992157856 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2cdc13fb20 0x7f2cdc0999d0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.745+0000 7f2ce288d700 1 --2- 172.21.15.180:0/2992157856 >> v2:172.21.15.105:3300/0 conn(0x7f2cdc0a1960 0x7f2cdc149540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.745+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 >> 172.21.15.180:0/2992157856 conn(0x7f2cdc05a530 msgr2=0x7f2cdc0698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:42.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.745+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 shutdown_connections 2020-02-12T15:09:42.749 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.745+0000 7f2ce288d700 1 -- 172.21.15.180:0/2992157856 wait complete. 2020-02-12T15:09:42.749 INFO:teuthology.orchestra.run.smithi180.stderr:new fs with metadata pool 2 and data pool 3 2020-02-12T15:09:42.757 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:42.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.861+0000 7ff0fef49700 1 Processor -- start 2020-02-12T15:09:42.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.861+0000 7ff0fef49700 1 -- start start 2020-02-12T15:09:42.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fef49700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f812ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:42.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fef49700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff0f812ee90 0x7ff0f8134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:42.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fef49700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f80a3f10 con 0x7ff0f80aac00 2020-02-12T15:09:42.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fef49700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0f80a41b0 con 0x7ff0f812ee90 2020-02-12T15:09:42.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fef49700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f80a4450 con 0x7ff0f80a3990 2020-02-12T15:09:42.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff0f812ee90 0x7ff0f8134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fcce5700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7ff0f80aac00 0x7ff0f80a6520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42302/0 (socket says 172.21.15.180:42302) 2020-02-12T15:09:42.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff0f812ee90 0x7ff0f8134c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50788/0 (socket says 172.21.15.180:50788) 2020-02-12T15:09:42.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fcce5700 1 -- 172.21.15.180:0/1800617372 learned_addr learned my addr 172.21.15.180:0/1800617372 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:42.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 -- 172.21.15.180:0/1800617372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 msgr2=0x7ff0f812ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:42.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f812ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 -- 172.21.15.180:0/1800617372 >> v1:172.21.15.180:6789/0 conn(0x7ff0f80aac00 legacy=0x7ff0f80a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0f77fe700 1 -- 172.21.15.180:0/1800617372 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3166065170 0 0) 0x7ff0f80a3f10 con 0x7ff0f80aac00 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 -- 172.21.15.180:0/1800617372 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f812f320 con 0x7ff0f812ee90 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 --2- 172.21.15.180:0/1800617372 >> v2:172.21.15.180:3300/0 conn(0x7ff0f812ee90 0x7ff0f8134c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff0f00032b0 tx=0x7ff0f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 --2- 172.21.15.180:0/1800617372 >> v2:172.21.15.180:3300/0 conn(0x7ff0f812ee90 0x7ff0f8134c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff0f00032b0 tx=0x7ff0f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.862+0000 7ff0fd4e6700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff0f812ee90 0x7ff0f8134c80 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7ff0f00032b0 tx=0x7ff0f0008c60).ready entity=mon.1 client_cookie=1f294c3523efc995 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fd4e6700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff0f812ee90 0x7ff0f8134c80 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7ff0f00032b0 tx=0x7ff0f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0f77fe700 1 -- 172.21.15.180:0/1800617372 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f000a160 con 0x7ff0f812ee90 2020-02-12T15:09:42.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fd4e6700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff0f812ee90 0x7ff0f8134c80 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7ff0f00032b0 tx=0x7ff0f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0f77fe700 1 -- 172.21.15.180:0/1800617372 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f000a2c0 con 0x7ff0f812ee90 2020-02-12T15:09:42.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fd4e6700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff0f812ee90 0x7ff0f8134c80 secure :-1 s=THROTTLE_DONE pgs=80 cs=0 l=1 rx=0x7ff0f00032b0 tx=0x7ff0f0008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0f77fe700 1 -- 172.21.15.180:0/1800617372 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0f000a660 con 0x7ff0f812ee90 2020-02-12T15:09:42.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 -- 172.21.15.180:0/1800617372 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff0f812ee90 msgr2=0x7ff0f8134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff0f812ee90 0x7ff0f8134c80 secure :-1 s=READY pgs=80 cs=0 l=1 rx=0x7ff0f00032b0 tx=0x7ff0f0008c60).stop 2020-02-12T15:09:42.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 -- 172.21.15.180:0/1800617372 shutdown_connections 2020-02-12T15:09:42.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff0f812ee90 0x7ff0f8134c80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:42.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 --2- 172.21.15.180:0/1800617372 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f812ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:42.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 -- 172.21.15.180:0/1800617372 >> 172.21.15.180:0/1800617372 conn(0x7ff0f809d450 msgr2=0x7ff0f809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:42.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 -- 172.21.15.180:0/1800617372 shutdown_connections 2020-02-12T15:09:42.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.863+0000 7ff0fef49700 1 -- 172.21.15.180:0/1800617372 wait complete. 2020-02-12T15:09:42.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.864+0000 7ff0fef49700 1 Processor -- start 2020-02-12T15:09:42.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.864+0000 7ff0fef49700 1 -- start start 2020-02-12T15:09:42.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fef49700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:42.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fef49700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f8146670 con 0x7ff0f812ee90 2020-02-12T15:09:42.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fef49700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0f809e400 con 0x7ff0f80aac00 2020-02-12T15:09:42.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fef49700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0f8061100 con 0x7ff0f80a3990 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f7fff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7ff0f80aac00 0x7ff0f8146b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42308/0 (socket says 172.21.15.180:42308) 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f7fff700 1 -- 172.21.15.180:0/2166431676 learned_addr learned my addr 172.21.15.180:0/2166431676 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 531403644 0 0) 0x7ff0f809e400 con 0x7ff0f80aac00 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0d8002fe0 con 0x7ff0f80aac00 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913203572 0 0) 0x7ff0f8146670 con 0x7ff0f812ee90 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff0f809e400 con 0x7ff0f812ee90 2020-02-12T15:09:42.882 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1241638309 0 0) 0x7ff0d8002fe0 con 0x7ff0f80aac00 2020-02-12T15:09:42.883 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7ff0f8146670 con 0x7ff0f80aac00 2020-02-12T15:09:42.889 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7ff0ec0028d0 con 0x7ff0f80aac00 2020-02-12T15:09:42.889 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fcce5700 1 -- 172.21.15.180:0/2166431676 >> v1:172.21.15.180:6789/0 conn(0x7ff0f80aac00 legacy=0x7ff0f8146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.889 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fcce5700 1 -- 172.21.15.180:0/2166431676 >> v1:172.21.15.105:6789/0 conn(0x7ff0f812ee90 legacy=0x7ff0f814da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:42.889 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fcce5700 1 -- 172.21.15.180:0/2166431676 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f809e6a0 con 0x7ff0f80a3990 2020-02-12T15:09:42.889 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.890 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.890 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.865+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:42.890 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.890 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e8005a90 con 0x7ff0f80a3990 2020-02-12T15:09:42.890 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.890 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0f809e940 con 0x7ff0f80a3990 2020-02-12T15:09:42.890 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0e8005bf0 con 0x7ff0f80a3990 2020-02-12T15:09:42.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff0e80060c0 con 0x7ff0f80a3990 2020-02-12T15:09:42.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0f809e080 con 0x7ff0f80a3990 2020-02-12T15:09:42.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.866+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.867+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7ff0e800a320 con 0x7ff0f80a3990 2020-02-12T15:09:42.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.867+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0f8132550 con 0x7ff0f80a3990 2020-02-12T15:09:42.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.867+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.867+0000 7ff0f5ffb700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff0d803a340 0x7ff0d803c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:42.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.867+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff0e8049630 con 0x7ff0f80a3990 2020-02-12T15:09:42.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.867+0000 7ff0f7fff700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff0d803a340 0x7ff0d803c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:42.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.867+0000 7ff0f7fff700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff0d803a340 0x7ff0d803c800 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:42.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.871+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:42.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:42.871+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff0e802eb80 con 0x7ff0f80a3990 2020-02-12T15:09:43.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.006+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff0f809ede0 con 0x7ff0f80a3990 2020-02-12T15:09:43.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.007+0000 7ff0fcce5700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=THROTTLE_DONE pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.007+0000 7ff0f5ffb700 1 -- 172.21.15.180:0/2166431676 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14994 (secure 0 0 0) 0x7ff0f809ede0 con 0x7ff0f80a3990 2020-02-12T15:09:43.010 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:43.011 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":23,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:42.737656+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:43.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff0d803a340 msgr2=0x7ff0d803c800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff0d803a340 0x7ff0d803c800 crc :-1 s=READY pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 msgr2=0x7ff0f809f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 secure :-1 s=READY pgs=29 cs=0 l=1 rx=0x7ff0e8000b80 tx=0x7ff0e8010880).stop 2020-02-12T15:09:43.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 shutdown_connections 2020-02-12T15:09:43.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff0d803a340 0x7ff0d803c800 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 --2- 172.21.15.180:0/2166431676 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff0f80a3990 0x7ff0f809f080 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.013 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 >> 172.21.15.180:0/2166431676 conn(0x7ff0f809d450 msgr2=0x7ff0f809d830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:43.013 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 shutdown_connections 2020-02-12T15:09:43.013 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.009+0000 7ff0fef49700 1 -- 172.21.15.180:0/2166431676 wait complete. 2020-02-12T15:09:43.023 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:43.134 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.131+0000 7f5212e2c700 1 Processor -- start 2020-02-12T15:09:43.134 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.131+0000 7f5212e2c700 1 -- start start 2020-02-12T15:09:43.141 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f5212e2c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 0x7f520c1380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:43.141 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f5212e2c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f520c0a7030 0x7f520c0a74c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:43.141 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f5212e2c700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c0aaff0 con 0x7f520c0a3d10 2020-02-12T15:09:43.141 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f5212e2c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c05fe60 con 0x7f520c0a7030 2020-02-12T15:09:43.141 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f5212e2c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0aaab0 con 0x7f520c0a1c20 2020-02-12T15:09:43.141 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f520bfff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f520c0a3d10 0x7f520c0a2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42314/0 (socket says 172.21.15.180:42314) 2020-02-12T15:09:43.142 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f520bfff700 1 -- 172.21.15.180:0/1134444174 learned_addr learned my addr 172.21.15.180:0/1134444174 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:43.142 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> v2:172.21.15.105:3300/0 conn(0x7f520c0a7030 0x7f520c0a74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.142 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4122802234 0 0) 0x7f520c0aaff0 con 0x7f520c0a3d10 2020-02-12T15:09:43.142 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f5210bc8700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 0x7f520c1380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.142 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.132+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51f8003230 con 0x7f520c0a3d10 2020-02-12T15:09:43.142 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 2020000587 0 0) 0x7f51f8003230 con 0x7f520c0a3d10 2020-02-12T15:09:43.143 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 msgr2=0x7f520c1380f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:43.143 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 0x7f520c1380f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:43.143 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 >> v2:172.21.15.105:3300/0 conn(0x7f520c0a7030 msgr2=0x7f520c0a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:43.143 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 --2- 172.21.15.180:0/1134444174 >> v2:172.21.15.105:3300/0 conn(0x7f520c0a7030 0x7f520c0a74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:43.143 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c0aad50 con 0x7f520c0a3d10 2020-02-12T15:09:43.149 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f52000016d0 con 0x7f520c0a3d10 2020-02-12T15:09:43.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 >> v1:172.21.15.180:6789/0 conn(0x7f520c0a3d10 legacy=0x7f520c0a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f8003720 0x7f51f8003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:43.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 0x7f51f80044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:43.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:43.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c05fe60 con 0x7f51f8003720 2020-02-12T15:09:43.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c0aaab0 con 0x7f51f8004930 2020-02-12T15:09:43.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51f8005380 con 0x7f520c0a1c20 2020-02-12T15:09:43.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520bfff700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 0x7f51f80044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f5210bc8700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f8003720 0x7f51f8003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 -- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 msgr2=0x7f51f80044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:43.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 0x7f51f80044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:43.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 -- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f8003720 msgr2=0x7f51f8003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:43.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f51f8003720 0x7f51f8003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:43.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 -- 172.21.15.180:0/1134444174 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51f8003230 con 0x7f51f8004930 2020-02-12T15:09:43.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520bfff700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f520c0a1c20 0x7f51f80044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:43.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f52040032b0 tx=0x7f52040103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f52040032b0 tx=0x7f52040103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f52040032b0 tx=0x7f52040103d0).ready entity=mon.1 client_cookie=be6080e269dcbe7 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:43.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f52040032b0 tx=0x7f52040103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52040112b0 con 0x7f51f8004930 2020-02-12T15:09:43.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f52040032b0 tx=0x7f52040103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5204011410 con 0x7f51f8004930 2020-02-12T15:09:43.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 secure :-1 s=THROTTLE_DONE pgs=83 cs=0 l=1 rx=0x7f52040032b0 tx=0x7f52040103d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f5212e2c700 1 -- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 msgr2=0x7f51f8004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f520b7fe700 1 -- 172.21.15.180:0/1134444174 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52040117f0 con 0x7f51f8004930 2020-02-12T15:09:43.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f5212e2c700 1 --2- 172.21.15.180:0/1134444174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f51f8004930 0x7f51f8004db0 secure :-1 s=READY pgs=83 cs=0 l=1 rx=0x7f52040032b0 tx=0x7f52040103d0).stop 2020-02-12T15:09:43.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.133+0000 7f52113c9700 1 -- 172.21.15.180:0/1134444174 reap_dead start 2020-02-12T15:09:43.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.134+0000 7f5212e2c700 1 -- 172.21.15.180:0/1134444174 shutdown_connections 2020-02-12T15:09:43.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.134+0000 7f5212e2c700 1 -- 172.21.15.180:0/1134444174 >> 172.21.15.180:0/1134444174 conn(0x7f520c09d450 msgr2=0x7f520c09d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:43.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.134+0000 7f5212e2c700 1 -- 172.21.15.180:0/1134444174 shutdown_connections 2020-02-12T15:09:43.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.134+0000 7f5212e2c700 1 -- 172.21.15.180:0/1134444174 wait complete. 2020-02-12T15:09:43.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.135+0000 7f5212e2c700 1 Processor -- start 2020-02-12T15:09:43.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.135+0000 7f5212e2c700 1 -- start start 2020-02-12T15:09:43.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5212e2c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f520c132400 0x7f520c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:43.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5212e2c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f520c1307b0 0x7f520c142170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:43.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5212e2c700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f520c1342f0 con 0x7f520c12b980 2020-02-12T15:09:43.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5212e2c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c1347c0 con 0x7f520c1307b0 2020-02-12T15:09:43.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5212e2c700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f520c134a60 con 0x7f520c132400 2020-02-12T15:09:43.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5210bc8700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f520c12b980 0x7f520c131cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42326/0 (socket says 172.21.15.180:42326) 2020-02-12T15:09:43.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5210bc8700 1 -- 172.21.15.180:0/1733234999 learned_addr learned my addr 172.21.15.180:0/1733234999 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:43.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> v2:172.21.15.180:3300/0 conn(0x7f520c132400 0x7f520c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f52113c9700 1 --2- 172.21.15.180:0/1733234999 >> v2:172.21.15.105:3300/0 conn(0x7f520c1307b0 0x7f520c142170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4034363348 0 0) 0x7f520c1342f0 con 0x7f520c12b980 2020-02-12T15:09:43.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51ec002fe0 con 0x7f520c12b980 2020-02-12T15:09:43.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 -- 172.21.15.180:0/1733234999 >> v2:172.21.15.105:3300/0 conn(0x7f520c1307b0 msgr2=0x7f520c142170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> v2:172.21.15.105:3300/0 conn(0x7f520c1307b0 0x7f520c142170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 -- 172.21.15.180:0/1733234999 >> v1:172.21.15.180:6789/0 conn(0x7f520c12b980 legacy=0x7f520c131cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 -- 172.21.15.180:0/1733234999 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f520c134d00 con 0x7f520c132400 2020-02-12T15:09:43.167 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> v2:172.21.15.180:3300/0 conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.168 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> v2:172.21.15.180:3300/0 conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.168 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:43.168 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.168 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520000cb90 con 0x7f520c132400 2020-02-12T15:09:43.169 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.169 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f520000ccf0 con 0x7f520c132400 2020-02-12T15:09:43.169 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.169 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c12bd60 con 0x7f520c132400 2020-02-12T15:09:43.170 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f520000ce60 con 0x7f520c132400 2020-02-12T15:09:43.170 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.136+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c12c420 con 0x7f520c132400 2020-02-12T15:09:43.170 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.137+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.170 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.137+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f5200012860 con 0x7f520c132400 2020-02-12T15:09:43.170 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.137+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.171 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.137+0000 7f5209ffb700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51ec039f10 0x7f51ec03c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:43.171 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.137+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5200049980 con 0x7f520c132400 2020-02-12T15:09:43.171 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.137+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f520c0565b0 con 0x7f520c132400 2020-02-12T15:09:43.171 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.137+0000 7f5210bc8700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51ec039f10 0x7f51ec03c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.172 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.138+0000 7f5210bc8700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51ec039f10 0x7f51ec03c3d0 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:43.172 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.141+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.173 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.141+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f520002f050 con 0x7f520c132400 2020-02-12T15:09:43.278 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.275+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f520c05e410 con 0x7f520c132400 2020-02-12T15:09:43.279 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.276+0000 7f520bfff700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=THROTTLE_DONE pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.279 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.276+0000 7f5209ffb700 1 -- 172.21.15.180:0/1733234999 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) v1 ==== 74+0+14994 (secure 0 0 0) 0x7f5200031b60 con 0x7f520c132400 2020-02-12T15:09:43.279 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:43.279 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":23,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:42.737656+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":32773,"flags_names":"hashpspool,ec_overwrites,creating","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:43.281 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.277+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51ec039f10 msgr2=0x7f51ec03c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.281 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.277+0000 7f5212e2c700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51ec039f10 0x7f51ec03c3d0 crc :-1 s=READY pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.281 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.277+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 msgr2=0x7f520c1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.282 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.277+0000 7f5212e2c700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 secure :-1 s=READY pgs=85 cs=0 l=1 rx=0x7f52000013e0 tx=0x7f520c0a2000).stop 2020-02-12T15:09:43.282 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.278+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 shutdown_connections 2020-02-12T15:09:43.282 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.278+0000 7f5212e2c700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f51ec039f10 0x7f51ec03c3d0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.282 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.278+0000 7f5212e2c700 1 --2- 172.21.15.180:0/1733234999 >> v2:172.21.15.105:3300/0 conn(0x7f520c1307b0 0x7f520c142170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.283 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.278+0000 7f5212e2c700 1 --2- 172.21.15.180:0/1733234999 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f520c132400 0x7f520c1351a0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.283 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.278+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 >> 172.21.15.180:0/1733234999 conn(0x7f520c09d450 msgr2=0x7f520c0698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:43.283 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.278+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 shutdown_connections 2020-02-12T15:09:43.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.278+0000 7f5212e2c700 1 -- 172.21.15.180:0/1733234999 wait complete. 2020-02-12T15:09:43.293 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs set cephfs standby_count_wanted 0 2020-02-12T15:09:43.411 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.398+0000 7fb070b98700 1 Processor -- start 2020-02-12T15:09:43.411 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.398+0000 7fb070b98700 1 -- start start 2020-02-12T15:09:43.411 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb070b98700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c09b270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:43.411 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb070b98700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fb06c0a2b30 0x7fb06c0a7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:43.411 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb070b98700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0a25e0 con 0x7fb06c0a5b80 2020-02-12T15:09:43.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb070b98700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c0a3d30 con 0x7fb06c0a2b30 2020-02-12T15:09:43.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb070b98700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c0a3fd0 con 0x7fb06c0a5f60 2020-02-12T15:09:43.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c09b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c09b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50820/0 (socket says 172.21.15.180:50820) 2020-02-12T15:09:43.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 -- 172.21.15.180:0/1204420036 learned_addr learned my addr 172.21.15.180:0/1204420036 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:43.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 -- 172.21.15.180:0/1204420036 >> v2:172.21.15.105:3300/0 conn(0x7fb06c0a2b30 msgr2=0x7fb06c0a7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:43.412 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06bfff700 1 --2- 172.21.15.180:0/1204420036 >> v2:172.21.15.105:3300/0 conn(0x7fb06c0a2b30 0x7fb06c0a7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 --2- 172.21.15.180:0/1204420036 >> v2:172.21.15.105:3300/0 conn(0x7fb06c0a2b30 0x7fb06c0a7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:43.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 -- 172.21.15.180:0/1204420036 >> v1:172.21.15.105:6789/0 conn(0x7fb06c0a5b80 legacy=0x7fb06c0a6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:43.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 -- 172.21.15.180:0/1204420036 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c0a2340 con 0x7fb06c0a5f60 2020-02-12T15:09:43.413 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06bfff700 1 --2- 172.21.15.180:0/1204420036 >> v2:172.21.15.105:3300/0 conn(0x7fb06c0a2b30 0x7fb06c0a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:43.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 --2- 172.21.15.180:0/1204420036 >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c09b270 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fb06c0a1e40 tx=0x7fb060007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 --2- 172.21.15.180:0/1204420036 >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c09b270 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fb06c0a1e40 tx=0x7fb060007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.399+0000 7fb06affd700 1 --2- 172.21.15.180:0/1204420036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c09b270 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fb06c0a1e40 tx=0x7fb060007a40).ready entity=mon.1 client_cookie=a41d07c74b61ca0d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:43.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb06affd700 1 --2- 172.21.15.180:0/1204420036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c09b270 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb06c0a1e40 tx=0x7fb060007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb06a7fc700 1 -- 172.21.15.180:0/1204420036 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0600116e0 con 0x7fb06c0a5f60 2020-02-12T15:09:43.414 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb06affd700 1 --2- 172.21.15.180:0/1204420036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c09b270 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb06c0a1e40 tx=0x7fb060007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb06affd700 1 --2- 172.21.15.180:0/1204420036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c09b270 secure :-1 s=THROTTLE_DONE pgs=86 cs=0 l=1 rx=0x7fb06c0a1e40 tx=0x7fb060007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb06a7fc700 1 -- 172.21.15.180:0/1204420036 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb060011840 con 0x7fb06c0a5f60 2020-02-12T15:09:43.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb06a7fc700 1 -- 172.21.15.180:0/1204420036 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb060011c20 con 0x7fb06c0a5f60 2020-02-12T15:09:43.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 -- 172.21.15.180:0/1204420036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 msgr2=0x7fb06c09b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 --2- 172.21.15.180:0/1204420036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c09b270 secure :-1 s=READY pgs=86 cs=0 l=1 rx=0x7fb06c0a1e40 tx=0x7fb060007a40).stop 2020-02-12T15:09:43.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 -- 172.21.15.180:0/1204420036 shutdown_connections 2020-02-12T15:09:43.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 --2- 172.21.15.180:0/1204420036 >> v2:172.21.15.105:3300/0 conn(0x7fb06c0a2b30 0x7fb06c0a7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:43.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 --2- 172.21.15.180:0/1204420036 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c09b270 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:43.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 -- 172.21.15.180:0/1204420036 >> 172.21.15.180:0/1204420036 conn(0x7fb06c05a530 msgr2=0x7fb06c05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:43.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 -- 172.21.15.180:0/1204420036 shutdown_connections 2020-02-12T15:09:43.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.400+0000 7fb070b98700 1 -- 172.21.15.180:0/1204420036 wait complete. 2020-02-12T15:09:43.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.401+0000 7fb070b98700 1 Processor -- start 2020-02-12T15:09:43.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.401+0000 7fb070b98700 1 -- start start 2020-02-12T15:09:43.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb070b98700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c0a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:43.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb070b98700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c0a5090 con 0x7fb06c0a5b80 2020-02-12T15:09:43.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb070b98700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb06c064fd0 con 0x7fb06c0a2b30 2020-02-12T15:09:43.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb070b98700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb06c0a2f10 con 0x7fb06c0a5f60 2020-02-12T15:09:43.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06b7fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fb06c0a2b30 0x7fb06c064210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42338/0 (socket says 172.21.15.180:42338) 2020-02-12T15:09:43.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06b7fe700 1 -- 172.21.15.180:0/199968422 learned_addr learned my addr 172.21.15.180:0/199968422 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:43.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c0a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095146083 0 0) 0x7fb06c064fd0 con 0x7fb06c0a2b30 2020-02-12T15:09:43.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb04c002fe0 con 0x7fb06c0a2b30 2020-02-12T15:09:43.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 -- 172.21.15.180:0/199968422 >> v1:172.21.15.180:6789/0 conn(0x7fb06c0a2b30 legacy=0x7fb06c064210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 -- 172.21.15.180:0/199968422 >> v1:172.21.15.105:6789/0 conn(0x7fb06c0a5b80 legacy=0x7fb06c1464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:43.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 402792138 0 0) 0x7fb06c0a2340 con 0x7fb06c0a5b80 2020-02-12T15:09:43.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 -- 172.21.15.180:0/199968422 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c065270 con 0x7fb06c0a5f60 2020-02-12T15:09:43.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> v2:172.21.15.180:3300/0 conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:43.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb064012bb0 con 0x7fb06c0a5f60 2020-02-12T15:09:43.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb064009e90 con 0x7fb06c0a5f60 2020-02-12T15:09:43.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb06c065510 con 0x7fb06c0a5f60 2020-02-12T15:09:43.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.402+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0640091a0 con 0x7fb06c0a5f60 2020-02-12T15:09:43.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.403+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb06c0a56f0 con 0x7fb06c0a5f60 2020-02-12T15:09:43.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.403+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.403+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fb064005a40 con 0x7fb06c0a5f60 2020-02-12T15:09:43.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.403+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.403+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06c067390 con 0x7fb06c0a5f60 2020-02-12T15:09:43.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.403+0000 7fb068ff9700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fb04c039ed0 0x7fb04c03c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:43.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.404+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fb064049ca0 con 0x7fb06c0a5f60 2020-02-12T15:09:43.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.404+0000 7fb06b7fe700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fb04c039ed0 0x7fb04c03c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:43.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.404+0000 7fb06b7fe700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fb04c039ed0 0x7fb04c03c390 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:43.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.407+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:43.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.407+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fb06c067390 con 0x7fb06c0a5f60 2020-02-12T15:09:43.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:43.586+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fb06c067390 con 0x7fb06c0a5f60 2020-02-12T15:09:44.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.431+0000 7fb06bfff700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.431+0000 7fb068ff9700 1 -- 172.21.15.180:0/199968422 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v3) v1 ==== 118+0+0 (secure 0 0 0) 0x7fb06c067390 con 0x7fb06c0a5f60 2020-02-12T15:09:44.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fb04c039ed0 msgr2=0x7fb04c03c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fb04c039ed0 0x7fb04c03c390 crc :-1 s=READY pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 msgr2=0x7fb06c0a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7fb0640032b0 tx=0x7fb064010cf0).stop 2020-02-12T15:09:44.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 shutdown_connections 2020-02-12T15:09:44.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fb04c039ed0 0x7fb04c03c390 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 --2- 172.21.15.180:0/199968422 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fb06c0a5f60 0x7fb06c0a4c30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 >> 172.21.15.180:0/199968422 conn(0x7fb06c05a530 msgr2=0x7fb06c0a8820 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:44.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 shutdown_connections 2020-02-12T15:09:44.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.433+0000 7fb070b98700 1 -- 172.21.15.180:0/199968422 wait complete. 2020-02-12T15:09:44.448 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-12T15:09:44.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.557+0000 7f2e77fff700 1 Processor -- start 2020-02-12T15:09:44.559 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.557+0000 7f2e77fff700 1 -- start start 2020-02-12T15:09:44.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e77fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 0x7f2e78140480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:44.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e77fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e780a3b30 con 0x7f2e780a5fa0 2020-02-12T15:09:44.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e77fff700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e780a23b0 con 0x7f2e780a5bc0 2020-02-12T15:09:44.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e77fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780a2650 con 0x7f2e7813e090 2020-02-12T15:09:44.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e76ffd700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f2e780a5bc0 0x7f2e780a1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42346/0 (socket says 172.21.15.180:42346) 2020-02-12T15:09:44.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e76ffd700 1 -- 172.21.15.180:0/1771874687 learned_addr learned my addr 172.21.15.180:0/1771874687 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:44.567 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437131728 0 0) 0x7f2e780a23b0 con 0x7f2e780a5bc0 2020-02-12T15:09:44.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2e58003230 con 0x7f2e780a5bc0 2020-02-12T15:09:44.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 0x7f2e78140480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3637944697 0 0) 0x7f2e58003230 con 0x7f2e780a5bc0 2020-02-12T15:09:44.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 msgr2=0x7f2e78140480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:44.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 0x7f2e78140480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:44.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 >> v1:172.21.15.105:6789/0 conn(0x7f2e780a5fa0 legacy=0x7f2e7813c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.568 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e780a1b70 con 0x7f2e780a5bc0 2020-02-12T15:09:44.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f2e700016d0 con 0x7f2e780a5bc0 2020-02-12T15:09:44.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 >> v1:172.21.15.180:6789/0 conn(0x7f2e780a5bc0 legacy=0x7f2e780a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e58003750 0x7f2e58003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:44.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 0x7f2e580044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:44.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:44.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780a2650 con 0x7f2e58003750 2020-02-12T15:09:44.569 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58005330 con 0x7f2e58004930 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e58004150 con 0x7f2e7813e090 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.558+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e58003750 0x7f2e58003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e767fc700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 0x7f2e580044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 -- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 msgr2=0x7f2e580044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 0x7f2e580044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 -- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e58003750 msgr2=0x7f2e58003b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:44.570 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e58003750 0x7f2e58003b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:44.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 -- 172.21.15.180:0/1771874687 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e58003230 con 0x7f2e58004930 2020-02-12T15:09:44.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e767fc700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e7813e090 0x7f2e580044d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:44.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f2e58003750 0x7f2e58003b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:44.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f2e68002f30 tx=0x7f2e68010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f2e68002f30 tx=0x7f2e68010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f2e68002f30 tx=0x7f2e68010100).ready entity=mon.1 client_cookie=d2a764d70d0093b7 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:44.571 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f2e68002f30 tx=0x7f2e68010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f2e68002f30 tx=0x7f2e68010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e68010e10 con 0x7f2e58004930 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 secure :-1 s=THROTTLE_DONE pgs=90 cs=0 l=1 rx=0x7f2e68002f30 tx=0x7f2e68010100).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e68008950 con 0x7f2e58004930 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e75ffb700 1 -- 172.21.15.180:0/1771874687 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e68008cb0 con 0x7f2e58004930 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e77fff700 1 -- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 msgr2=0x7f2e58004db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e77fff700 1 --2- 172.21.15.180:0/1771874687 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e58004930 0x7f2e58004db0 secure :-1 s=READY pgs=90 cs=0 l=1 rx=0x7f2e68002f30 tx=0x7f2e68010100).stop 2020-02-12T15:09:44.572 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e777fe700 1 -- 172.21.15.180:0/1771874687 reap_dead start 2020-02-12T15:09:44.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.559+0000 7f2e77fff700 1 -- 172.21.15.180:0/1771874687 shutdown_connections 2020-02-12T15:09:44.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.560+0000 7f2e77fff700 1 -- 172.21.15.180:0/1771874687 >> 172.21.15.180:0/1771874687 conn(0x7f2e7805a530 msgr2=0x7f2e7805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:44.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.560+0000 7f2e77fff700 1 -- 172.21.15.180:0/1771874687 shutdown_connections 2020-02-12T15:09:44.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.560+0000 7f2e77fff700 1 -- 172.21.15.180:0/1771874687 wait complete. 2020-02-12T15:09:44.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.560+0000 7f2e77fff700 1 Processor -- start 2020-02-12T15:09:44.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.560+0000 7f2e77fff700 1 -- start start 2020-02-12T15:09:44.573 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e77fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2e781302e0 0x7f2e7809f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:44.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e77fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e78148b10 0x7f2e78124a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:44.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e77fff700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e7805ea60 con 0x7f2e78124e80 2020-02-12T15:09:44.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e77fff700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e78148fc0 con 0x7f2e781302e0 2020-02-12T15:09:44.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e77fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780a47b0 con 0x7f2e78148b10 2020-02-12T15:09:44.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f2e781302e0 0x7f2e7809f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e777fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f2e78124e80 0x7f2e781252d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42362/0 (socket says 172.21.15.180:42362) 2020-02-12T15:09:44.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e777fe700 1 -- 172.21.15.180:0/2633301843 learned_addr learned my addr 172.21.15.180:0/2633301843 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e767fc700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e78148b10 0x7f2e78124a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 -- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e78148b10 msgr2=0x7f2e78124a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e78148b10 0x7f2e78124a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 315211411 0 0) 0x7f2e7805ea60 con 0x7f2e78124e80 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 -- 172.21.15.180:0/2633301843 >> v1:172.21.15.180:6789/0 conn(0x7f2e78124e80 legacy=0x7f2e781252d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 -- 172.21.15.180:0/2633301843 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e781271b0 con 0x7f2e781302e0 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e767fc700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e78148b10 0x7f2e78124a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:44.575 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> v2:172.21.15.180:3300/0 conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> v2:172.21.15.180:3300/0 conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.561+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:44.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e7000ce00 con 0x7f2e781302e0 2020-02-12T15:09:44.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.576 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e700045b0 con 0x7f2e781302e0 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e781273e0 con 0x7f2e781302e0 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2e70004990 con 0x7f2e781302e0 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e781276b0 con 0x7f2e781302e0 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f2e70004c10 con 0x7f2e781302e0 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.562+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.563+0000 7f2e6ffff700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2e5c039aa0 0x7f2e5c03bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:44.577 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.563+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e78126920 con 0x7f2e781302e0 2020-02-12T15:09:44.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.563+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2e70049be0 con 0x7f2e781302e0 2020-02-12T15:09:44.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.563+0000 7f2e767fc700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2e5c039aa0 0x7f2e5c03bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.563+0000 7f2e767fc700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2e5c039aa0 0x7f2e5c03bf60 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:44.578 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.566+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.579 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.566+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f2e7002f090 con 0x7f2e781302e0 2020-02-12T15:09:44.747 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.745+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2e780565b0 con 0x7f2e781302e0 2020-02-12T15:09:44.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.745+0000 7f2e76ffd700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=THROTTLE_DONE pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.748 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.745+0000 7f2e6ffff700 1 -- 172.21.15.180:0/2633301843 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1420 (secure 0 0 0) 0x7f2e700100d0 con 0x7f2e781302e0 2020-02-12T15:09:44.748 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:44.748 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":3,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[],"filesystems":[{"mdsmap":{"epoch":3,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-12T15:09:42.737856+0000","modified":"2020-02-12T15:09:44.427243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[],"up":{},"failed":[],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-12T15:09:44.749 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2e5c039aa0 msgr2=0x7f2e5c03bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.749 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2e5c039aa0 0x7f2e5c03bf60 crc :-1 s=READY pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.749 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 msgr2=0x7f2e7809f350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.750 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 secure :-1 s=READY pgs=92 cs=0 l=1 rx=0x7f2e700013e0 tx=0x7f2e780a1d00).stop 2020-02-12T15:09:44.750 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 shutdown_connections 2020-02-12T15:09:44.750 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2e5c039aa0 0x7f2e5c03bf60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.750 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f2e781302e0 0x7f2e7809f350 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.750 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 --2- 172.21.15.180:0/2633301843 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f2e78148b10 0x7f2e78124a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.751 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 >> 172.21.15.180:0/2633301843 conn(0x7f2e7805a530 msgr2=0x7f2e780a7030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:44.751 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 shutdown_connections 2020-02-12T15:09:44.751 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.747+0000 7f2e77fff700 1 -- 172.21.15.180:0/2633301843 wait complete. 2020-02-12T15:09:44.751 INFO:teuthology.orchestra.run.smithi180.stderr:dumped fsmap epoch 3 2020-02-12T15:09:44.759 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:44.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.862+0000 7fae46467700 1 Processor -- start 2020-02-12T15:09:44.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.863+0000 7fae46467700 1 -- start start 2020-02-12T15:09:44.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.863+0000 7fae46467700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:44.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.863+0000 7fae46467700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fae400a49e0 0x7fae400a4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:44.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.863+0000 7fae46467700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae400a3b20 con 0x7fae40137da0 2020-02-12T15:09:44.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.863+0000 7fae46467700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae4005b500 con 0x7fae400a49e0 2020-02-12T15:09:44.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.863+0000 7fae46467700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae400a52c0 con 0x7fae400a77c0 2020-02-12T15:09:44.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae44c64700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fae400a49e0 0x7fae400a4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45c66700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7fae40137da0 0x7fae40138230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.180:36944/0 (socket says 172.21.15.180:36944) 2020-02-12T15:09:44.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45c66700 1 -- 172.21.15.180:0/4217465784 learned_addr learned my addr 172.21.15.180:0/4217465784 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:44.869 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 -- 172.21.15.180:0/4217465784 >> v2:172.21.15.105:3300/0 conn(0x7fae400a49e0 msgr2=0x7fae400a4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:44.869 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- 172.21.15.180:0/4217465784 >> v2:172.21.15.105:3300/0 conn(0x7fae400a49e0 0x7fae400a4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:44.869 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 -- 172.21.15.180:0/4217465784 >> v1:172.21.15.105:6789/0 conn(0x7fae40137da0 legacy=0x7fae40138230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.869 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 -- 172.21.15.180:0/4217465784 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae400a3dc0 con 0x7fae400a77c0 2020-02-12T15:09:44.869 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae3c002f30 tx=0x7fae3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.869 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae3c002f30 tx=0x7fae3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.869 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae3c0088e0).ready entity=mon.2 client_cookie=f4edc7b2f9f0201d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:44.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae33fff700 1 -- 172.21.15.180:0/4217465784 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c008e40 con 0x7fae400a77c0 2020-02-12T15:09:44.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae33fff700 1 -- 172.21.15.180:0/4217465784 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c0115f0 con 0x7fae400a77c0 2020-02-12T15:09:44.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae45465700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 secure :-1 s=THROTTLE_DONE pgs=30 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae3c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.870 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae33fff700 1 -- 172.21.15.180:0/4217465784 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c0119d0 con 0x7fae400a77c0 2020-02-12T15:09:44.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae46467700 1 -- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 msgr2=0x7fae400a6230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.864+0000 7fae46467700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 secure :-1 s=READY pgs=30 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae3c0088e0).stop 2020-02-12T15:09:44.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.865+0000 7fae46467700 1 -- 172.21.15.180:0/4217465784 shutdown_connections 2020-02-12T15:09:44.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.865+0000 7fae46467700 1 --2- 172.21.15.180:0/4217465784 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a77c0 0x7fae400a6230 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:44.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.865+0000 7fae46467700 1 --2- 172.21.15.180:0/4217465784 >> v2:172.21.15.105:3300/0 conn(0x7fae400a49e0 0x7fae400a4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:44.871 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.865+0000 7fae46467700 1 -- 172.21.15.180:0/4217465784 >> 172.21.15.180:0/4217465784 conn(0x7fae4005a530 msgr2=0x7fae4005a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:44.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.865+0000 7fae46467700 1 -- 172.21.15.180:0/4217465784 shutdown_connections 2020-02-12T15:09:44.872 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.865+0000 7fae46467700 1 -- 172.21.15.180:0/4217465784 wait complete. 2020-02-12T15:09:44.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae46467700 1 Processor -- start 2020-02-12T15:09:44.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae46467700 1 -- start start 2020-02-12T15:09:44.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae46467700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:44.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae46467700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae401332a0 con 0x7fae40137da0 2020-02-12T15:09:44.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae46467700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae4009d650 con 0x7fae400a77c0 2020-02-12T15:09:44.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae46467700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae4009a3b0 con 0x7fae400a49e0 2020-02-12T15:09:44.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae44c64700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fae400a77c0 0x7fae40133660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42372/0 (socket says 172.21.15.180:42372) 2020-02-12T15:09:44.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae44c64700 1 -- 172.21.15.180:0/2789650946 learned_addr learned my addr 172.21.15.180:0/2789650946 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:44.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.866+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2109040820 0 0) 0x7fae4009d650 con 0x7fae400a77c0 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae20002fe0 con 0x7fae400a77c0 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 965977298 0 0) 0x7fae401332a0 con 0x7fae40137da0 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fae4009d650 con 0x7fae40137da0 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 -- 172.21.15.180:0/2789650946 >> v1:172.21.15.180:6789/0 conn(0x7fae400a77c0 legacy=0x7fae40133660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 -- 172.21.15.180:0/2789650946 >> v1:172.21.15.105:6789/0 conn(0x7fae40137da0 legacy=0x7fae40148aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 -- 172.21.15.180:0/2789650946 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae40131c00 con 0x7fae400a49e0 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.877 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.878 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:44.878 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.878 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c011880 con 0x7fae400a49e0 2020-02-12T15:09:44.878 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.878 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae3c0119e0 con 0x7fae400a49e0 2020-02-12T15:09:44.878 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae40131ea0 con 0x7fae400a49e0 2020-02-12T15:09:44.878 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae3c007340 con 0x7fae400a49e0 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.867+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae40066620 con 0x7fae400a49e0 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.868+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.868+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fae3c0056c0 con 0x7fae400a49e0 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.868+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.868+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae401320a0 con 0x7fae400a49e0 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.868+0000 7fae327fc700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fae2003a010 0x7fae2003c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:44.879 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.868+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fae3c049d80 con 0x7fae400a49e0 2020-02-12T15:09:44.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.868+0000 7fae44c64700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fae2003a010 0x7fae2003c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:44.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.869+0000 7fae44c64700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fae2003a010 0x7fae2003c4d0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:44.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.872+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:44.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:44.872+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fae401320a0 con 0x7fae400a49e0 2020-02-12T15:09:45.011 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.008+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae401320a0 con 0x7fae400a49e0 2020-02-12T15:09:45.012 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.010+0000 7fae45465700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=THROTTLE_DONE pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.013 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.010+0000 7fae327fc700 1 -- 172.21.15.180:0/2789650946 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14981 (secure 0 0 0) 0x7fae401320a0 con 0x7fae400a49e0 2020-02-12T15:09:45.014 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:45.015 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":24,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:43.739063+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:45.016 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fae2003a010 msgr2=0x7fae2003c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.016 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fae2003a010 0x7fae2003c4d0 crc :-1 s=READY pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.017 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 msgr2=0x7fae4009d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.017 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 secure :-1 s=READY pgs=31 cs=0 l=1 rx=0x7fae3c002f30 tx=0x7fae400a2b30).stop 2020-02-12T15:09:45.017 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 shutdown_connections 2020-02-12T15:09:45.017 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fae2003a010 0x7fae2003c4d0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.017 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 --2- 172.21.15.180:0/2789650946 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae400a49e0 0x7fae4009d140 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.018 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 >> 172.21.15.180:0/2789650946 conn(0x7fae4005a530 msgr2=0x7fae400a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.018 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 shutdown_connections 2020-02-12T15:09:45.018 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.011+0000 7fae46467700 1 -- 172.21.15.180:0/2789650946 wait complete. 2020-02-12T15:09:45.026 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2020-02-12T15:09:45.026 INFO:tasks.ceph.mds.a:Restarting daemon 2020-02-12T15:09:45.027 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2020-02-12T15:09:45.029 INFO:tasks.ceph.mds.a:Started 2020-02-12T15:09:45.029 INFO:tasks.ceph.mds.b:Restarting daemon 2020-02-12T15:09:45.030 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2020-02-12T15:09:45.032 INFO:tasks.ceph.mds.b:Started 2020-02-12T15:09:45.033 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:45.033 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2020-02-12T15:09:45.104 INFO:tasks.ceph.mds.a.smithi180.stdout:starting mds.a at 2020-02-12T15:09:45.117 INFO:tasks.ceph.mds.b.smithi105.stdout:starting mds.b at 2020-02-12T15:09:45.143 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f27fe700 1 Processor -- start 2020-02-12T15:09:45.143 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f27fe700 1 -- start start 2020-02-12T15:09:45.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f27fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f42ec0a8660 0x7f42ec0656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f27fe700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec138130 con 0x7f42ec138b10 2020-02-12T15:09:45.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f27fe700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec1383d0 con 0x7f42ec0ab130 2020-02-12T15:09:45.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f27fe700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42ec138670 con 0x7f42ec0a8660 2020-02-12T15:09:45.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42ebfff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f42ec0a8660 0x7f42ec0656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f0d9b700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f42ec0ab130 0x7f42ec0ab5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42394/0 (socket says 172.21.15.180:42394) 2020-02-12T15:09:45.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42ebfff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f42ec0a8660 0x7f42ec0656f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50876/0 (socket says 172.21.15.180:50876) 2020-02-12T15:09:45.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.141+0000 7f42f0d9b700 1 -- 172.21.15.180:0/309654732 learned_addr learned my addr 172.21.15.180:0/309654732 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:45.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 -- 172.21.15.180:0/309654732 >> v1:172.21.15.180:6789/0 conn(0x7f42ec0ab130 legacy=0x7f42ec0ab5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 -- 172.21.15.180:0/309654732 >> v1:172.21.15.105:6789/0 conn(0x7f42ec138b10 legacy=0x7f42ec0a8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42eaffd700 1 -- 172.21.15.180:0/309654732 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257719919 0 0) 0x7f42ec1383d0 con 0x7f42ec0ab130 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 -- 172.21.15.180:0/309654732 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec0abcf0 con 0x7f42ec0a8660 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 --2- 172.21.15.180:0/309654732 >> v2:172.21.15.180:3300/0 conn(0x7f42ec0a8660 0x7f42ec0656f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f42dc002f30 tx=0x7f42dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 --2- 172.21.15.180:0/309654732 >> v2:172.21.15.180:3300/0 conn(0x7f42ec0a8660 0x7f42ec0656f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f42dc002f30 tx=0x7f42dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 --2- 172.21.15.180:0/309654732 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f42ec0a8660 0x7f42ec0656f0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f42dc002f30 tx=0x7f42dc0088e0).ready entity=mon.1 client_cookie=939f260f1c7d104d server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 --2- 172.21.15.180:0/309654732 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f42ec0a8660 0x7f42ec0656f0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f42dc002f30 tx=0x7f42dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42eaffd700 1 -- 172.21.15.180:0/309654732 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42dc008e40 con 0x7f42ec0a8660 2020-02-12T15:09:45.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 --2- 172.21.15.180:0/309654732 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f42ec0a8660 0x7f42ec0656f0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f42dc002f30 tx=0x7f42dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42eaffd700 1 -- 172.21.15.180:0/309654732 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42dc0116a0 con 0x7f42ec0a8660 2020-02-12T15:09:45.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42ebfff700 1 --2- 172.21.15.180:0/309654732 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f42ec0a8660 0x7f42ec0656f0 secure :-1 s=THROTTLE_DONE pgs=98 cs=0 l=1 rx=0x7f42dc002f30 tx=0x7f42dc0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42f27fe700 1 -- 172.21.15.180:0/309654732 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f42ec0a8660 msgr2=0x7f42ec0656f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42f27fe700 1 --2- 172.21.15.180:0/309654732 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f42ec0a8660 0x7f42ec0656f0 secure :-1 s=READY pgs=98 cs=0 l=1 rx=0x7f42dc002f30 tx=0x7f42dc0088e0).stop 2020-02-12T15:09:45.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42eaffd700 1 -- 172.21.15.180:0/309654732 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42dc011a80 con 0x7f42ec0a8660 2020-02-12T15:09:45.155 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42f27fe700 1 -- 172.21.15.180:0/309654732 shutdown_connections 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.142+0000 7f42f27fe700 1 --2- 172.21.15.180:0/309654732 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f42ec0a8660 0x7f42ec0656f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.143+0000 7f42f27fe700 1 -- 172.21.15.180:0/309654732 >> 172.21.15.180:0/309654732 conn(0x7f42ec05e910 msgr2=0x7f42ec05ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.143+0000 7f42f27fe700 1 -- 172.21.15.180:0/309654732 shutdown_connections 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.143+0000 7f42f27fe700 1 -- 172.21.15.180:0/309654732 wait complete. 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.143+0000 7f42f27fe700 1 Processor -- start 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.143+0000 7f42f27fe700 1 -- start start 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42f27fe700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.156 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42f27fe700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec0a5230 con 0x7f42ec0ab130 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42f27fe700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42ec13bfa0 con 0x7f42ec0a8660 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42f27fe700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42ec134d50 con 0x7f42ec138b10 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42ebfff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f42ec0a8660 0x7f42ec0a4570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42396/0 (socket says 172.21.15.180:42396) 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42ebfff700 1 -- 172.21.15.180:0/3691969955 learned_addr learned my addr 172.21.15.180:0/3691969955 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 17765431 0 0) 0x7f42ec13bfa0 con 0x7f42ec0a8660 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42cc002fe0 con 0x7f42ec0a8660 2020-02-12T15:09:45.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2892640026 0 0) 0x7f42ec0a5230 con 0x7f42ec0ab130 2020-02-12T15:09:45.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.144+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42ec13bfa0 con 0x7f42ec0ab130 2020-02-12T15:09:45.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 112101869 0 0) 0x7f42cc002fe0 con 0x7f42ec0a8660 2020-02-12T15:09:45.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f42ec0a5230 con 0x7f42ec0a8660 2020-02-12T15:09:45.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f42dc008e40 con 0x7f42ec0a8660 2020-02-12T15:09:45.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 -- 172.21.15.180:0/3691969955 >> v1:172.21.15.180:6789/0 conn(0x7f42ec0a8660 legacy=0x7f42ec0a4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 -- 172.21.15.180:0/3691969955 >> v1:172.21.15.105:6789/0 conn(0x7f42ec0ab130 legacy=0x7f42ec14df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 -- 172.21.15.180:0/3691969955 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42ec133200 con 0x7f42ec138b10 2020-02-12T15:09:45.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e4005e10 con 0x7f42ec138b10 2020-02-12T15:09:45.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e4012150 con 0x7f42ec138b10 2020-02-12T15:09:45.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42e40124f0 con 0x7f42ec138b10 2020-02-12T15:09:45.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42ec1334a0 con 0x7f42ec138b10 2020-02-12T15:09:45.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42ec09e060 con 0x7f42ec138b10 2020-02-12T15:09:45.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.145+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.146+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f42e4012760 con 0x7f42ec138b10 2020-02-12T15:09:45.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.146+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.146+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42ec133630 con 0x7f42ec138b10 2020-02-12T15:09:45.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.146+0000 7f42e97fa700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f42cc03a2b0 0x7f42cc03c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.146+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f42e40498a0 con 0x7f42ec138b10 2020-02-12T15:09:45.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.146+0000 7f42ebfff700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f42cc03a2b0 0x7f42cc03c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.146+0000 7f42ebfff700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f42cc03a2b0 0x7f42cc03c770 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.150+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.162 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.150+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f42e402eeb0 con 0x7f42ec138b10 2020-02-12T15:09:45.286 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.283+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f42ec0565b0 con 0x7f42ec138b10 2020-02-12T15:09:45.287 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.284+0000 7f42f0d9b700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=THROTTLE_DONE pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.287 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.284+0000 7f42e97fa700 1 -- 172.21.15.180:0/3691969955 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14981 (secure 0 0 0) 0x7f42e4031980 con 0x7f42ec138b10 2020-02-12T15:09:45.287 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:45.287 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":24,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:43.739063+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:45.289 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f42cc03a2b0 msgr2=0x7f42cc03c770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.289 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f42cc03a2b0 0x7f42cc03c770 crc :-1 s=READY pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.289 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 msgr2=0x7f42ec0a4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 secure :-1 s=READY pgs=35 cs=0 l=1 rx=0x7f42e4000f00 tx=0x7f42e4010b60).stop 2020-02-12T15:09:45.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 shutdown_connections 2020-02-12T15:09:45.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f42cc03a2b0 0x7f42cc03c770 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 --2- 172.21.15.180:0/3691969955 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f42ec138b10 0x7f42ec0a4c80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 >> 172.21.15.180:0/3691969955 conn(0x7f42ec05e910 msgr2=0x7f42ec0698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.291 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 shutdown_connections 2020-02-12T15:09:45.291 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.286+0000 7f42f27fe700 1 -- 172.21.15.180:0/3691969955 wait complete. 2020-02-12T15:09:45.300 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:34.556683+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:37.409320+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:40.417450+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T15:09:45.300 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T15:09:45.367 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:45.387 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:09:45.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.408+0000 7fdfd389a700 1 Processor -- start 2020-02-12T15:09:45.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.408+0000 7fdfd389a700 1 -- start start 2020-02-12T15:09:45.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd389a700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc0a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd389a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc09e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd389a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdfcc09e790 0x7fdfcc131c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd389a700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc065a60 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd389a700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc065d00 con 0x7fdfcc09e790 2020-02-12T15:09:45.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd389a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc09ec40 con 0x7fdfcc0a9e00 2020-02-12T15:09:45.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdfcc09e790 0x7fdfcc131c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdfcc09e790 0x7fdfcc131c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50894/0 (socket says 172.21.15.180:50894) 2020-02-12T15:09:45.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 -- 172.21.15.180:0/1483695174 learned_addr learned my addr 172.21.15.180:0/1483695174 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:45.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1636700 1 --2- 172.21.15.180:0/1483695174 >> v2:172.21.15.105:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc0a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd0e35700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc09e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 -- 172.21.15.180:0/1483695174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 msgr2=0x7fdfcc09e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:45.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc09e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 -- 172.21.15.180:0/1483695174 >> v2:172.21.15.105:3300/0 conn(0x7fdfcc05f3a0 msgr2=0x7fdfcc0a99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:45.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> v2:172.21.15.105:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc0a99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 -- 172.21.15.180:0/1483695174 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0a8f90 con 0x7fdfcc09e790 2020-02-12T15:09:45.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> v2:172.21.15.180:3300/0 conn(0x7fdfcc09e790 0x7fdfcc131c20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdfc40032b0 tx=0x7fdfc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> v2:172.21.15.180:3300/0 conn(0x7fdfcc09e790 0x7fdfcc131c20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdfc40032b0 tx=0x7fdfc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc09e790 0x7fdfcc131c20 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fdfc40032b0 tx=0x7fdfc4007dc0).ready entity=mon.1 client_cookie=2b02f571f274f85f server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.409+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc09e790 0x7fdfcc131c20 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fdfc40032b0 tx=0x7fdfc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc09e790 0x7fdfcc131c20 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fdfc40032b0 tx=0x7fdfc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfbbfff700 1 -- 172.21.15.180:0/1483695174 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc4011e30 con 0x7fdfcc09e790 2020-02-12T15:09:45.435 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc09e790 0x7fdfcc131c20 secure :-1 s=THROTTLE_DONE pgs=100 cs=0 l=1 rx=0x7fdfc40032b0 tx=0x7fdfc4007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.435 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfbbfff700 1 -- 172.21.15.180:0/1483695174 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc400a160 con 0x7fdfcc09e790 2020-02-12T15:09:45.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfbbfff700 1 -- 172.21.15.180:0/1483695174 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc400a540 con 0x7fdfcc09e790 2020-02-12T15:09:45.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 -- 172.21.15.180:0/1483695174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc09e790 msgr2=0x7fdfcc131c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc09e790 0x7fdfcc131c20 secure :-1 s=READY pgs=100 cs=0 l=1 rx=0x7fdfc40032b0 tx=0x7fdfc4007dc0).stop 2020-02-12T15:09:45.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 -- 172.21.15.180:0/1483695174 shutdown_connections 2020-02-12T15:09:45.437 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc09e790 0x7fdfcc131c20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.438 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 --2- 172.21.15.180:0/1483695174 >> v2:172.21.15.105:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc0a99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.439 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 --2- 172.21.15.180:0/1483695174 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc09e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.439 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 -- 172.21.15.180:0/1483695174 >> 172.21.15.180:0/1483695174 conn(0x7fdfcc05a880 msgr2=0x7fdfcc05e910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.439 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 -- 172.21.15.180:0/1483695174 shutdown_connections 2020-02-12T15:09:45.439 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.410+0000 7fdfd389a700 1 -- 172.21.15.180:0/1483695174 wait complete. 2020-02-12T15:09:45.439 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.411+0000 7fdfd389a700 1 Processor -- start 2020-02-12T15:09:45.439 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.411+0000 7fdfd389a700 1 -- start start 2020-02-12T15:09:45.439 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd389a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc137870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.440 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd389a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc13aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.440 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd389a700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfcc139240 con 0x7fdfcc09e790 2020-02-12T15:09:45.440 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd389a700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfcc13a830 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.440 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd389a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfcc1394e0 con 0x7fdfcc0a9e00 2020-02-12T15:09:45.440 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc137870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.440 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd0e35700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fdfcc09e790 0x7fdfcc12e9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42412/0 (socket says 172.21.15.180:42412) 2020-02-12T15:09:45.440 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc137870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50896/0 (socket says 172.21.15.180:50896) 2020-02-12T15:09:45.444 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd0e35700 1 -- 172.21.15.180:0/930789560 learned_addr learned my addr 172.21.15.180:0/930789560 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:45.444 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1e37700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc13aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.444 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 -- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 msgr2=0x7fdfcc13aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.444 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc13aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.444 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 -- 172.21.15.180:0/930789560 >> v1:172.21.15.180:6789/0 conn(0x7fdfcc09e790 legacy=0x7fdfcc12e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.444 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2696915608 0 0) 0x7fdfcc139240 con 0x7fdfcc09e790 2020-02-12T15:09:45.444 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 -- 172.21.15.180:0/930789560 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfcc0670b0 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.445 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> v2:172.21.15.180:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.445 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> v2:172.21.15.180:3300/0 conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.446 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.446 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.412+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.446 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc8007530 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.446 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.446 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.447 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc80056c0 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.447 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfcc139780 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.447 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc8005aa0 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.447 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfcc12f0d0 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.447 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.447 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fdfc8013060 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.447 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.413+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.414+0000 7fdfba7fc700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdfac039a80 0x7fdfac03bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.414+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdfc800d0c0 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.414+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfcc0565b0 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.414+0000 7fdfd0e35700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdfac039a80 0x7fdfac03bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.414+0000 7fdfd0e35700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdfac039a80 0x7fdfac03bf40 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.417+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.417+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdfc802ef90 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.560+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdfcc05e360 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.561+0000 7fdfd1636700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=THROTTLE_DONE pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.561+0000 7fdfba7fc700 1 -- 172.21.15.180:0/930789560 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdfc8031a40 con 0x7fdfcc05f3a0 2020-02-12T15:09:45.563 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:45.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdfac039a80 msgr2=0x7fdfac03bf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdfac039a80 0x7fdfac03bf40 crc :-1 s=READY pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 msgr2=0x7fdfcc137870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 secure :-1 s=READY pgs=102 cs=0 l=1 rx=0x7fdfc8002f30 tx=0x7fdfc8010bc0).stop 2020-02-12T15:09:45.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 shutdown_connections 2020-02-12T15:09:45.565 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdfac039a80 0x7fdfac03bf40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdfcc05f3a0 0x7fdfcc137870 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 --2- 172.21.15.180:0/930789560 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdfcc0a9e00 0x7fdfcc13aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 >> 172.21.15.180:0/930789560 conn(0x7fdfcc05a880 msgr2=0x7fdfcc0ade60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 shutdown_connections 2020-02-12T15:09:45.566 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.562+0000 7fdfd389a700 1 -- 172.21.15.180:0/930789560 wait complete. 2020-02-12T15:09:45.575 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-12T15:09:45.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.680+0000 7facda83c700 1 Processor -- start 2020-02-12T15:09:45.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.680+0000 7facda83c700 1 -- start start 2020-02-12T15:09:45.685 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.680+0000 7facda83c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7facd40a15e0 0x7facd40a5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.685 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.680+0000 7facda83c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd4131ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.686 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.680+0000 7facda83c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd40a22f0 con 0x7facd40a2e40 2020-02-12T15:09:45.686 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.680+0000 7facda83c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40a2590 con 0x7facd40a15e0 2020-02-12T15:09:45.686 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.680+0000 7facda83c700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40a2830 con 0x7facd4131a40 2020-02-12T15:09:45.686 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd4131ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.686 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd4131ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50910/0 (socket says 172.21.15.180:50910) 2020-02-12T15:09:45.686 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 -- 172.21.15.180:0/489835517 learned_addr learned my addr 172.21.15.180:0/489835517 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:45.687 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd37fe700 1 --2- 172.21.15.180:0/489835517 >> v2:172.21.15.105:3300/0 conn(0x7facd40a15e0 0x7facd40a5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.687 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 -- 172.21.15.180:0/489835517 >> v2:172.21.15.105:3300/0 conn(0x7facd40a15e0 msgr2=0x7facd40a5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:45.687 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- 172.21.15.180:0/489835517 >> v2:172.21.15.105:3300/0 conn(0x7facd40a15e0 0x7facd40a5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.687 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 -- 172.21.15.180:0/489835517 >> v1:172.21.15.105:6789/0 conn(0x7facd40a2e40 legacy=0x7facd40a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:45.687 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 -- 172.21.15.180:0/489835517 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd40a63b0 con 0x7facd4131a40 2020-02-12T15:09:45.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- 172.21.15.180:0/489835517 >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd4131ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- 172.21.15.180:0/489835517 >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd4131ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- 172.21.15.180:0/489835517 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd4131ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).ready entity=mon.1 client_cookie=dab612fe645d29e6 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- 172.21.15.180:0/489835517 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd4131ea0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd2ffd700 1 -- 172.21.15.180:0/489835517 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc00a160 con 0x7facd4131a40 2020-02-12T15:09:45.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- 172.21.15.180:0/489835517 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd4131ea0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.688 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd8dd9700 1 --2- 172.21.15.180:0/489835517 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd4131ea0 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.689 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd2ffd700 1 -- 172.21.15.180:0/489835517 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc00a2c0 con 0x7facd4131a40 2020-02-12T15:09:45.689 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facd2ffd700 1 -- 172.21.15.180:0/489835517 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc00a6a0 con 0x7facd4131a40 2020-02-12T15:09:45.689 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facda83c700 1 -- 172.21.15.180:0/489835517 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 msgr2=0x7facd4131ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.689 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.681+0000 7facda83c700 1 --2- 172.21.15.180:0/489835517 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd4131ea0 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).stop 2020-02-12T15:09:45.689 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.682+0000 7facda83c700 1 -- 172.21.15.180:0/489835517 shutdown_connections 2020-02-12T15:09:45.689 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.682+0000 7facda83c700 1 --2- 172.21.15.180:0/489835517 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd4131ea0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.689 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.682+0000 7facda83c700 1 --2- 172.21.15.180:0/489835517 >> v2:172.21.15.105:3300/0 conn(0x7facd40a15e0 0x7facd40a5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.690 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.682+0000 7facda83c700 1 -- 172.21.15.180:0/489835517 >> 172.21.15.180:0/489835517 conn(0x7facd405a530 msgr2=0x7facd405a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.690 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.682+0000 7facda83c700 1 -- 172.21.15.180:0/489835517 shutdown_connections 2020-02-12T15:09:45.690 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.682+0000 7facda83c700 1 -- 172.21.15.180:0/489835517 wait complete. 2020-02-12T15:09:45.690 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.683+0000 7facda83c700 1 Processor -- start 2020-02-12T15:09:45.690 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.683+0000 7facda83c700 1 -- start start 2020-02-12T15:09:45.693 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facda83c700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7facd40a2e40 0x7facd4063520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.693 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facda83c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd41422a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.694 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facda83c700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7facd4063980 con 0x7facd40a15e0 2020-02-12T15:09:45.694 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facda83c700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd4066f10 con 0x7facd40a2e40 2020-02-12T15:09:45.694 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facda83c700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facd40a61b0 con 0x7facd4131a40 2020-02-12T15:09:45.694 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facd8dd9700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd41422a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.694 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facd8dd9700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd41422a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50914/0 (socket says 172.21.15.180:50914) 2020-02-12T15:09:45.694 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facd8dd9700 1 -- 172.21.15.180:0/2548940881 learned_addr learned my addr 172.21.15.180:0/2548940881 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:45.694 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facd3fff700 1 --1- 172.21.15.180:0/2548940881 >> v1:172.21.15.180:6789/0 conn(0x7facd40a15e0 0x7facd4066800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42426/0 (socket says 172.21.15.180:42426) 2020-02-12T15:09:45.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.684+0000 7facd37fe700 1 --2- 172.21.15.180:0/2548940881 >> v2:172.21.15.105:3300/0 conn(0x7facd40a2e40 0x7facd4063520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 -- 172.21.15.180:0/2548940881 >> v2:172.21.15.105:3300/0 conn(0x7facd40a2e40 msgr2=0x7facd4063520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> v2:172.21.15.105:3300/0 conn(0x7facd40a2e40 0x7facd4063520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 -- 172.21.15.180:0/2548940881 >> v1:172.21.15.180:6789/0 conn(0x7facd40a15e0 legacy=0x7facd4066800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417001262 0 0) 0x7facc4002010 con 0x7facd40a15e0 2020-02-12T15:09:45.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 -- 172.21.15.180:0/2548940881 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facd4063090 con 0x7facd4131a40 2020-02-12T15:09:45.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> v2:172.21.15.180:3300/0 conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc00a760 con 0x7facd4131a40 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faccc005c30 con 0x7facd4131a40 2020-02-12T15:09:45.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd40650a0 con 0x7facd4131a40 2020-02-12T15:09:45.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faccc007150 con 0x7facd4131a40 2020-02-12T15:09:45.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd412fcb0 con 0x7facd4131a40 2020-02-12T15:09:45.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.685+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.686+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7faccc0073c0 con 0x7facd4131a40 2020-02-12T15:09:45.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.686+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.698 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.686+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd4067a70 con 0x7facd4131a40 2020-02-12T15:09:45.698 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.686+0000 7facd17fa700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7facb4039ad0 0x7facb403bf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.698 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.686+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7faccc04a770 con 0x7facd4131a40 2020-02-12T15:09:45.698 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.686+0000 7facd3fff700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7facb4039ad0 0x7facb403bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.698 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.686+0000 7facd3fff700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7facb4039ad0 0x7facb403bf90 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.698 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.689+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.699 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.689+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7faccc02fe60 con 0x7facd4131a40 2020-02-12T15:09:45.827 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.824+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7facd40565b0 con 0x7facd4131a40 2020-02-12T15:09:45.827 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.825+0000 7facd8dd9700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=THROTTLE_DONE pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.827 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.825+0000 7facd17fa700 1 -- 172.21.15.180:0/2548940881 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7faccc032970 con 0x7facd4131a40 2020-02-12T15:09:45.828 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:45.829 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7facb4039ad0 msgr2=0x7facb403bf90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.829 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7facb4039ad0 0x7facb403bf90 crc :-1 s=READY pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.829 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 msgr2=0x7facd41422a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.829 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 secure :-1 s=READY pgs=105 cs=0 l=1 rx=0x7facd40a3af0 tx=0x7faccc007dc0).stop 2020-02-12T15:09:45.829 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 shutdown_connections 2020-02-12T15:09:45.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7facb4039ad0 0x7facb403bf90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 --2- 172.21.15.180:0/2548940881 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7facd4131a40 0x7facd41422a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 --2- 172.21.15.180:0/2548940881 >> v2:172.21.15.105:3300/0 conn(0x7facd40a2e40 0x7facd4063520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 >> 172.21.15.180:0/2548940881 conn(0x7facd405a530 msgr2=0x7facd40698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 shutdown_connections 2020-02-12T15:09:45.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.826+0000 7facda83c700 1 -- 172.21.15.180:0/2548940881 wait complete. 2020-02-12T15:09:45.839 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-12T15:09:45.947 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.945+0000 7f83f3f00700 1 Processor -- start 2020-02-12T15:09:45.947 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.945+0000 7f83f3f00700 1 -- start start 2020-02-12T15:09:45.956 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.945+0000 7f83f3f00700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec0a2130 0x7f83ec134870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.956 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.945+0000 7f83f3f00700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a2590 0x7f83ec134cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:45.956 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.945+0000 7f83f3f00700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83ec0a4490 con 0x7f83ec0a7920 2020-02-12T15:09:45.956 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.945+0000 7f83f3f00700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec0a1c90 con 0x7f83ec0a2590 2020-02-12T15:09:45.957 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.945+0000 7f83f3f00700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec134490 con 0x7f83ec0a2130 2020-02-12T15:09:45.957 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a2590 0x7f83ec134cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.957 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f149b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec0a2130 0x7f83ec134870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.957 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f149b700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec0a2130 0x7f83ec134870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.180:51066/0 (socket says 172.21.15.180:51066) 2020-02-12T15:09:45.958 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f149b700 1 -- 172.21.15.180:0/680917632 learned_addr learned my addr 172.21.15.180:0/680917632 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:45.958 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f1c9c700 1 --1- 172.21.15.180:0/680917632 >> v1:172.21.15.105:6789/0 conn(0x7f83ec0a7920 0x7f83ec0a3bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.180:37012/0 (socket says 172.21.15.180:37012) 2020-02-12T15:09:45.958 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 -- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec0a2130 msgr2=0x7f83ec134870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:45.958 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec0a2130 0x7f83ec134870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.958 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 -- 172.21.15.180:0/680917632 >> v1:172.21.15.105:6789/0 conn(0x7f83ec0a7920 legacy=0x7f83ec0a3bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.959 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 -- 172.21.15.180:0/680917632 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec134600 con 0x7f83ec0a2590 2020-02-12T15:09:45.959 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f0c9a700 1 -- 172.21.15.180:0/680917632 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053082459 0 0) 0x7f83ec0a4490 con 0x7f83ec0a7920 2020-02-12T15:09:45.959 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- 172.21.15.180:0/680917632 >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a2590 0x7f83ec134cd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83e40032b0 tx=0x7f83e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.959 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- 172.21.15.180:0/680917632 >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a2590 0x7f83ec134cd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83e40032b0 tx=0x7f83e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.960 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ec0a2590 0x7f83ec134cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f83e40032b0 tx=0x7f83e4008c60).ready entity=mon.0 client_cookie=c4e32e002a38a672 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.960 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ec0a2590 0x7f83ec134cd0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f83e40032b0 tx=0x7f83e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.960 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f0c9a700 1 -- 172.21.15.180:0/680917632 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e4013e80 con 0x7f83ec0a2590 2020-02-12T15:09:45.960 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ec0a2590 0x7f83ec134cd0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f83e40032b0 tx=0x7f83e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f249d700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ec0a2590 0x7f83ec134cd0 secure :-1 s=THROTTLE_DONE pgs=56 cs=0 l=1 rx=0x7f83e40032b0 tx=0x7f83e4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.946+0000 7f83f0c9a700 1 -- 172.21.15.180:0/680917632 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e400c350 con 0x7f83ec0a2590 2020-02-12T15:09:45.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f0c9a700 1 -- 172.21.15.180:0/680917632 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e400c6f0 con 0x7f83ec0a2590 2020-02-12T15:09:45.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 -- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ec0a2590 msgr2=0x7f83ec134cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ec0a2590 0x7f83ec134cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rx=0x7f83e40032b0 tx=0x7f83e4008c60).stop 2020-02-12T15:09:45.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 -- 172.21.15.180:0/680917632 shutdown_connections 2020-02-12T15:09:45.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83ec0a2590 0x7f83ec134cd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 --2- 172.21.15.180:0/680917632 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec0a2130 0x7f83ec134870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:45.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 -- 172.21.15.180:0/680917632 >> 172.21.15.180:0/680917632 conn(0x7f83ec05a530 msgr2=0x7f83ec05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:45.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 -- 172.21.15.180:0/680917632 shutdown_connections 2020-02-12T15:09:45.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.947+0000 7f83f3f00700 1 -- 172.21.15.180:0/680917632 wait complete. 2020-02-12T15:09:45.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 Processor -- start 2020-02-12T15:09:45.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 -- start start 2020-02-12T15:09:45.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f83ec0a2130 0x7f83ec140e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a7920 0x7f83ec135d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec09e080 0x7f83ec09cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec141260 con 0x7f83ec0a7920 2020-02-12T15:09:45.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83ec1361e0 con 0x7f83ec0a2130 2020-02-12T15:09:45.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.948+0000 7f83f3f00700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83ec067320 con 0x7f83ec09e080 2020-02-12T15:09:45.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f83ec0a2130 0x7f83ec140e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f83ec0a2130 0x7f83ec140e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50926/0 (socket says 172.21.15.180:50926) 2020-02-12T15:09:45.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 -- 172.21.15.180:0/4209140423 learned_addr learned my addr 172.21.15.180:0/4209140423 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:45.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f149b700 1 --2- 172.21.15.180:0/4209140423 >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a7920 0x7f83ec135d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f249d700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec09e080 0x7f83ec09cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 -- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec09e080 msgr2=0x7f83ec09cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec09e080 0x7f83ec09cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 -- 172.21.15.180:0/4209140423 >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a7920 msgr2=0x7f83ec135d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:45.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a7920 0x7f83ec135d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:45.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 -- 172.21.15.180:0/4209140423 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83ec138650 con 0x7f83ec0a2130 2020-02-12T15:09:45.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f149b700 1 --2- 172.21.15.180:0/4209140423 >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a7920 0x7f83ec135d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:45.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f249d700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec09e080 0x7f83ec09cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:45.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> v2:172.21.15.180:3300/0 conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> v2:172.21.15.180:3300/0 conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83daffd700 1 -- 172.21.15.180:0/4209140423 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e80115a0 con 0x7f83ec0a2130 2020-02-12T15:09:45.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83daffd700 1 -- 172.21.15.180:0/4209140423 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83e8011700 con 0x7f83ec0a2130 2020-02-12T15:09:45.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83ec135640 con 0x7f83ec0a2130 2020-02-12T15:09:45.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83daffd700 1 -- 172.21.15.180:0/4209140423 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83e8011ae0 con 0x7f83ec0a2130 2020-02-12T15:09:45.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.949+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83ec1382d0 con 0x7f83ec0a2130 2020-02-12T15:09:45.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.950+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.971 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.950+0000 7f83daffd700 1 -- 172.21.15.180:0/4209140423 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f83e800b0a0 con 0x7f83ec0a2130 2020-02-12T15:09:45.971 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.950+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.971 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.950+0000 7f83daffd700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83cc039e00 0x7f83cc03c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:45.971 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.950+0000 7f83daffd700 1 -- 172.21.15.180:0/4209140423 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f83e80498e0 con 0x7f83ec0a2130 2020-02-12T15:09:45.972 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.950+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83ec067ab0 con 0x7f83ec0a2130 2020-02-12T15:09:45.972 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.950+0000 7f83f149b700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83cc039e00 0x7f83cc03c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:45.972 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.951+0000 7f83f149b700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83cc039e00 0x7f83cc03c2c0 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:45.973 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.954+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:45.973 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:45.954+0000 7f83daffd700 1 -- 172.21.15.180:0/4209140423 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f83e802eeb0 con 0x7f83ec0a2130 2020-02-12T15:09:46.092 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.090+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f83ec135a80 con 0x7f83ec0a2130 2020-02-12T15:09:46.093 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.090+0000 7f83f1c9c700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=THROTTLE_DONE pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.093 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.090+0000 7f83daffd700 1 -- 172.21.15.180:0/4209140423 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f83e80090e0 con 0x7f83ec0a2130 2020-02-12T15:09:46.093 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:46.094 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83cc039e00 msgr2=0x7f83cc03c2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.094 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83cc039e00 0x7f83cc03c2c0 crc :-1 s=READY pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.094 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 msgr2=0x7f83ec140e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.095 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 secure :-1 s=READY pgs=106 cs=0 l=1 rx=0x7f83e8000b80 tx=0x7f83e8010940).stop 2020-02-12T15:09:46.095 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 shutdown_connections 2020-02-12T15:09:46.095 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83cc039e00 0x7f83cc03c2c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.095 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83ec0a2130 0x7f83ec140e00 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.095 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 --2- 172.21.15.180:0/4209140423 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83ec09e080 0x7f83ec09cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.095 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 --2- 172.21.15.180:0/4209140423 >> v2:172.21.15.105:3300/0 conn(0x7f83ec0a7920 0x7f83ec135d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.095 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.091+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 >> 172.21.15.180:0/4209140423 conn(0x7f83ec05a530 msgr2=0x7f83ec0a62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:46.096 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.092+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 shutdown_connections 2020-02-12T15:09:46.096 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.092+0000 7f83f3f00700 1 -- 172.21.15.180:0/4209140423 wait complete. 2020-02-12T15:09:46.109 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2020-02-12T15:09:46.109 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2020-02-12T15:09:46.109 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early mgr dump --format=json 2020-02-12T15:09:46.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.213+0000 7fdd1fa06700 1 Processor -- start 2020-02-12T15:09:46.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1fa06700 1 -- start start 2020-02-12T15:09:46.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1fa06700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd180aac00 0x7fdd180a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:46.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1fa06700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd180a6520 0x7fdd1812ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:46.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1fa06700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdd1812ee90 0x7fdd18134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:46.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1fa06700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180a3f10 con 0x7fdd180a6520 2020-02-12T15:09:46.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1fa06700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd180a41b0 con 0x7fdd1812ee90 2020-02-12T15:09:46.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1fa06700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd180a4450 con 0x7fdd180aac00 2020-02-12T15:09:46.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1dfa3700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdd1812ee90 0x7fdd18134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1dfa3700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdd1812ee90 0x7fdd18134c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50934/0 (socket says 172.21.15.180:50934) 2020-02-12T15:09:46.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.214+0000 7fdd1dfa3700 1 -- 172.21.15.180:0/1078657175 learned_addr learned my addr 172.21.15.180:0/1078657175 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:46.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1d7a2700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd180aac00 0x7fdd180a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.226 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1078657175 >> v2:172.21.15.105:3300/0 conn(0x7fdd180a6520 0x7fdd1812ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.226 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 -- 172.21.15.180:0/1078657175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd180aac00 msgr2=0x7fdd180a3990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:46.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd180aac00 0x7fdd180a3990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 -- 172.21.15.180:0/1078657175 >> v2:172.21.15.105:3300/0 conn(0x7fdd180a6520 msgr2=0x7fdd1812ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:46.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> v2:172.21.15.105:3300/0 conn(0x7fdd180a6520 0x7fdd1812ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 -- 172.21.15.180:0/1078657175 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd1812f320 con 0x7fdd1812ee90 2020-02-12T15:09:46.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1078657175 >> v2:172.21.15.105:3300/0 conn(0x7fdd180a6520 0x7fdd1812ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:46.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> v2:172.21.15.180:3300/0 conn(0x7fdd1812ee90 0x7fdd18134c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdd100032b0 tx=0x7fdd10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> v2:172.21.15.180:3300/0 conn(0x7fdd1812ee90 0x7fdd18134c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdd100032b0 tx=0x7fdd10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd1812ee90 0x7fdd18134c80 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fdd100032b0 tx=0x7fdd10007dc0).ready entity=mon.1 client_cookie=7025d8d148e59c57 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd1812ee90 0x7fdd18134c80 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdd100032b0 tx=0x7fdd10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd1812ee90 0x7fdd18134c80 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdd100032b0 tx=0x7fdd10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd07fff700 1 -- 172.21.15.180:0/1078657175 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1000a160 con 0x7fdd1812ee90 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd1812ee90 0x7fdd18134c80 secure :-1 s=THROTTLE_DONE pgs=107 cs=0 l=1 rx=0x7fdd100032b0 tx=0x7fdd10007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd07fff700 1 -- 172.21.15.180:0/1078657175 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd1000a2c0 con 0x7fdd1812ee90 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd07fff700 1 -- 172.21.15.180:0/1078657175 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1000a660 con 0x7fdd1812ee90 2020-02-12T15:09:46.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1078657175 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd1812ee90 msgr2=0x7fdd18134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.230 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd1812ee90 0x7fdd18134c80 secure :-1 s=READY pgs=107 cs=0 l=1 rx=0x7fdd100032b0 tx=0x7fdd10007dc0).stop 2020-02-12T15:09:46.230 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1078657175 shutdown_connections 2020-02-12T15:09:46.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd1812ee90 0x7fdd18134c80 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.215+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1078657175 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdd180aac00 0x7fdd180a3990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.216+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1078657175 >> v2:172.21.15.105:3300/0 conn(0x7fdd180a6520 0x7fdd1812ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.216+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1078657175 >> 172.21.15.180:0/1078657175 conn(0x7fdd1809d450 msgr2=0x7fdd1809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:46.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.216+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1078657175 shutdown_connections 2020-02-12T15:09:46.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.216+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1078657175 wait complete. 2020-02-12T15:09:46.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.216+0000 7fdd1fa06700 1 Processor -- start 2020-02-12T15:09:46.232 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.216+0000 7fdd1fa06700 1 -- start start 2020-02-12T15:09:46.232 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1fa06700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdd180aac00 0x7fdd181343b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1fa06700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdd1812ee90 0x7fdd18136680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1fa06700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd1809e840 con 0x7fdd180a6520 2020-02-12T15:09:46.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1fa06700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd18134810 con 0x7fdd1812ee90 2020-02-12T15:09:46.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1fa06700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd1809f300 con 0x7fdd180aac00 2020-02-12T15:09:46.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdd180aac00 0x7fdd181343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdd180aac00 0x7fdd181343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50940/0 (socket says 172.21.15.180:50940) 2020-02-12T15:09:46.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 -- 172.21.15.180:0/1450377885 learned_addr learned my addr 172.21.15.180:0/1450377885 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:46.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1dfa3700 1 --2- 172.21.15.180:0/1450377885 >> v2:172.21.15.105:3300/0 conn(0x7fdd1812ee90 0x7fdd18136680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 -- 172.21.15.180:0/1450377885 >> v2:172.21.15.105:3300/0 conn(0x7fdd1812ee90 msgr2=0x7fdd18136680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> v2:172.21.15.105:3300/0 conn(0x7fdd1812ee90 0x7fdd18136680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 -- 172.21.15.180:0/1450377885 >> v1:172.21.15.105:6789/0 conn(0x7fdd180a6520 legacy=0x7fdd18135d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 -- 172.21.15.180:0/1450377885 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd18138010 con 0x7fdd180aac00 2020-02-12T15:09:46.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> v2:172.21.15.180:3300/0 conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> v2:172.21.15.180:3300/0 conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.217+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd067fc700 1 -- 172.21.15.180:0/1450377885 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd14007160 con 0x7fdd180aac00 2020-02-12T15:09:46.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd067fc700 1 -- 172.21.15.180:0/1450377885 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd140072c0 con 0x7fdd180aac00 2020-02-12T15:09:46.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd067fc700 1 -- 172.21.15.180:0/1450377885 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdd1400e270 con 0x7fdd180aac00 2020-02-12T15:09:46.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd18138240 con 0x7fdd180aac00 2020-02-12T15:09:46.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd18137b90 con 0x7fdd180aac00 2020-02-12T15:09:46.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.218+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.219+0000 7fdd067fc700 1 -- 172.21.15.180:0/1450377885 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fdd1400e4e0 con 0x7fdd180aac00 2020-02-12T15:09:46.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.219+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.219+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd180565b0 con 0x7fdd180aac00 2020-02-12T15:09:46.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.219+0000 7fdd067fc700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdcf8039cb0 0x7fdcf803c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.219+0000 7fdd067fc700 1 -- 172.21.15.180:0/1450377885 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdd14007e40 con 0x7fdd180aac00 2020-02-12T15:09:46.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.219+0000 7fdd1d7a2700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdcf8039cb0 0x7fdcf803c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.219+0000 7fdd1d7a2700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdcf8039cb0 0x7fdcf803c170 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.238 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.222+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.238 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.222+0000 7fdd067fc700 1 -- 172.21.15.180:0/1450377885 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdd1402f1f0 con 0x7fdd180aac00 2020-02-12T15:09:46.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.391+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fdd1805e410 con 0x7fdd180aac00 2020-02-12T15:09:46.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.393+0000 7fdd1cfa1700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=THROTTLE_DONE pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.393+0000 7fdd067fc700 1 -- 172.21.15.180:0/1450377885 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v4) v1 ==== 74+0+92794 (secure 0 0 0) 0x7fdd1400a0d0 con 0x7fdd180aac00 2020-02-12T15:09:46.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdcf8039cb0 msgr2=0x7fdcf803c170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdcf8039cb0 0x7fdcf803c170 crc :-1 s=READY pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 msgr2=0x7fdd181343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 secure :-1 s=READY pgs=108 cs=0 l=1 rx=0x7fdd18137930 tx=0x7fdd14010b90).stop 2020-02-12T15:09:46.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 shutdown_connections 2020-02-12T15:09:46.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdcf8039cb0 0x7fdcf803c170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1450377885 >> v2:172.21.15.105:3300/0 conn(0x7fdd1812ee90 0x7fdd18136680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 --2- 172.21.15.180:0/1450377885 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdd180aac00 0x7fdd181343b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 >> 172.21.15.180:0/1450377885 conn(0x7fdd1809d450 msgr2=0x7fdd1812b6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:46.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 shutdown_connections 2020-02-12T15:09:46.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.395+0000 7fdd1fa06700 1 -- 172.21.15.180:0/1450377885 wait complete. 2020-02-12T15:09:46.400 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:46.408 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":4,"active_gid":4101,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6800","nonce":21618},{"type":"v1","addr":"172.21.15.105:6801","nonce":21618}]},"active_addr":"172.21.15.105:6801/21618","active_change":"2020-02-12T15:09:24.439067+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4108,"name":"y","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_services":{"name":"warn_on_stray_services","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if services are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"int","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.105:0","nonce":2250902737}]}]}} 2020-02-12T15:09:46.414 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2020-02-12T15:09:46.414 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2020-02-12T15:09:46.414 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:46.520 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.518+0000 7f9198361700 1 Processor -- start 2020-02-12T15:09:46.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.518+0000 7f9198361700 1 -- start start 2020-02-12T15:09:46.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f9198361700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:46.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f9198361700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f91900a6520 0x7f919012ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:46.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f9198361700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91900a3f10 con 0x7f919012ee90 2020-02-12T15:09:46.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f9198361700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91900a41b0 con 0x7f91900a6520 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f9198361700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91900a4450 con 0x7f91900aac00 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91960fd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91958fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f91900a6520 0x7f919012ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91960fd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.180:51092/0 (socket says 172.21.15.180:51092) 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91960fd700 1 -- 172.21.15.180:0/2514050062 learned_addr learned my addr 172.21.15.180:0/2514050062 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91960fd700 1 -- 172.21.15.180:0/2514050062 >> v2:172.21.15.105:3300/0 conn(0x7f91900a6520 msgr2=0x7f919012ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91960fd700 1 --2- 172.21.15.180:0/2514050062 >> v2:172.21.15.105:3300/0 conn(0x7f91900a6520 0x7f919012ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91960fd700 1 -- 172.21.15.180:0/2514050062 >> v1:172.21.15.105:6789/0 conn(0x7f919012ee90 legacy=0x7f9190134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91960fd700 1 -- 172.21.15.180:0/2514050062 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f919012f320 con 0x7f91900aac00 2020-02-12T15:09:46.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.519+0000 7f91958fc700 1 --2- 172.21.15.180:0/2514050062 >> v2:172.21.15.105:3300/0 conn(0x7f91900a6520 0x7f919012ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:46.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91960fd700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9180002f30 tx=0x7f91800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91960fd700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9180002f30 tx=0x7f91800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91960fd700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f9180002f30 tx=0x7f91800088e0).ready entity=mon.2 client_cookie=67acd29b67bd2cb server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.525 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91960fd700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f9180002f30 tx=0x7f91800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.526 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91960fd700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f9180002f30 tx=0x7f91800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.526 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91950fb700 1 -- 172.21.15.180:0/2514050062 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f91800116b0 con 0x7f91900aac00 2020-02-12T15:09:46.526 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91960fd700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 secure :-1 s=THROTTLE_DONE pgs=36 cs=0 l=1 rx=0x7f9180002f30 tx=0x7f91800088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.526 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91950fb700 1 -- 172.21.15.180:0/2514050062 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9180011810 con 0x7f91900aac00 2020-02-12T15:09:46.526 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f91950fb700 1 -- 172.21.15.180:0/2514050062 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9180011bf0 con 0x7f91900aac00 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 -- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 msgr2=0x7f91900a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 secure :-1 s=READY pgs=36 cs=0 l=1 rx=0x7f9180002f30 tx=0x7f91800088e0).stop 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 -- 172.21.15.180:0/2514050062 shutdown_connections 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 --2- 172.21.15.180:0/2514050062 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f91900aac00 0x7f91900a3990 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 --2- 172.21.15.180:0/2514050062 >> v2:172.21.15.105:3300/0 conn(0x7f91900a6520 0x7f919012ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 -- 172.21.15.180:0/2514050062 >> 172.21.15.180:0/2514050062 conn(0x7f919009d450 msgr2=0x7f919009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 -- 172.21.15.180:0/2514050062 shutdown_connections 2020-02-12T15:09:46.527 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.520+0000 7f9198361700 1 -- 172.21.15.180:0/2514050062 wait complete. 2020-02-12T15:09:46.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.521+0000 7f9198361700 1 Processor -- start 2020-02-12T15:09:46.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.521+0000 7f9198361700 1 -- start start 2020-02-12T15:09:46.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f9198361700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f91900aac00 0x7f9190131c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f9198361700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919012ee90 0x7f9190127400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f9198361700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f919012fb90 con 0x7f91900a6520 2020-02-12T15:09:46.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f9198361700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f919012f650 con 0x7f91900aac00 2020-02-12T15:09:46.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f9198361700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f919012f8f0 con 0x7f919012ee90 2020-02-12T15:09:46.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f91900aac00 0x7f9190131c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f91900aac00 0x7f9190131c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50952/0 (socket says 172.21.15.180:50952) 2020-02-12T15:09:46.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91960fd700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f91900a6520 0x7f91901312c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42464/0 (socket says 172.21.15.180:42464) 2020-02-12T15:09:46.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 -- 172.21.15.180:0/3293120553 learned_addr learned my addr 172.21.15.180:0/3293120553 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:46.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91968fe700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919012ee90 0x7f9190127400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 -- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919012ee90 msgr2=0x7f9190127400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919012ee90 0x7f9190127400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 -- 172.21.15.180:0/3293120553 >> v1:172.21.15.180:6789/0 conn(0x7f91900a6520 legacy=0x7f91901312c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 233752835 0 0) 0x7f919012fb90 con 0x7f91900a6520 2020-02-12T15:09:46.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 -- 172.21.15.180:0/3293120553 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91901319d0 con 0x7f91900aac00 2020-02-12T15:09:46.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> v2:172.21.15.180:3300/0 conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> v2:172.21.15.180:3300/0 conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f918c007540 con 0x7f91900aac00 2020-02-12T15:09:46.540 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f918c0059c0 con 0x7f91900aac00 2020-02-12T15:09:46.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9190135790 con 0x7f91900aac00 2020-02-12T15:09:46.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.522+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f918c005d60 con 0x7f91900aac00 2020-02-12T15:09:46.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.523+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91900a13a0 con 0x7f91900aac00 2020-02-12T15:09:46.541 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.523+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.523+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f918c010180 con 0x7f91900aac00 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.523+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.523+0000 7f917f7fe700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9170039b60 0x7f917003c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.524+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f918c049b30 con 0x7f91900aac00 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.524+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9190131000 con 0x7f91900aac00 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.524+0000 7f91960fd700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9170039b60 0x7f917003c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.524+0000 7f91960fd700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9170039b60 0x7f917003c020 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.542 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.527+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.543 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.527+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9190131000 con 0x7f91900aac00 2020-02-12T15:09:46.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.662+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9190131000 con 0x7f91900aac00 2020-02-12T15:09:46.666 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.663+0000 7f91958fc700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=THROTTLE_DONE pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.666 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.663+0000 7f917f7fe700 1 -- 172.21.15.180:0/3293120553 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14981 (secure 0 0 0) 0x7f9190131000 con 0x7f91900aac00 2020-02-12T15:09:46.666 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:46.666 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":24,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:43.739063+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:46.667 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9170039b60 msgr2=0x7f917003c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.667 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9170039b60 0x7f917003c020 crc :-1 s=READY pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.668 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 msgr2=0x7f9190131c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.668 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 secure :-1 s=READY pgs=110 cs=0 l=1 rx=0x7f918c002ef0 tx=0x7f918c010ec0).stop 2020-02-12T15:09:46.668 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 shutdown_connections 2020-02-12T15:09:46.670 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9170039b60 0x7f917003c020 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.670 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f919012ee90 0x7f9190127400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.671 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 --2- 172.21.15.180:0/3293120553 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f91900aac00 0x7f9190131c60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.671 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 >> 172.21.15.180:0/3293120553 conn(0x7f919009d450 msgr2=0x7f91900698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:46.671 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 shutdown_connections 2020-02-12T15:09:46.671 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.665+0000 7f9198361700 1 -- 172.21.15.180:0/3293120553 wait complete. 2020-02-12T15:09:46.684 INFO:tasks.ceph.ceph_manager.ceph:all up! 2020-02-12T15:09:46.685 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:46.790 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.788+0000 7fe67e628700 1 Processor -- start 2020-02-12T15:09:46.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.788+0000 7fe67e628700 1 -- start start 2020-02-12T15:09:46.801 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.788+0000 7fe67e628700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fe6780a49e0 0x7fe6780a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:46.801 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.788+0000 7fe67e628700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe678137da0 0x7fe6781381f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:46.801 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67e628700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6780a3b20 con 0x7fe6780a77c0 2020-02-12T15:09:46.802 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67e628700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe67805b500 con 0x7fe6780a49e0 2020-02-12T15:09:46.802 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67e628700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6780a52d0 con 0x7fe678137da0 2020-02-12T15:09:46.802 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fe6780a49e0 0x7fe6780a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.802 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67d626700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fe6780a77c0 0x7fe6780a6230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42472/0 (socket says 172.21.15.180:42472) 2020-02-12T15:09:46.803 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67d626700 1 -- 172.21.15.180:0/4240259729 learned_addr learned my addr 172.21.15.180:0/4240259729 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:46.803 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67de27700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe678137da0 0x7fe6781381f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.803 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 -- 172.21.15.180:0/4240259729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe678137da0 msgr2=0x7fe6781381f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:46.803 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe678137da0 0x7fe6781381f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.804 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 -- 172.21.15.180:0/4240259729 >> v1:172.21.15.180:6789/0 conn(0x7fe6780a77c0 legacy=0x7fe6780a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.804 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe667fff700 1 -- 172.21.15.180:0/4240259729 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4285921448 0 0) 0x7fe6780a3b20 con 0x7fe6780a77c0 2020-02-12T15:09:46.804 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 -- 172.21.15.180:0/4240259729 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6780a3dc0 con 0x7fe6780a49e0 2020-02-12T15:09:46.804 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- 172.21.15.180:0/4240259729 >> v2:172.21.15.180:3300/0 conn(0x7fe6780a49e0 0x7fe6780a4e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fe668002f30 tx=0x7fe6680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.805 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- 172.21.15.180:0/4240259729 >> v2:172.21.15.180:3300/0 conn(0x7fe6780a49e0 0x7fe6780a4e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fe668002f30 tx=0x7fe6680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.806 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe6780a49e0 0x7fe6780a4e70 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fe668002f30 tx=0x7fe6680088e0).ready entity=mon.1 client_cookie=5c53759b654ff6c0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.806 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe6780a49e0 0x7fe6780a4e70 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fe668002f30 tx=0x7fe6680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.806 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe667fff700 1 -- 172.21.15.180:0/4240259729 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe668008e40 con 0x7fe6780a49e0 2020-02-12T15:09:46.807 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe6780a49e0 0x7fe6780a4e70 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fe668002f30 tx=0x7fe6680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.807 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe667fff700 1 -- 172.21.15.180:0/4240259729 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6680115f0 con 0x7fe6780a49e0 2020-02-12T15:09:46.807 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67ce25700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe6780a49e0 0x7fe6780a4e70 secure :-1 s=THROTTLE_DONE pgs=112 cs=0 l=1 rx=0x7fe668002f30 tx=0x7fe6680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.807 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe667fff700 1 -- 172.21.15.180:0/4240259729 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe668011990 con 0x7fe6780a49e0 2020-02-12T15:09:46.808 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67e628700 1 -- 172.21.15.180:0/4240259729 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe6780a49e0 msgr2=0x7fe6780a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.808 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.789+0000 7fe67e628700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe6780a49e0 0x7fe6780a4e70 secure :-1 s=READY pgs=112 cs=0 l=1 rx=0x7fe668002f30 tx=0x7fe6680088e0).stop 2020-02-12T15:09:46.808 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.790+0000 7fe67e628700 1 -- 172.21.15.180:0/4240259729 shutdown_connections 2020-02-12T15:09:46.808 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.790+0000 7fe67e628700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe678137da0 0x7fe6781381f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:46.808 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.790+0000 7fe67e628700 1 --2- 172.21.15.180:0/4240259729 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe6780a49e0 0x7fe6780a4e70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.809 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.790+0000 7fe67e628700 1 -- 172.21.15.180:0/4240259729 >> 172.21.15.180:0/4240259729 conn(0x7fe67805a530 msgr2=0x7fe67805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:46.809 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.790+0000 7fe67e628700 1 -- 172.21.15.180:0/4240259729 shutdown_connections 2020-02-12T15:09:46.811 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.790+0000 7fe67e628700 1 -- 172.21.15.180:0/4240259729 wait complete. 2020-02-12T15:09:46.812 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67e628700 1 Processor -- start 2020-02-12T15:09:46.812 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67e628700 1 -- start start 2020-02-12T15:09:46.813 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67e628700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6780a49e0 0x7fe678135f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.813 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67e628700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fe678137da0 0x7fe6780a0740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.813 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67e628700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe678135010 con 0x7fe6780a77c0 2020-02-12T15:09:46.813 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67e628700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe678061840 con 0x7fe678137da0 2020-02-12T15:09:46.813 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67e628700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe678135240 con 0x7fe6780a49e0 2020-02-12T15:09:46.813 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67de27700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fe678137da0 0x7fe6780a0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.813 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67de27700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fe678137da0 0x7fe6780a0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50966/0 (socket says 172.21.15.180:50966) 2020-02-12T15:09:46.814 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67de27700 1 -- 172.21.15.180:0/880491349 learned_addr learned my addr 172.21.15.180:0/880491349 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:46.814 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.791+0000 7fe67d626700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6780a49e0 0x7fe678135f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.814 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 -- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6780a49e0 msgr2=0x7fe678135f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.814 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6780a49e0 0x7fe678135f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.814 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 -- 172.21.15.180:0/880491349 >> v1:172.21.15.105:6789/0 conn(0x7fe6780a77c0 legacy=0x7fe6780a0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.814 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 -- 172.21.15.180:0/880491349 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe678134160 con 0x7fe678137da0 2020-02-12T15:09:46.814 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> v2:172.21.15.180:3300/0 conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.815 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> v2:172.21.15.180:3300/0 conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.815 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.815 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.815 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe6667fc700 1 -- 172.21.15.180:0/880491349 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe67000e980 con 0x7fe678137da0 2020-02-12T15:09:46.815 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.816 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.816 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe6667fc700 1 -- 172.21.15.180:0/880491349 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67000eae0 con 0x7fe678137da0 2020-02-12T15:09:46.816 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe6667fc700 1 -- 172.21.15.180:0/880491349 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe67000c510 con 0x7fe678137da0 2020-02-12T15:09:46.817 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe678134cb0 con 0x7fe678137da0 2020-02-12T15:09:46.817 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.792+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe678136590 con 0x7fe678137da0 2020-02-12T15:09:46.817 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.793+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.817 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.793+0000 7fe6667fc700 1 -- 172.21.15.180:0/880491349 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fe670005a40 con 0x7fe678137da0 2020-02-12T15:09:46.817 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.793+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.818 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.793+0000 7fe6667fc700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fe658039be0 0x7fe65803c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:46.818 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.793+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe678135440 con 0x7fe678137da0 2020-02-12T15:09:46.818 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.793+0000 7fe6667fc700 1 -- 172.21.15.180:0/880491349 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fe670049920 con 0x7fe678137da0 2020-02-12T15:09:46.818 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.793+0000 7fe67d626700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fe658039be0 0x7fe65803c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:46.818 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.794+0000 7fe67d626700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fe658039be0 0x7fe65803c0a0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:46.818 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.797+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.818 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.797+0000 7fe6667fc700 1 -- 172.21.15.180:0/880491349 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fe678135440 con 0x7fe678137da0 2020-02-12T15:09:46.936 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.933+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe678135440 con 0x7fe678137da0 2020-02-12T15:09:46.937 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.934+0000 7fe67de27700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=THROTTLE_DONE pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:46.937 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.934+0000 7fe6667fc700 1 -- 172.21.15.180:0/880491349 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14981 (secure 0 0 0) 0x7fe678135440 con 0x7fe678137da0 2020-02-12T15:09:46.937 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:46.937 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":24,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:43.739063+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:46.938 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fe658039be0 msgr2=0x7fe65803c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.939 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fe658039be0 0x7fe65803c0a0 crc :-1 s=READY pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.939 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 msgr2=0x7fe6780a0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:46.939 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 secure :-1 s=READY pgs=113 cs=0 l=1 rx=0x7fe6700032b0 tx=0x7fe670010f60).stop 2020-02-12T15:09:46.940 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 shutdown_connections 2020-02-12T15:09:46.940 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fe658039be0 0x7fe65803c0a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.940 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fe678137da0 0x7fe6780a0740 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.940 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 --2- 172.21.15.180:0/880491349 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fe6780a49e0 0x7fe678135f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:46.940 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 >> 172.21.15.180:0/880491349 conn(0x7fe67805a530 msgr2=0x7fe6780698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:46.941 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 shutdown_connections 2020-02-12T15:09:46.941 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:46.935+0000 7fe67e628700 1 -- 172.21.15.180:0/880491349 wait complete. 2020-02-12T15:09:46.949 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.0 flush_pg_stats 2020-02-12T15:09:47.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.052+0000 7f9b7a46b700 1 Processor -- start 2020-02-12T15:09:47.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.052+0000 7f9b7a46b700 1 -- start start 2020-02-12T15:09:47.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b7a46b700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b740a5c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b7a46b700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740a4cb0 con 0x7f9b740a3900 2020-02-12T15:09:47.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b7a46b700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740a5090 con 0x7f9b740aac00 2020-02-12T15:09:47.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b7a46b700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b74136ae0 con 0x7f9b740a57d0 2020-02-12T15:09:47.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b737fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b740a5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b73fff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f9b740aac00 0x7f9b7413fcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42486/0 (socket says 172.21.15.180:42486) 2020-02-12T15:09:47.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b73fff700 1 -- 172.21.15.180:0/4177401167 learned_addr learned my addr 172.21.15.180:0/4177401167 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.053+0000 7f9b737fe700 1 -- 172.21.15.180:0/4177401167 >> v1:172.21.15.180:6789/0 conn(0x7f9b740aac00 legacy=0x7f9b7413fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.065 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 -- 172.21.15.180:0/4177401167 >> v1:172.21.15.105:6789/0 conn(0x7f9b740a3900 legacy=0x7f9b740a3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.065 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b72ffd700 1 -- 172.21.15.180:0/4177401167 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346165478 0 0) 0x7f9b740a5090 con 0x7f9b740aac00 2020-02-12T15:09:47.065 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 -- 172.21.15.180:0/4177401167 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740a5330 con 0x7f9b740a57d0 2020-02-12T15:09:47.065 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 --2- 172.21.15.180:0/4177401167 >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b740a5c50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9b68002f30 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.065 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 --2- 172.21.15.180:0/4177401167 >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b740a5c50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9b68002f30 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.065 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 --2- 172.21.15.180:0/4177401167 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b740a5c50 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b680088e0).ready entity=mon.1 client_cookie=e1b1d5693da024fe server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.065 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 --2- 172.21.15.180:0/4177401167 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b740a5c50 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.066 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b72ffd700 1 -- 172.21.15.180:0/4177401167 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b68008e40 con 0x7f9b740a57d0 2020-02-12T15:09:47.066 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 --2- 172.21.15.180:0/4177401167 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b740a5c50 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.066 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b737fe700 1 --2- 172.21.15.180:0/4177401167 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b740a5c50 secure :-1 s=THROTTLE_DONE pgs=115 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b680088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.066 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b72ffd700 1 -- 172.21.15.180:0/4177401167 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680116a0 con 0x7f9b740a57d0 2020-02-12T15:09:47.066 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b72ffd700 1 -- 172.21.15.180:0/4177401167 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b68011a80 con 0x7f9b740a57d0 2020-02-12T15:09:47.067 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b7a46b700 1 -- 172.21.15.180:0/4177401167 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 msgr2=0x7f9b740a5c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.067 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b7a46b700 1 --2- 172.21.15.180:0/4177401167 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b740a5c50 secure :-1 s=READY pgs=115 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b680088e0).stop 2020-02-12T15:09:47.067 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b7a46b700 1 -- 172.21.15.180:0/4177401167 shutdown_connections 2020-02-12T15:09:47.067 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b7a46b700 1 --2- 172.21.15.180:0/4177401167 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b740a5c50 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.067 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b7a46b700 1 -- 172.21.15.180:0/4177401167 >> 172.21.15.180:0/4177401167 conn(0x7f9b7409d450 msgr2=0x7f9b7409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.067 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b7a46b700 1 -- 172.21.15.180:0/4177401167 shutdown_connections 2020-02-12T15:09:47.068 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.054+0000 7f9b7a46b700 1 -- 172.21.15.180:0/4177401167 wait complete. 2020-02-12T15:09:47.068 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.055+0000 7f9b7a46b700 1 Processor -- start 2020-02-12T15:09:47.068 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.055+0000 7f9b7a46b700 1 -- start start 2020-02-12T15:09:47.068 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b7a46b700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b74149c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.068 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b7a46b700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9b740aac00 0x7f9b7414a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.069 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b7a46b700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b740a06f0 con 0x7f9b740a3900 2020-02-12T15:09:47.069 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b7a46b700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b741495b0 con 0x7f9b740aac00 2020-02-12T15:09:47.069 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b7a46b700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b7414a4f0 con 0x7f9b740a57d0 2020-02-12T15:09:47.069 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b74149c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.070 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b73fff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f9b740a3900 0x7f9b740a0c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42492/0 (socket says 172.21.15.180:42492) 2020-02-12T15:09:47.070 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b74149c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50980/0 (socket says 172.21.15.180:50980) 2020-02-12T15:09:47.070 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b73fff700 1 -- 172.21.15.180:0/1957978780 learned_addr learned my addr 172.21.15.180:0/1957978780 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.070 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b78a08700 1 --2- 172.21.15.180:0/1957978780 >> v2:172.21.15.105:3300/0 conn(0x7f9b740aac00 0x7f9b7414a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.070 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 -- 172.21.15.180:0/1957978780 >> v2:172.21.15.105:3300/0 conn(0x7f9b740aac00 msgr2=0x7f9b7414a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> v2:172.21.15.105:3300/0 conn(0x7f9b740aac00 0x7f9b7414a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 -- 172.21.15.180:0/1957978780 >> v1:172.21.15.180:6789/0 conn(0x7f9b740a3900 legacy=0x7f9b740a0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 104819126 0 0) 0x7f9b740a06f0 con 0x7f9b740a3900 2020-02-12T15:09:47.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 -- 172.21.15.180:0/1957978780 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b740a01b0 con 0x7f9b740a57d0 2020-02-12T15:09:47.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> v2:172.21.15.180:3300/0 conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.072 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.072 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b68007150 con 0x7f9b740a57d0 2020-02-12T15:09:47.072 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.072 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.072 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.056+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b680072b0 con 0x7f9b740a57d0 2020-02-12T15:09:47.072 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.057+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b740a0450 con 0x7f9b740a57d0 2020-02-12T15:09:47.073 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.057+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9b680056c0 con 0x7f9b740a57d0 2020-02-12T15:09:47.073 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.057+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b7413ce50 con 0x7f9b740a57d0 2020-02-12T15:09:47.073 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.057+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.073 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.057+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f9b68005930 con 0x7f9b740a57d0 2020-02-12T15:09:47.073 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.057+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9b740a0970 con 0x7f9b740a57d0 2020-02-12T15:09:47.073 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.057+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b737fe700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=THROTTLE_DONE pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b717fa700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9b54039b90 0x7f9b5403c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9b6804a050 con 0x7f9b740a57d0 2020-02-12T15:09:47.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b717fa700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:6800/20943,v1:172.21.15.180:6801/20943] conn(0x7f9b540407e0 0x7f9b54042c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 --> [v2:172.21.15.180:6800/20943,v1:172.21.15.180:6801/20943] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9b540431c0 con 0x7f9b540407e0 2020-02-12T15:09:47.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9b6804b510 con 0x7f9b740a57d0 2020-02-12T15:09:47.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b73fff700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9b54039b90 0x7f9b5403c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b78a08700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:6800/20943,v1:172.21.15.180:6801/20943] conn(0x7f9b540407e0 0x7f9b54042c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b73fff700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9b54039b90 0x7f9b5403c050 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.058+0000 7f9b78a08700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:6800/20943,v1:172.21.15.180:6801/20943] conn(0x7f9b540407e0 0x7f9b54042c00 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.059+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== osd.0 v2:172.21.15.180:6800/20943 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f9b540431c0 con 0x7f9b540407e0 2020-02-12T15:09:47.080 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.076+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 --> [v2:172.21.15.180:6800/20943,v1:172.21.15.180:6801/20943] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9b7409ea80 con 0x7f9b540407e0 2020-02-12T15:09:47.080 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.076+0000 7f9b717fa700 1 -- 172.21.15.180:0/1957978780 <== osd.0 v2:172.21.15.180:6800/20943 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9b7409ea80 con 0x7f9b540407e0 2020-02-12T15:09:47.081 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.076+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:6800/20943,v1:172.21.15.180:6801/20943] conn(0x7f9b540407e0 msgr2=0x7f9b54042c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.081 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.076+0000 7f9b7a46b700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:6800/20943,v1:172.21.15.180:6801/20943] conn(0x7f9b540407e0 0x7f9b54042c00 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.081 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9b54039b90 msgr2=0x7f9b5403c050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.081 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9b54039b90 0x7f9b5403c050 crc :-1 s=READY pgs=60 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.081 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 msgr2=0x7f9b74149c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.081 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 secure :-1 s=READY pgs=117 cs=0 l=1 rx=0x7f9b68002f30 tx=0x7f9b7405fc70).stop 2020-02-12T15:09:47.082 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b78a08700 1 -- 172.21.15.180:0/1957978780 reap_dead start 2020-02-12T15:09:47.082 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 shutdown_connections 2020-02-12T15:09:47.082 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 --2- 172.21.15.180:0/1957978780 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9b740a57d0 0x7f9b74149c30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.082 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 >> 172.21.15.180:0/1957978780 conn(0x7f9b7409d450 msgr2=0x7f9b740a5cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.082 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 shutdown_connections 2020-02-12T15:09:47.082 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.077+0000 7f9b7a46b700 1 -- 172.21.15.180:0/1957978780 wait complete. 2020-02-12T15:09:47.089 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:47.090 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.1 flush_pg_stats 2020-02-12T15:09:47.213 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.193+0000 7ff6ca8e8700 1 Processor -- start 2020-02-12T15:09:47.214 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6ca8e8700 1 -- start start 2020-02-12T15:09:47.214 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6ca8e8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a77c0 0x7ff6c40a6230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.214 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6ca8e8700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c40a4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.214 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6ca8e8700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40a3b20 con 0x7ff6c40a49e0 2020-02-12T15:09:47.214 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6ca8e8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c405b500 con 0x7ff6c40a77c0 2020-02-12T15:09:47.214 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6ca8e8700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40a52d0 con 0x7ff6c41384b0 2020-02-12T15:09:47.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6ca0e7700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c40a4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6c90e5700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7ff6c40a49e0 0x7ff6c4137da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42502/0 (socket says 172.21.15.180:42502) 2020-02-12T15:09:47.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6c90e5700 1 -- 172.21.15.180:0/212905727 learned_addr learned my addr 172.21.15.180:0/212905727 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.194+0000 7ff6c98e6700 1 --2- 172.21.15.180:0/212905727 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a77c0 0x7ff6c40a6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/212905727 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a77c0 msgr2=0x7ff6c40a6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/212905727 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a77c0 0x7ff6c40a6230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/212905727 >> v1:172.21.15.180:6789/0 conn(0x7ff6c40a49e0 legacy=0x7ff6c4137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6c88e4700 1 -- 172.21.15.180:0/212905727 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3267532276 0 0) 0x7ff6c40a3b20 con 0x7ff6c40a49e0 2020-02-12T15:09:47.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/212905727 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40a3dc0 con 0x7ff6c41384b0 2020-02-12T15:09:47.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6c98e6700 1 --2- 172.21.15.180:0/212905727 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a77c0 0x7ff6c40a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:47.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/212905727 >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c40a4e70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/212905727 >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c40a4e70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/212905727 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c40a4e70 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).ready entity=mon.1 client_cookie=277c0bc663e2a6ae server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/212905727 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c40a4e70 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/212905727 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c40a4e70 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/212905727 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c40a4e70 secure :-1 s=THROTTLE_DONE pgs=119 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6c88e4700 1 -- 172.21.15.180:0/212905727 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6bc00a160 con 0x7ff6c41384b0 2020-02-12T15:09:47.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6c88e4700 1 -- 172.21.15.180:0/212905727 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc00a2c0 con 0x7ff6c41384b0 2020-02-12T15:09:47.218 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6c88e4700 1 -- 172.21.15.180:0/212905727 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6bc00a6a0 con 0x7ff6c41384b0 2020-02-12T15:09:47.218 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/212905727 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 msgr2=0x7ff6c40a4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.218 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca8e8700 1 --2- 172.21.15.180:0/212905727 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c40a4e70 secure :-1 s=READY pgs=119 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).stop 2020-02-12T15:09:47.218 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/212905727 shutdown_connections 2020-02-12T15:09:47.218 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca8e8700 1 --2- 172.21.15.180:0/212905727 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c40a4e70 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.218 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca8e8700 1 --2- 172.21.15.180:0/212905727 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a77c0 0x7ff6c40a6230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.218 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.195+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/212905727 >> 172.21.15.180:0/212905727 conn(0x7ff6c405a530 msgr2=0x7ff6c405a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.196+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/212905727 shutdown_connections 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.196+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/212905727 wait complete. 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.196+0000 7ff6ca8e8700 1 Processor -- start 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.196+0000 7ff6ca8e8700 1 -- start start 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca8e8700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a49e0 0x7ff6c4066ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca8e8700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6c40a77c0 0x7ff6c40650f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca8e8700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c413ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.219 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca8e8700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c409cae0 con 0x7ff6c40a49e0 2020-02-12T15:09:47.220 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca8e8700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c409ccc0 con 0x7ff6c41384b0 2020-02-12T15:09:47.220 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca8e8700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c4064c50 con 0x7ff6c40a77c0 2020-02-12T15:09:47.220 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c413ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.220 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c413ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:50996/0 (socket says 172.21.15.180:50996) 2020-02-12T15:09:47.220 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/1484764747 learned_addr learned my addr 172.21.15.180:0/1484764747 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:47.220 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6c98e6700 1 --2- 172.21.15.180:0/1484764747 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a49e0 0x7ff6c4066ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.220 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6c90e5700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6c40a77c0 0x7ff6c40650f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.221 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6c40a77c0 msgr2=0x7ff6c40650f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.221 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff6c40a77c0 0x7ff6c40650f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.221 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/1484764747 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a49e0 msgr2=0x7ff6c4066ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.221 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> v2:172.21.15.105:3300/0 conn(0x7ff6c40a49e0 0x7ff6c4066ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.221 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/1484764747 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c4066f30 con 0x7ff6c41384b0 2020-02-12T15:09:47.221 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.221 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> v2:172.21.15.180:3300/0 conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.222 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.222 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.222 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.222 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.222 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.197+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6bc0114c0 con 0x7ff6c41384b0 2020-02-12T15:09:47.222 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6bc011620 con 0x7ff6c41384b0 2020-02-12T15:09:47.222 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff6bc005c30 con 0x7ff6c41384b0 2020-02-12T15:09:47.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c4065550 con 0x7ff6c41384b0 2020-02-12T15:09:47.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c4146560 con 0x7ff6c41384b0 2020-02-12T15:09:47.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7ff6bc010680 con 0x7ff6c41384b0 2020-02-12T15:09:47.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.198+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff6c40565b0 con 0x7ff6c41384b0 2020-02-12T15:09:47.223 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6b6ffd700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff6a4039be0 0x7ff6a403c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff6bc04a2e0 con 0x7ff6c41384b0 2020-02-12T15:09:47.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6ca0e7700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=THROTTLE_DONE pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6b6ffd700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:6808/20944,v1:172.21.15.180:6809/20944] conn(0x7ff6a4040830 0x7ff6a4042c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 --> [v2:172.21.15.180:6808/20944,v1:172.21.15.180:6809/20944] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff6a4043210 con 0x7ff6a4040830 2020-02-12T15:09:47.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff6bc0324e0 con 0x7ff6c41384b0 2020-02-12T15:09:47.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6c98e6700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff6a4039be0 0x7ff6a403c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.224 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6c90e5700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:6808/20944,v1:172.21.15.180:6809/20944] conn(0x7ff6a4040830 0x7ff6a4042c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.225 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6c98e6700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff6a4039be0 0x7ff6a403c0a0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.225 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.199+0000 7ff6c90e5700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:6808/20944,v1:172.21.15.180:6809/20944] conn(0x7ff6a4040830 0x7ff6a4042c50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.225 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.200+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== osd.1 v2:172.21.15.180:6808/20944 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7ff6a4043210 con 0x7ff6a4040830 2020-02-12T15:09:47.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 --> [v2:172.21.15.180:6808/20944,v1:172.21.15.180:6809/20944] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff6c409ce00 con 0x7ff6a4040830 2020-02-12T15:09:47.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6b6ffd700 1 -- 172.21.15.180:0/1484764747 <== osd.1 v2:172.21.15.180:6808/20944 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff6c409ce00 con 0x7ff6a4040830 2020-02-12T15:09:47.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:6808/20944,v1:172.21.15.180:6809/20944] conn(0x7ff6a4040830 msgr2=0x7ff6a4042c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:6808/20944,v1:172.21.15.180:6809/20944] conn(0x7ff6a4040830 0x7ff6a4042c50 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff6a4039be0 msgr2=0x7ff6a403c0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff6a4039be0 0x7ff6a403c0a0 crc :-1 s=READY pgs=61 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 msgr2=0x7ff6c413ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 secure :-1 s=READY pgs=120 cs=0 l=1 rx=0x7ff6bc0032b0 tx=0x7ff6bc007dc0).stop 2020-02-12T15:09:47.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca0e7700 1 -- 172.21.15.180:0/1484764747 reap_dead start 2020-02-12T15:09:47.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 shutdown_connections 2020-02-12T15:09:47.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.217+0000 7ff6ca8e8700 1 --2- 172.21.15.180:0/1484764747 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff6c41384b0 0x7ff6c413ecf0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.218+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 >> 172.21.15.180:0/1484764747 conn(0x7ff6c405a530 msgr2=0x7ff6c40a1250 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.218+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 shutdown_connections 2020-02-12T15:09:47.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.218+0000 7ff6ca8e8700 1 -- 172.21.15.180:0/1484764747 wait complete. 2020-02-12T15:09:47.230 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:47.230 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.2 flush_pg_stats 2020-02-12T15:09:47.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.334+0000 7f30b322a700 1 Processor -- start 2020-02-12T15:09:47.337 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.334+0000 7f30b322a700 1 -- start start 2020-02-12T15:09:47.345 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b322a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0656f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.345 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b322a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f30ac0ab130 0x7f30ac0ab5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.345 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b322a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac138130 con 0x7f30ac138b10 2020-02-12T15:09:47.345 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b322a700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30ac1383d0 con 0x7f30ac0ab130 2020-02-12T15:09:47.345 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b322a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac138670 con 0x7f30ac0a8660 2020-02-12T15:09:47.345 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f30ac0ab130 0x7f30ac0ab5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.345 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f30ac0ab130 0x7f30ac0ab5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51002/0 (socket says 172.21.15.180:51002) 2020-02-12T15:09:47.346 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 -- 172.21.15.180:0/124892108 learned_addr learned my addr 172.21.15.180:0/124892108 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:47.346 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b0fc6700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0656f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.346 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 -- 172.21.15.180:0/124892108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 msgr2=0x7f30ac0656f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.346 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0656f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.346 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 -- 172.21.15.180:0/124892108 >> v1:172.21.15.105:6789/0 conn(0x7f30ac138b10 legacy=0x7f30ac0a8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.347 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 -- 172.21.15.180:0/124892108 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac137e20 con 0x7f30ac0ab130 2020-02-12T15:09:47.347 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b0fc6700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:47.347 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.335+0000 7f30b17c7700 1 --2- 172.21.15.180:0/124892108 >> v2:172.21.15.180:3300/0 conn(0x7f30ac0ab130 0x7f30ac0ab5c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f30ac05b1c0 tx=0x7f30a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.347 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b17c7700 1 --2- 172.21.15.180:0/124892108 >> v2:172.21.15.180:3300/0 conn(0x7f30ac0ab130 0x7f30ac0ab5c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f30ac05b1c0 tx=0x7f30a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.347 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b17c7700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f30ac0ab130 0x7f30ac0ab5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f30ac05b1c0 tx=0x7f30a4008c60).ready entity=mon.1 client_cookie=7cb641bc50543e28 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.347 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b17c7700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f30ac0ab130 0x7f30ac0ab5c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f30ac05b1c0 tx=0x7f30a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.347 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b17c7700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f30ac0ab130 0x7f30ac0ab5c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f30ac05b1c0 tx=0x7f30a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30ab7fe700 1 -- 172.21.15.180:0/124892108 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30a400a160 con 0x7f30ac0ab130 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b17c7700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f30ac0ab130 0x7f30ac0ab5c0 secure :-1 s=THROTTLE_DONE pgs=121 cs=0 l=1 rx=0x7f30ac05b1c0 tx=0x7f30a4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30ab7fe700 1 -- 172.21.15.180:0/124892108 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a400a2c0 con 0x7f30ac0ab130 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30ab7fe700 1 -- 172.21.15.180:0/124892108 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30a400a660 con 0x7f30ac0ab130 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 -- 172.21.15.180:0/124892108 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f30ac0ab130 msgr2=0x7f30ac0ab5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f30ac0ab130 0x7f30ac0ab5c0 secure :-1 s=READY pgs=121 cs=0 l=1 rx=0x7f30ac05b1c0 tx=0x7f30a4008c60).stop 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 -- 172.21.15.180:0/124892108 shutdown_connections 2020-02-12T15:09:47.348 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f30ac0ab130 0x7f30ac0ab5c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.349 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 --2- 172.21.15.180:0/124892108 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0656f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.349 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 -- 172.21.15.180:0/124892108 >> 172.21.15.180:0/124892108 conn(0x7f30ac05e910 msgr2=0x7f30ac05ed20 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.349 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 -- 172.21.15.180:0/124892108 shutdown_connections 2020-02-12T15:09:47.349 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.336+0000 7f30b322a700 1 -- 172.21.15.180:0/124892108 wait complete. 2020-02-12T15:09:47.349 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.337+0000 7f30b322a700 1 Processor -- start 2020-02-12T15:09:47.349 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.337+0000 7f30b322a700 1 -- start start 2020-02-12T15:09:47.349 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30b322a700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0a24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30b322a700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac12ecb0 con 0x7f30ac138b10 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30b322a700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30ac12ef50 con 0x7f30ac0ab130 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30b322a700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac12eac0 con 0x7f30ac0a8660 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30abfff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f30ac0ab130 0x7f30ac12cf50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42520/0 (socket says 172.21.15.180:42520) 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30abfff700 1 -- 172.21.15.180:0/3660405192 learned_addr learned my addr 172.21.15.180:0/3660405192 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3678119934 0 0) 0x7f30ac12ef50 con 0x7f30ac0ab130 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f308c002fe0 con 0x7f30ac0ab130 2020-02-12T15:09:47.350 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30b0fc6700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0a24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.351 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 662178430 0 0) 0x7f308c002fe0 con 0x7f30ac0ab130 2020-02-12T15:09:47.351 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f30ac12ef50 con 0x7f30ac0ab130 2020-02-12T15:09:47.351 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.338+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f30a0002970 con 0x7f30ac0ab130 2020-02-12T15:09:47.351 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 msgr2=0x7f30ac0a24d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.351 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f30ac0a24d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.351 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 >> v1:172.21.15.180:6789/0 conn(0x7f30ac0ab130 legacy=0x7f30ac12cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.351 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 >> v1:172.21.15.105:6789/0 conn(0x7f30ac138b10 legacy=0x7f30ac14fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.352 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f308c0049b0 0x7f308c004d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.352 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f308c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.352 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.352 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c004750 con 0x7f308c0049b0 2020-02-12T15:09:47.353 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0052f0 con 0x7f308c003d80 2020-02-12T15:09:47.353 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308c0054b0 con 0x7f30ac0a8660 2020-02-12T15:09:47.353 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.353 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b0fc6700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f308c0049b0 0x7f308c004d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.353 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30abfff700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f308c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.353 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 -- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 msgr2=0x7f308c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.353 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f30ac0a8660 0x7f308c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 -- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f308c0049b0 msgr2=0x7f308c004d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f308c0049b0 0x7f308c004d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac0a5250 con 0x7f308c003d80 2020-02-12T15:09:47.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0a4000 con 0x7f308c003d80 2020-02-12T15:09:47.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac0a4ee0 con 0x7f308c003d80 2020-02-12T15:09:47.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30a4005a40 con 0x7f308c003d80 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30a4005be0 con 0x7f308c003d80 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.339+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f30a4010640 con 0x7f308c003d80 2020-02-12T15:09:47.355 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.356 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3088003580 con 0x7f308c003d80 2020-02-12T15:09:47.356 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f30a400f570 con 0x7f308c003d80 2020-02-12T15:09:47.356 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.356 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30b17c7700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=THROTTLE_DONE pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.356 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30a9ffb700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f308c041f60 0x7f308c044420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.356 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f30a404a870 con 0x7f308c003d80 2020-02-12T15:09:47.357 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30a9ffb700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:6816/20953,v1:172.21.15.180:6817/20953] conn(0x7f308c048950 0x7f308c04ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.357 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.180:6816/20953,v1:172.21.15.180:6817/20953] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f308c04b3c0 con 0x7f308c048950 2020-02-12T15:09:47.357 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f30a404bd10 con 0x7f308c003d80 2020-02-12T15:09:47.357 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30b0fc6700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f308c041f60 0x7f308c044420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.357 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.340+0000 7f30abfff700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:6816/20953,v1:172.21.15.180:6817/20953] conn(0x7f308c048950 0x7f308c04ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.357 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.341+0000 7f30b0fc6700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f308c041f60 0x7f308c044420 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.357 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.341+0000 7f30abfff700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:6816/20953,v1:172.21.15.180:6817/20953] conn(0x7f308c048950 0x7f308c04ad70 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.358 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.341+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== osd.2 v2:172.21.15.180:6816/20953 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f308c04b3c0 con 0x7f308c048950 2020-02-12T15:09:47.362 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 --> [v2:172.21.15.180:6816/20953,v1:172.21.15.180:6817/20953] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f3088002680 con 0x7f308c048950 2020-02-12T15:09:47.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30a9ffb700 1 -- 172.21.15.180:0/3660405192 <== osd.2 v2:172.21.15.180:6816/20953 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f3088002680 con 0x7f308c048950 2020-02-12T15:09:47.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:6816/20953,v1:172.21.15.180:6817/20953] conn(0x7f308c048950 msgr2=0x7f308c04ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:6816/20953,v1:172.21.15.180:6817/20953] conn(0x7f308c048950 0x7f308c04ad70 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b17c7700 1 -- 172.21.15.180:0/3660405192 reap_dead start 2020-02-12T15:09:47.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f308c041f60 msgr2=0x7f308c044420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f308c041f60 0x7f308c044420 crc :-1 s=READY pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 msgr2=0x7f308c004200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 secure :-1 s=READY pgs=123 cs=0 l=1 rx=0x7f30a4008250 tx=0x7f30ac137fb0).stop 2020-02-12T15:09:47.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 shutdown_connections 2020-02-12T15:09:47.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f308c003d80 0x7f308c004200 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 --2- 172.21.15.180:0/3660405192 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f308c041f60 0x7f308c044420 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 >> 172.21.15.180:0/3660405192 conn(0x7f30ac05e910 msgr2=0x7f30ac065030 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.365 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 shutdown_connections 2020-02-12T15:09:47.365 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.359+0000 7f30b322a700 1 -- 172.21.15.180:0/3660405192 wait complete. 2020-02-12T15:09:47.371 INFO:teuthology.orchestra.run.smithi180.stdout:55834574854 2020-02-12T15:09:47.372 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.3 flush_pg_stats 2020-02-12T15:09:47.487 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.476+0000 7f6fdd980700 1 Processor -- start 2020-02-12T15:09:47.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.476+0000 7f6fdd980700 1 -- start start 2020-02-12T15:09:47.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fdd980700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6fd812f140 0x7f6fd8134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fdd980700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80a3f10 con 0x7f6fd80aac00 2020-02-12T15:09:47.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fdd980700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80a41b0 con 0x7f6fd80a3990 2020-02-12T15:09:47.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fdd980700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80a4450 con 0x7f6fd812f140 2020-02-12T15:09:47.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd67fc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f6fd80a3990 0x7f6fd812ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42536/0 (socket says 172.21.15.180:42536) 2020-02-12T15:09:47.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2274590113 learned_addr learned my addr 172.21.15.180:0/2274590113 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd77fe700 1 --2- 172.21.15.180:0/2274590113 >> v2:172.21.15.105:3300/0 conn(0x7f6fd812f140 0x7f6fd8134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2882762861 0 0) 0x7f6fd80a41b0 con 0x7f6fd80a3990 2020-02-12T15:09:47.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fbc003230 con 0x7f6fd80a3990 2020-02-12T15:09:47.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1145163753 0 0) 0x7f6fd80a3f10 con 0x7f6fd80aac00 2020-02-12T15:09:47.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd80a41b0 con 0x7f6fd80aac00 2020-02-12T15:09:47.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 742621519 0 0) 0x7f6fbc003230 con 0x7f6fd80a3990 2020-02-12T15:09:47.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 >> v2:172.21.15.105:3300/0 conn(0x7f6fd812f140 msgr2=0x7f6fd8134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.477+0000 7f6fd5ffb700 1 --2- 172.21.15.180:0/2274590113 >> v2:172.21.15.105:3300/0 conn(0x7f6fd812f140 0x7f6fd8134c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 >> v1:172.21.15.105:6789/0 conn(0x7f6fd80aac00 legacy=0x7f6fd80a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd81350e0 con 0x7f6fd80a3990 2020-02-12T15:09:47.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f6fc80016d0 con 0x7f6fd80a3990 2020-02-12T15:09:47.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 >> v1:172.21.15.180:6789/0 conn(0x7f6fd80a3990 legacy=0x7f6fd812ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fbc0038b0 0x7f6fbc003cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fbc004db0 0x7f6fbc00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80a4450 con 0x7f6fbc0038b0 2020-02-12T15:09:47.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc0053a0 con 0x7f6fbc0044d0 2020-02-12T15:09:47.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fbc00bc00 con 0x7f6fbc004db0 2020-02-12T15:09:47.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd77fe700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fbc004db0 0x7f6fbc00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd6ffd700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fbc0038b0 0x7f6fbc003cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fbc004db0 msgr2=0x7f6fbc00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6fbc004db0 0x7f6fbc00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fbc0038b0 msgr2=0x7f6fbc003cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fbc0038b0 0x7f6fbc003cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd77fe700 1 -- 172.21.15.180:0/2274590113 reap_dead start 2020-02-12T15:09:47.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2274590113 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fbc003230 con 0x7f6fbc0044d0 2020-02-12T15:09:47.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd6ffd700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6fbc0038b0 0x7f6fbc003cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:47.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).ready entity=mon.1 client_cookie=79fc334251239e18 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fc800ee60 con 0x7f6fbc0044d0 2020-02-12T15:09:47.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc8010e50 con 0x7f6fbc0044d0 2020-02-12T15:09:47.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 secure :-1 s=THROTTLE_DONE pgs=125 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fdd980700 1 -- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 msgr2=0x7f6fbc004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fd5ffb700 1 -- 172.21.15.180:0/2274590113 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fc8010390 con 0x7f6fbc0044d0 2020-02-12T15:09:47.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.478+0000 7f6fdd980700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 secure :-1 s=READY pgs=125 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).stop 2020-02-12T15:09:47.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.479+0000 7f6fdd980700 1 -- 172.21.15.180:0/2274590113 shutdown_connections 2020-02-12T15:09:47.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.479+0000 7f6fdd980700 1 --2- 172.21.15.180:0/2274590113 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fbc0044d0 0x7f6fbc004950 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.479+0000 7f6fdd980700 1 -- 172.21.15.180:0/2274590113 >> 172.21.15.180:0/2274590113 conn(0x7f6fd809d450 msgr2=0x7f6fd809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.479+0000 7f6fdd980700 1 -- 172.21.15.180:0/2274590113 shutdown_connections 2020-02-12T15:09:47.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.479+0000 7f6fdd980700 1 -- 172.21.15.180:0/2274590113 wait complete. 2020-02-12T15:09:47.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fdd980700 1 Processor -- start 2020-02-12T15:09:47.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fdd980700 1 -- start start 2020-02-12T15:09:47.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fdd980700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f6fd8147040 0x7f6fd809eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fdd980700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd8061e70 con 0x7f6fbc0044d0 2020-02-12T15:09:47.498 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fdd980700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd8062110 con 0x7f6fd812b4b0 2020-02-12T15:09:47.498 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fdd980700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd812c010 con 0x7f6fd8147040 2020-02-12T15:09:47.498 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fd67fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f6fd8147040 0x7f6fd809eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.498 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fd67fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f6fd8147040 0x7f6fd809eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51034/0 (socket says 172.21.15.180:51034) 2020-02-12T15:09:47.498 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fd77fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f6fd812b4b0 0x7f6fd812b900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42550/0 (socket says 172.21.15.180:42550) 2020-02-12T15:09:47.499 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.480+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2187583953 learned_addr learned my addr 172.21.15.180:0/2187583953 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:47.505 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2187583953 >> v1:172.21.15.180:6789/0 conn(0x7f6fd812b4b0 legacy=0x7f6fd812b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.505 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2187583953 >> v1:172.21.15.105:6789/0 conn(0x7f6fbc0044d0 legacy=0x7f6fd8146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.505 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3442394653 0 0) 0x7f6fd8062110 con 0x7f6fd812b4b0 2020-02-12T15:09:47.505 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 -- 172.21.15.180:0/2187583953 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd8061a80 con 0x7f6fd8147040 2020-02-12T15:09:47.505 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> v2:172.21.15.180:3300/0 conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.505 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> v2:172.21.15.180:3300/0 conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.506 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.506 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.506 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fc8000e90 con 0x7f6fd8147040 2020-02-12T15:09:47.506 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.506 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.506 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc800b2d0 con 0x7f6fd8147040 2020-02-12T15:09:47.506 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd812e040 con 0x7f6fd8147040 2020-02-12T15:09:47.507 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6fc80151f0 con 0x7f6fd8147040 2020-02-12T15:09:47.507 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd814e960 con 0x7f6fd8147040 2020-02-12T15:09:47.507 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.481+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.507 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f6fc80044f0 con 0x7f6fd8147040 2020-02-12T15:09:47.507 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.507 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6fd8131ad0 con 0x7f6fd8147040 2020-02-12T15:09:47.507 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fd67fc700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=THROTTLE_DONE pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.508 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fc7fff700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6fb4039b10 0x7f6fb403bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.508 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6fc80498e0 con 0x7f6fd8147040 2020-02-12T15:09:47.508 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fc7fff700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:6824/20974,v1:172.21.15.180:6825/20974] conn(0x7f6fb4040760 0x7f6fb4042b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.508 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 --> [v2:172.21.15.180:6824/20974,v1:172.21.15.180:6825/20974] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6fb4043140 con 0x7f6fb4040760 2020-02-12T15:09:47.509 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f6fc804ada0 con 0x7f6fd8147040 2020-02-12T15:09:47.509 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fd6ffd700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6fb4039b10 0x7f6fb403bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.509 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fd77fe700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:6824/20974,v1:172.21.15.180:6825/20974] conn(0x7f6fb4040760 0x7f6fb4042b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.509 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fd77fe700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:6824/20974,v1:172.21.15.180:6825/20974] conn(0x7f6fb4040760 0x7f6fb4042b80 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.510 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.482+0000 7f6fd6ffd700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6fb4039b10 0x7f6fb403bfd0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.510 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.483+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== osd.3 v2:172.21.15.180:6824/20974 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f6fb4043140 con 0x7f6fb4040760 2020-02-12T15:09:47.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.500+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 --> [v2:172.21.15.180:6824/20974,v1:172.21.15.180:6825/20974] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6fd80a83d0 con 0x7f6fb4040760 2020-02-12T15:09:47.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.500+0000 7f6fc7fff700 1 -- 172.21.15.180:0/2187583953 <== osd.3 v2:172.21.15.180:6824/20974 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6fd80a83d0 con 0x7f6fb4040760 2020-02-12T15:09:47.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:6824/20974,v1:172.21.15.180:6825/20974] conn(0x7f6fb4040760 msgr2=0x7f6fb4042b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.514 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:6824/20974,v1:172.21.15.180:6825/20974] conn(0x7f6fb4040760 0x7f6fb4042b80 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6fb4039b10 msgr2=0x7f6fb403bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6fb4039b10 0x7f6fb403bfd0 crc :-1 s=READY pgs=63 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 msgr2=0x7f6fd809eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 secure :-1 s=READY pgs=127 cs=0 l=1 rx=0x7f6fc80014a0 tx=0x7f6fd8135270).stop 2020-02-12T15:09:47.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fd77fe700 1 -- 172.21.15.180:0/2187583953 reap_dead start 2020-02-12T15:09:47.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 shutdown_connections 2020-02-12T15:09:47.515 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 --2- 172.21.15.180:0/2187583953 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6fd8147040 0x7f6fd809eb70 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 >> 172.21.15.180:0/2187583953 conn(0x7f6fd809d450 msgr2=0x7f6fd80a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 shutdown_connections 2020-02-12T15:09:47.516 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.501+0000 7f6fdd980700 1 -- 172.21.15.180:0/2187583953 wait complete. 2020-02-12T15:09:47.516 INFO:teuthology.orchestra.run.smithi180.stdout:55834574854 2020-02-12T15:09:47.516 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.4 flush_pg_stats 2020-02-12T15:09:47.623 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.621+0000 7f149d584700 1 Processor -- start 2020-02-12T15:09:47.623 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.621+0000 7f149d584700 1 -- start start 2020-02-12T15:09:47.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.621+0000 7f149d584700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f14980a9320 0x7f14980a8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.621+0000 7f149d584700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149805ec90 con 0x7f14980a8f40 2020-02-12T15:09:47.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.621+0000 7f149d584700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149805ef30 con 0x7f14981387f0 2020-02-12T15:09:47.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.621+0000 7f149d584700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f149805f1d0 con 0x7f14980a9320 2020-02-12T15:09:47.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.621+0000 7f14977fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f14980a9320 0x7f14980a8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14967fc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f14981387f0 0x7f14980a7d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42558/0 (socket says 172.21.15.180:42558) 2020-02-12T15:09:47.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14967fc700 1 -- 172.21.15.180:0/1767856037 learned_addr learned my addr 172.21.15.180:0/1767856037 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f14980a9320 0x7f14980a8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51046/0 (socket says 172.21.15.180:51046) 2020-02-12T15:09:47.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 -- 172.21.15.180:0/1767856037 >> v1:172.21.15.180:6789/0 conn(0x7f14981387f0 legacy=0x7f14980a7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 -- 172.21.15.180:0/1767856037 >> v1:172.21.15.105:6789/0 conn(0x7f14980a8f40 legacy=0x7f14981380e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 -- 172.21.15.180:0/1767856037 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14980a88e0 con 0x7f14980a9320 2020-02-12T15:09:47.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 --2- 172.21.15.180:0/1767856037 >> v2:172.21.15.180:3300/0 conn(0x7f14980a9320 0x7f14980a8480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f1498062240 tx=0x7f1490008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 --2- 172.21.15.180:0/1767856037 >> v2:172.21.15.180:3300/0 conn(0x7f14980a9320 0x7f14980a8480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f1498062240 tx=0x7f1490008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 --2- 172.21.15.180:0/1767856037 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f14980a9320 0x7f14980a8480 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f1498062240 tx=0x7f1490008c60).ready entity=mon.1 client_cookie=2b9afd5cea758a9 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 --2- 172.21.15.180:0/1767856037 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f14980a9320 0x7f14980a8480 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1498062240 tx=0x7f1490008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f1495ffb700 1 -- 172.21.15.180:0/1767856037 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f149000a160 con 0x7f14980a9320 2020-02-12T15:09:47.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 --2- 172.21.15.180:0/1767856037 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f14980a9320 0x7f14980a8480 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1498062240 tx=0x7f1490008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f14977fe700 1 --2- 172.21.15.180:0/1767856037 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f14980a9320 0x7f14980a8480 secure :-1 s=THROTTLE_DONE pgs=129 cs=0 l=1 rx=0x7f1498062240 tx=0x7f1490008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f1495ffb700 1 -- 172.21.15.180:0/1767856037 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149000a2c0 con 0x7f14980a9320 2020-02-12T15:09:47.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f1495ffb700 1 -- 172.21.15.180:0/1767856037 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f149000a6a0 con 0x7f14980a9320 2020-02-12T15:09:47.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f149d584700 1 -- 172.21.15.180:0/1767856037 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f14980a9320 msgr2=0x7f14980a8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.622+0000 7f149d584700 1 --2- 172.21.15.180:0/1767856037 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f14980a9320 0x7f14980a8480 secure :-1 s=READY pgs=129 cs=0 l=1 rx=0x7f1498062240 tx=0x7f1490008c60).stop 2020-02-12T15:09:47.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.623+0000 7f149d584700 1 -- 172.21.15.180:0/1767856037 shutdown_connections 2020-02-12T15:09:47.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.623+0000 7f149d584700 1 --2- 172.21.15.180:0/1767856037 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f14980a9320 0x7f14980a8480 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.623+0000 7f149d584700 1 -- 172.21.15.180:0/1767856037 >> 172.21.15.180:0/1767856037 conn(0x7f149805a530 msgr2=0x7f149805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.623+0000 7f149d584700 1 -- 172.21.15.180:0/1767856037 shutdown_connections 2020-02-12T15:09:47.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.623+0000 7f149d584700 1 -- 172.21.15.180:0/1767856037 wait complete. 2020-02-12T15:09:47.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.623+0000 7f149d584700 1 Processor -- start 2020-02-12T15:09:47.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f149d584700 1 -- start start 2020-02-12T15:09:47.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f149d584700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f14980a8f40 0x7f14980a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f149d584700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149813b170 con 0x7f14981387f0 2020-02-12T15:09:47.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f149d584700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f149813b410 con 0x7f14980a9320 2020-02-12T15:09:47.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f149d584700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14980a4a90 con 0x7f14980a8f40 2020-02-12T15:09:47.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f14967fc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f14980a9320 0x7f1498139350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42562/0 (socket says 172.21.15.180:42562) 2020-02-12T15:09:47.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f14967fc700 1 -- 172.21.15.180:0/2405527518 learned_addr learned my addr 172.21.15.180:0/2405527518 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1638996396 0 0) 0x7f149813b410 con 0x7f14980a9320 2020-02-12T15:09:47.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1474002fe0 con 0x7f14980a9320 2020-02-12T15:09:47.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.624+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> v2:172.21.15.105:3300/0 conn(0x7f14980a8f40 0x7f14980a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3008343016 0 0) 0x7f1474002fe0 con 0x7f14980a9320 2020-02-12T15:09:47.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f149813b410 con 0x7f14980a9320 2020-02-12T15:09:47.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f148c001850 con 0x7f14980a9320 2020-02-12T15:09:47.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 >> v2:172.21.15.105:3300/0 conn(0x7f14980a8f40 msgr2=0x7f14980a5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 --2- 172.21.15.180:0/2405527518 >> v2:172.21.15.105:3300/0 conn(0x7f14980a8f40 0x7f14980a5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 >> v1:172.21.15.180:6789/0 conn(0x7f14980a9320 legacy=0x7f1498139350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 >> v1:172.21.15.105:6789/0 conn(0x7f14981387f0 legacy=0x7f1498131a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1474003920 0x7f1474003d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14740041c0 0x7f147400b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14980a4a90 con 0x7f14740041c0 2020-02-12T15:09:47.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1474004750 con 0x7f1474004a00 2020-02-12T15:09:47.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f147400bbb0 con 0x7f1474003920 2020-02-12T15:09:47.638 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f14967fc700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1474003920 0x7f1474003d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f14977fe700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14740041c0 0x7f147400b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 -- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1474003920 msgr2=0x7f1474003d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f1474003920 0x7f1474003d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 -- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14740041c0 msgr2=0x7f147400b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.639 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f14740041c0 0x7f147400b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14980a58e0 con 0x7f1474004a00 2020-02-12T15:09:47.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f14977fe700 1 -- 172.21.15.180:0/2405527518 reap_dead start 2020-02-12T15:09:47.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f149813ad80 con 0x7f1474004a00 2020-02-12T15:09:47.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14980abd30 con 0x7f1474004a00 2020-02-12T15:09:47.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.640 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1488002e40 con 0x7f1474004a00 2020-02-12T15:09:47.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.641 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14880032b0 con 0x7f1474004a00 2020-02-12T15:09:47.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.625+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1488003690 con 0x7f1474004a00 2020-02-12T15:09:47.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1478003580 con 0x7f1474004a00 2020-02-12T15:09:47.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f14880064e0 con 0x7f1474004a00 2020-02-12T15:09:47.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1496ffd700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=THROTTLE_DONE pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.642 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1487fff700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f147403dcd0 0x7f1474040190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f14880492a0 con 0x7f1474004a00 2020-02-12T15:09:47.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1487fff700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] conn(0x7f14740448a0 0x7f1474046cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.643 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f14967fc700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f147403dcd0 0x7f1474040190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1474047280 con 0x7f14740448a0 2020-02-12T15:09:47.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.626+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f148804a760 con 0x7f1474004a00 2020-02-12T15:09:47.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.627+0000 7f14977fe700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] conn(0x7f14740448a0 0x7f1474046cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.627+0000 7f14967fc700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f147403dcd0 0x7f1474040190 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.627+0000 7f14977fe700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] conn(0x7f14740448a0 0x7f1474046cc0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.644 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.628+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== osd.4 v2:172.21.15.105:6818/22604 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f1474047280 con 0x7f14740448a0 2020-02-12T15:09:47.647 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.645+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 --> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f1478002680 con 0x7f14740448a0 2020-02-12T15:09:47.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.645+0000 7f1487fff700 1 -- 172.21.15.180:0/2405527518 <== osd.4 v2:172.21.15.105:6818/22604 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f1478002680 con 0x7f14740448a0 2020-02-12T15:09:47.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] conn(0x7f14740448a0 msgr2=0x7f1474046cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] conn(0x7f14740448a0 0x7f1474046cc0 crc :-1 s=READY pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.649 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f147403dcd0 msgr2=0x7f1474040190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f147403dcd0 0x7f1474040190 crc :-1 s=READY pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 msgr2=0x7f1474004e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 secure :-1 s=READY pgs=131 cs=0 l=1 rx=0x7f1488001f50 tx=0x7f1488002680).stop 2020-02-12T15:09:47.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 shutdown_connections 2020-02-12T15:09:47.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f147403dcd0 0x7f1474040190 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.650 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.105:6818/22604,v1:172.21.15.105:6819/22604] conn(0x7f14740448a0 0x7f1474046cc0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 --2- 172.21.15.180:0/2405527518 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f1474004a00 0x7f1474004e20 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 >> 172.21.15.180:0/2405527518 conn(0x7f149805a530 msgr2=0x7f149805a910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 shutdown_connections 2020-02-12T15:09:47.651 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.646+0000 7f149d584700 1 -- 172.21.15.180:0/2405527518 wait complete. 2020-02-12T15:09:47.658 INFO:teuthology.orchestra.run.smithi180.stdout:55834574854 2020-02-12T15:09:47.658 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.5 flush_pg_stats 2020-02-12T15:09:47.764 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.762+0000 7f23517b9700 1 Processor -- start 2020-02-12T15:09:47.765 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.762+0000 7f23517b9700 1 -- start start 2020-02-12T15:09:47.772 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f23517b9700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c098fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.773 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f23517b9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f234c0a8520 0x7f234c0a8980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.773 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f23517b9700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c098dc0 con 0x7f234c099410 2020-02-12T15:09:47.773 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f23517b9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c098880 con 0x7f234c0a8520 2020-02-12T15:09:47.774 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f23517b9700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c098b20 con 0x7f234c0a4db0 2020-02-12T15:09:47.774 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f234affd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c098fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.774 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f234a7fc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f234c099410 0x7f234c0a7e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42580/0 (socket says 172.21.15.180:42580) 2020-02-12T15:09:47.774 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f234affd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c098fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51064/0 (socket says 172.21.15.180:51064) 2020-02-12T15:09:47.775 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f234a7fc700 1 -- 172.21.15.180:0/2779089736 learned_addr learned my addr 172.21.15.180:0/2779089736 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.775 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f234b7fe700 1 --2- 172.21.15.180:0/2779089736 >> v2:172.21.15.105:3300/0 conn(0x7f234c0a8520 0x7f234c0a8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.775 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f234affd700 1 -- 172.21.15.180:0/2779089736 >> v2:172.21.15.105:3300/0 conn(0x7f234c0a8520 msgr2=0x7f234c0a8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.776 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f234affd700 1 --2- 172.21.15.180:0/2779089736 >> v2:172.21.15.105:3300/0 conn(0x7f234c0a8520 0x7f234c0a8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.776 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 -- 172.21.15.180:0/2779089736 >> v1:172.21.15.180:6789/0 conn(0x7f234c099410 legacy=0x7f234c0a7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.776 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.763+0000 7f2349ffb700 1 -- 172.21.15.180:0/2779089736 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3740845373 0 0) 0x7f234c098dc0 con 0x7f234c099410 2020-02-12T15:09:47.776 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 -- 172.21.15.180:0/2779089736 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c0a6120 con 0x7f234c0a4db0 2020-02-12T15:09:47.776 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234b7fe700 1 --2- 172.21.15.180:0/2779089736 >> v2:172.21.15.105:3300/0 conn(0x7f234c0a8520 0x7f234c0a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:47.776 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 --2- 172.21.15.180:0/2779089736 >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c098fb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f233c0032b0 tx=0x7f233c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.776 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 --2- 172.21.15.180:0/2779089736 >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c098fb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f233c0032b0 tx=0x7f233c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.777 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 --2- 172.21.15.180:0/2779089736 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c098fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f233c0032b0 tx=0x7f233c007dc0).ready entity=mon.1 client_cookie=45504edda1937239 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.777 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 --2- 172.21.15.180:0/2779089736 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c098fb0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f233c0032b0 tx=0x7f233c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.777 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f2349ffb700 1 -- 172.21.15.180:0/2779089736 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233c00a160 con 0x7f234c0a4db0 2020-02-12T15:09:47.777 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 --2- 172.21.15.180:0/2779089736 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c098fb0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f233c0032b0 tx=0x7f233c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.777 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f234affd700 1 --2- 172.21.15.180:0/2779089736 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c098fb0 secure :-1 s=THROTTLE_DONE pgs=133 cs=0 l=1 rx=0x7f233c0032b0 tx=0x7f233c007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.777 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f2349ffb700 1 -- 172.21.15.180:0/2779089736 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f233c00a2c0 con 0x7f234c0a4db0 2020-02-12T15:09:47.778 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f2349ffb700 1 -- 172.21.15.180:0/2779089736 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f233c00a660 con 0x7f234c0a4db0 2020-02-12T15:09:47.778 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 -- 172.21.15.180:0/2779089736 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 msgr2=0x7f234c098fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.778 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 --2- 172.21.15.180:0/2779089736 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c098fb0 secure :-1 s=READY pgs=133 cs=0 l=1 rx=0x7f233c0032b0 tx=0x7f233c007dc0).stop 2020-02-12T15:09:47.778 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 -- 172.21.15.180:0/2779089736 shutdown_connections 2020-02-12T15:09:47.778 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 --2- 172.21.15.180:0/2779089736 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c098fb0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.780 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 --2- 172.21.15.180:0/2779089736 >> v2:172.21.15.105:3300/0 conn(0x7f234c0a8520 0x7f234c0a8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.780 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 -- 172.21.15.180:0/2779089736 >> 172.21.15.180:0/2779089736 conn(0x7f234c05b640 msgr2=0x7f234c05ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.780 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 -- 172.21.15.180:0/2779089736 shutdown_connections 2020-02-12T15:09:47.780 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.764+0000 7f23517b9700 1 -- 172.21.15.180:0/2779089736 wait complete. 2020-02-12T15:09:47.780 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.765+0000 7f23517b9700 1 Processor -- start 2020-02-12T15:09:47.781 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.765+0000 7f23517b9700 1 -- start start 2020-02-12T15:09:47.781 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f23517b9700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f234c099410 0x7f234c1434b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.781 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f23517b9700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c09c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.781 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f23517b9700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f234c066f20 con 0x7f234c0a8520 2020-02-12T15:09:47.781 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f23517b9700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c09c180 con 0x7f234c099410 2020-02-12T15:09:47.781 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f23517b9700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f234c09c420 con 0x7f234c0a4db0 2020-02-12T15:09:47.781 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c09c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.782 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c09c8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51072/0 (socket says 172.21.15.180:51072) 2020-02-12T15:09:47.782 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 -- 172.21.15.180:0/193171698 learned_addr learned my addr 172.21.15.180:0/193171698 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:47.782 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234affd700 1 --2- 172.21.15.180:0/193171698 >> v2:172.21.15.105:3300/0 conn(0x7f234c099410 0x7f234c1434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.782 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 -- 172.21.15.180:0/193171698 >> v2:172.21.15.105:3300/0 conn(0x7f234c099410 msgr2=0x7f234c1434b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.782 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> v2:172.21.15.105:3300/0 conn(0x7f234c099410 0x7f234c1434b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.782 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 938711716 0 0) 0x7f234c066f20 con 0x7f234c0a8520 2020-02-12T15:09:47.782 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 -- 172.21.15.180:0/193171698 >> v1:172.21.15.180:6789/0 conn(0x7f234c0a8520 legacy=0x7f234c143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 -- 172.21.15.180:0/193171698 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f234c09f840 con 0x7f234c0a4db0 2020-02-12T15:09:47.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> v2:172.21.15.180:3300/0 conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2340005ca0 con 0x7f234c0a4db0 2020-02-12T15:09:47.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2340005e00 con 0x7f234c0a4db0 2020-02-12T15:09:47.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.766+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f234c09cd20 con 0x7f234c0a4db0 2020-02-12T15:09:47.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.767+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f23400062b0 con 0x7f234c0a4db0 2020-02-12T15:09:47.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.767+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f234c144300 con 0x7f234c0a4db0 2020-02-12T15:09:47.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.767+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.767+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f234c09c620 con 0x7f234c0a4db0 2020-02-12T15:09:47.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.767+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f23400064f0 con 0x7f234c0a4db0 2020-02-12T15:09:47.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.767+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.767+0000 7f234a7fc700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=THROTTLE_DONE pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f233bfff700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2328039a60 0x7f232803bf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2340049a30 con 0x7f234c0a4db0 2020-02-12T15:09:47.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f233bfff700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6802/22574,v1:172.21.15.105:6803/22574] conn(0x7f23280406b0 0x7f2328042ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 --> [v2:172.21.15.105:6802/22574,v1:172.21.15.105:6803/22574] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2328043090 con 0x7f23280406b0 2020-02-12T15:09:47.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f234004af50 con 0x7f234c0a4db0 2020-02-12T15:09:47.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f234affd700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2328039a60 0x7f232803bf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f234b7fe700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6802/22574,v1:172.21.15.105:6803/22574] conn(0x7f23280406b0 0x7f2328042ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f234affd700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2328039a60 0x7f232803bf20 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.768+0000 7f234b7fe700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6802/22574,v1:172.21.15.105:6803/22574] conn(0x7f23280406b0 0x7f2328042ad0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.769+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== osd.5 v2:172.21.15.105:6802/22574 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f2328043090 con 0x7f23280406b0 2020-02-12T15:09:47.789 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.786+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 --> [v2:172.21.15.105:6802/22574,v1:172.21.15.105:6803/22574] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f234c0565b0 con 0x7f23280406b0 2020-02-12T15:09:47.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f233bfff700 1 -- 172.21.15.180:0/193171698 <== osd.5 v2:172.21.15.105:6802/22574 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f234c0565b0 con 0x7f23280406b0 2020-02-12T15:09:47.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6802/22574,v1:172.21.15.105:6803/22574] conn(0x7f23280406b0 msgr2=0x7f2328042ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6802/22574,v1:172.21.15.105:6803/22574] conn(0x7f23280406b0 0x7f2328042ad0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2328039a60 msgr2=0x7f232803bf20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2328039a60 0x7f232803bf20 crc :-1 s=READY pgs=65 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 msgr2=0x7f234c09c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 secure :-1 s=READY pgs=135 cs=0 l=1 rx=0x7f2340000b80 tx=0x7f23400109d0).stop 2020-02-12T15:09:47.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f234b7fe700 1 -- 172.21.15.180:0/193171698 reap_dead start 2020-02-12T15:09:47.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 shutdown_connections 2020-02-12T15:09:47.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 --2- 172.21.15.180:0/193171698 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f234c0a4db0 0x7f234c09c8c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 >> 172.21.15.180:0/193171698 conn(0x7f234c05b640 msgr2=0x7f234c0698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 shutdown_connections 2020-02-12T15:09:47.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.787+0000 7f23517b9700 1 -- 172.21.15.180:0/193171698 wait complete. 2020-02-12T15:09:47.799 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:47.800 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.6 flush_pg_stats 2020-02-12T15:09:47.906 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.904+0000 7fbce7fff700 1 Processor -- start 2020-02-12T15:09:47.907 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.904+0000 7fbce7fff700 1 -- start start 2020-02-12T15:09:47.913 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce7fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fbce80a5fa0 0x7fbce813c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.914 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce7fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbce813cdd0 0x7fbce813f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:47.914 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce7fff700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80a3b30 con 0x7fbce80a5bc0 2020-02-12T15:09:47.914 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce7fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80a23b0 con 0x7fbce813cdd0 2020-02-12T15:09:47.914 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce7fff700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80a2650 con 0x7fbce80a5fa0 2020-02-12T15:09:47.914 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fbce80a5fa0 0x7fbce813c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.914 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce6ffd700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fbce80a5bc0 0x7fbce80a1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42594/0 (socket says 172.21.15.180:42594) 2020-02-12T15:09:47.914 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce6ffd700 1 -- 172.21.15.180:0/2313310848 learned_addr learned my addr 172.21.15.180:0/2313310848 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:47.915 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce77fe700 1 --2- 172.21.15.180:0/2313310848 >> v2:172.21.15.105:3300/0 conn(0x7fbce813cdd0 0x7fbce813f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.915 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 -- 172.21.15.180:0/2313310848 >> v2:172.21.15.105:3300/0 conn(0x7fbce813cdd0 msgr2=0x7fbce813f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:47.915 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 --2- 172.21.15.180:0/2313310848 >> v2:172.21.15.105:3300/0 conn(0x7fbce813cdd0 0x7fbce813f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.915 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 -- 172.21.15.180:0/2313310848 >> v1:172.21.15.180:6789/0 conn(0x7fbce80a5bc0 legacy=0x7fbce80a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.915 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce5ffb700 1 -- 172.21.15.180:0/2313310848 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2000114588 0 0) 0x7fbce80a3b30 con 0x7fbce80a5bc0 2020-02-12T15:09:47.916 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 -- 172.21.15.180:0/2313310848 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce80a1b70 con 0x7fbce80a5fa0 2020-02-12T15:09:47.917 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 --2- 172.21.15.180:0/2313310848 >> v2:172.21.15.180:3300/0 conn(0x7fbce80a5fa0 0x7fbce813c970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.917 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 --2- 172.21.15.180:0/2313310848 >> v2:172.21.15.180:3300/0 conn(0x7fbce80a5fa0 0x7fbce813c970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.917 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.905+0000 7fbce67fc700 1 --2- 172.21.15.180:0/2313310848 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbce80a5fa0 0x7fbce813c970 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).ready entity=mon.1 client_cookie=aaf48d5a8f08e835 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.917 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce67fc700 1 --2- 172.21.15.180:0/2313310848 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbce80a5fa0 0x7fbce813c970 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.917 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce5ffb700 1 -- 172.21.15.180:0/2313310848 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd80113c0 con 0x7fbce80a5fa0 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce67fc700 1 --2- 172.21.15.180:0/2313310848 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbce80a5fa0 0x7fbce813c970 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce5ffb700 1 -- 172.21.15.180:0/2313310848 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd8011520 con 0x7fbce80a5fa0 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce67fc700 1 --2- 172.21.15.180:0/2313310848 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbce80a5fa0 0x7fbce813c970 secure :-1 s=THROTTLE_DONE pgs=137 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce5ffb700 1 -- 172.21.15.180:0/2313310848 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd80118c0 con 0x7fbce80a5fa0 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 -- 172.21.15.180:0/2313310848 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbce80a5fa0 msgr2=0x7fbce813c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 --2- 172.21.15.180:0/2313310848 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbce80a5fa0 0x7fbce813c970 secure :-1 s=READY pgs=137 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).stop 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 -- 172.21.15.180:0/2313310848 shutdown_connections 2020-02-12T15:09:47.918 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 --2- 172.21.15.180:0/2313310848 >> v2:172.21.15.105:3300/0 conn(0x7fbce813cdd0 0x7fbce813f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:47.919 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 --2- 172.21.15.180:0/2313310848 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbce80a5fa0 0x7fbce813c970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.919 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 -- 172.21.15.180:0/2313310848 >> 172.21.15.180:0/2313310848 conn(0x7fbce805a530 msgr2=0x7fbce805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.919 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 -- 172.21.15.180:0/2313310848 shutdown_connections 2020-02-12T15:09:47.919 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.906+0000 7fbce7fff700 1 -- 172.21.15.180:0/2313310848 wait complete. 2020-02-12T15:09:47.919 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.907+0000 7fbce7fff700 1 Processor -- start 2020-02-12T15:09:47.919 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.907+0000 7fbce7fff700 1 -- start start 2020-02-12T15:09:47.919 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce7fff700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce80a5bc0 0x7fbce8066510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce7fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbce80a5fa0 0x7fbce8066970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce7fff700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80a8b70 con 0x7fbce813cdd0 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce7fff700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce80a8da0 con 0x7fbce80a5fa0 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce7fff700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80a9040 con 0x7fbce80a5bc0 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbce80a5fa0 0x7fbce8066970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce6ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce80a5bc0 0x7fbce8066510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbce80a5fa0 0x7fbce8066970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.180:38286/0 (socket says 172.21.15.180:38286) 2020-02-12T15:09:47.920 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce6ffd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce80a5bc0 0x7fbce8066510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.180:51232/0 (socket says 172.21.15.180:51232) 2020-02-12T15:09:47.921 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 -- 172.21.15.180:0/753913401 learned_addr learned my addr 172.21.15.180:0/753913401 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:47.921 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 -- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce80a5bc0 msgr2=0x7fbce8066510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.921 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce80a5bc0 0x7fbce8066510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.921 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 -- 172.21.15.180:0/753913401 >> v1:172.21.15.105:6789/0 conn(0x7fbce813cdd0 legacy=0x7fbce8132e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.921 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1012108708 0 0) 0x7fbce80a8b70 con 0x7fbce813cdd0 2020-02-12T15:09:47.921 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 -- 172.21.15.180:0/753913401 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8099df0 con 0x7fbce80a5fa0 2020-02-12T15:09:47.921 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce6ffd700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbce80a5bc0 0x7fbce8066510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:47.922 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> v2:172.21.15.105:3300/0 conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.922 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> v2:172.21.15.105:3300/0 conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.922 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.922 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.908+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.922 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd800f700 con 0x7fbce80a5fa0 2020-02-12T15:09:47.922 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.922 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.923 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd800f860 con 0x7fbce80a5fa0 2020-02-12T15:09:47.923 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce813cab0 con 0x7fbce80a5fa0 2020-02-12T15:09:47.923 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcd8007340 con 0x7fbce80a5fa0 2020-02-12T15:09:47.923 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce80a9820 con 0x7fbce80a5fa0 2020-02-12T15:09:47.923 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.923 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbce80a9a20 con 0x7fbce80a5fa0 2020-02-12T15:09:47.923 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbcd80056c0 con 0x7fbce80a5fa0 2020-02-12T15:09:47.924 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.909+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.924 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbce67fc700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=THROTTLE_DONE pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:47.924 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbcdffff700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbcc4039b50 0x7fbcc403c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.924 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbcd804a090 con 0x7fbce80a5fa0 2020-02-12T15:09:47.924 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbcdffff700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6810/22575,v1:172.21.15.105:6811/22575] conn(0x7fbcc40407a0 0x7fbcc4042bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:47.924 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 --> [v2:172.21.15.105:6810/22575,v1:172.21.15.105:6811/22575] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbcc4043180 con 0x7fbcc40407a0 2020-02-12T15:09:47.924 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbcd804b4f0 con 0x7fbce80a5fa0 2020-02-12T15:09:47.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbce6ffd700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbcc4039b50 0x7fbcc403c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbce77fe700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6810/22575,v1:172.21.15.105:6811/22575] conn(0x7fbcc40407a0 0x7fbcc4042bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:47.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbce6ffd700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbcc4039b50 0x7fbcc403c010 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.910+0000 7fbce77fe700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6810/22575,v1:172.21.15.105:6811/22575] conn(0x7fbcc40407a0 0x7fbcc4042bc0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:47.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.911+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== osd.6 v2:172.21.15.105:6810/22575 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7fbcc4043180 con 0x7fbcc40407a0 2020-02-12T15:09:47.930 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.928+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 --> [v2:172.21.15.105:6810/22575,v1:172.21.15.105:6811/22575] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbce80a5070 con 0x7fbcc40407a0 2020-02-12T15:09:47.931 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.928+0000 7fbcdffff700 1 -- 172.21.15.180:0/753913401 <== osd.6 v2:172.21.15.105:6810/22575 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbce80a5070 con 0x7fbcc40407a0 2020-02-12T15:09:47.932 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6810/22575,v1:172.21.15.105:6811/22575] conn(0x7fbcc40407a0 msgr2=0x7fbcc4042bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.932 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6810/22575,v1:172.21.15.105:6811/22575] conn(0x7fbcc40407a0 0x7fbcc4042bc0 crc :-1 s=READY pgs=7 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.932 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbcc4039b50 msgr2=0x7fbcc403c010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.932 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbcc4039b50 0x7fbcc403c010 crc :-1 s=READY pgs=66 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.932 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 msgr2=0x7fbce8066970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:47.932 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 secure :-1 s=READY pgs=68 cs=0 l=1 rx=0x7fbcd8002f30 tx=0x7fbcd8007a40).stop 2020-02-12T15:09:47.933 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce77fe700 1 -- 172.21.15.180:0/753913401 reap_dead start 2020-02-12T15:09:47.933 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 shutdown_connections 2020-02-12T15:09:47.933 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 --2- 172.21.15.180:0/753913401 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbce80a5fa0 0x7fbce8066970 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:47.933 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 >> 172.21.15.180:0/753913401 conn(0x7fbce805a530 msgr2=0x7fbce809fb50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:47.933 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 shutdown_connections 2020-02-12T15:09:47.933 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:47.929+0000 7fbce7fff700 1 -- 172.21.15.180:0/753913401 wait complete. 2020-02-12T15:09:47.941 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:47.941 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early tell osd.7 flush_pg_stats 2020-02-12T15:09:48.048 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.045+0000 7f016b77c700 1 Processor -- start 2020-02-12T15:09:48.048 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.045+0000 7f016b77c700 1 -- start start 2020-02-12T15:09:48.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f016b77c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01640a3990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:48.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f016b77c700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01640a6520 0x7f016412ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:48.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f016b77c700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01640a3f10 con 0x7f016412ee90 2020-02-12T15:09:48.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f016b77c700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01640a41b0 con 0x7f01640aac00 2020-02-12T15:09:48.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f016b77c700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01640a4450 con 0x7f01640a6520 2020-02-12T15:09:48.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169518700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01640a3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169d19700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f016412ee90 0x7f0164134c80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42614/0 (socket says 172.21.15.180:42614) 2020-02-12T15:09:48.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169d19700 1 -- 172.21.15.180:0/856090050 learned_addr learned my addr 172.21.15.180:0/856090050 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:48.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0168d17700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01640a6520 0x7f016412ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169518700 1 -- 172.21.15.180:0/856090050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01640a6520 msgr2=0x7f016412ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:48.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169518700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01640a6520 0x7f016412ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:48.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169518700 1 -- 172.21.15.180:0/856090050 >> v1:172.21.15.180:6789/0 conn(0x7f016412ee90 legacy=0x7f0164134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0157fff700 1 -- 172.21.15.180:0/856090050 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 461504758 0 0) 0x7f01640a3f10 con 0x7f016412ee90 2020-02-12T15:09:48.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169518700 1 -- 172.21.15.180:0/856090050 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f016412f320 con 0x7f01640aac00 2020-02-12T15:09:48.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0168d17700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01640a6520 0x7f016412ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:48.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.046+0000 7f0169518700 1 --2- 172.21.15.180:0/856090050 >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01640a3990 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0160002f30 tx=0x7f01600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0169518700 1 --2- 172.21.15.180:0/856090050 >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01640a3990 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0160002f30 tx=0x7f01600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0169518700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01640a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f0160002f30 tx=0x7f01600088e0).ready entity=mon.1 client_cookie=3e5be9220edecebd server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:48.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0169518700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01640a3990 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f0160002f30 tx=0x7f01600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0157fff700 1 -- 172.21.15.180:0/856090050 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0160008e40 con 0x7f01640aac00 2020-02-12T15:09:48.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0169518700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01640a3990 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f0160002f30 tx=0x7f01600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0169518700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01640a3990 secure :-1 s=THROTTLE_DONE pgs=139 cs=0 l=1 rx=0x7f0160002f30 tx=0x7f01600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0157fff700 1 -- 172.21.15.180:0/856090050 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01600116a0 con 0x7f01640aac00 2020-02-12T15:09:48.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f0157fff700 1 -- 172.21.15.180:0/856090050 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0160011a00 con 0x7f01640aac00 2020-02-12T15:09:48.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 -- 172.21.15.180:0/856090050 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 msgr2=0x7f01640a3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01640a3990 secure :-1 s=READY pgs=139 cs=0 l=1 rx=0x7f0160002f30 tx=0x7f01600088e0).stop 2020-02-12T15:09:48.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 -- 172.21.15.180:0/856090050 shutdown_connections 2020-02-12T15:09:48.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01640a3990 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 --2- 172.21.15.180:0/856090050 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f01640a6520 0x7f016412ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:48.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 -- 172.21.15.180:0/856090050 >> 172.21.15.180:0/856090050 conn(0x7f016409d450 msgr2=0x7f016409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:48.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 -- 172.21.15.180:0/856090050 shutdown_connections 2020-02-12T15:09:48.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.047+0000 7f016b77c700 1 -- 172.21.15.180:0/856090050 wait complete. 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.048+0000 7f016b77c700 1 Processor -- start 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.048+0000 7f016b77c700 1 -- start start 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f016b77c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01641351f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f016b77c700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016412c490 con 0x7f01640a6520 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f016b77c700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016412d160 con 0x7f016412ee90 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f016b77c700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f016412d400 con 0x7f01640aac00 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01641351f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0169d19700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f016412ee90 0x7f016414d650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42620/0 (socket says 172.21.15.180:42620) 2020-02-12T15:09:48.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0169d19700 1 -- 172.21.15.180:0/2797326779 learned_addr learned my addr 172.21.15.180:0/2797326779 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:48.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 -- 172.21.15.180:0/2797326779 >> v1:172.21.15.180:6789/0 conn(0x7f016412ee90 legacy=0x7f016414d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 -- 172.21.15.180:0/2797326779 >> v1:172.21.15.105:6789/0 conn(0x7f01640a6520 legacy=0x7f0164131aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2530756316 0 0) 0x7f016412d160 con 0x7f016412ee90 2020-02-12T15:09:48.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 -- 172.21.15.180:0/2797326779 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640a11e0 con 0x7f01640aac00 2020-02-12T15:09:48.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.061 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> v2:172.21.15.180:3300/0 conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.061 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:48.061 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.061 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f01580091a0 con 0x7f01640aac00 2020-02-12T15:09:48.061 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.061 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.061 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0158009300 con 0x7f01640aac00 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0158009660 con 0x7f01640aac00 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.049+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0164146310 con 0x7f01640aac00 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01641321b0 con 0x7f01640aac00 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f01580098d0 con 0x7f01640aac00 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f01641356a0 con 0x7f01640aac00 2020-02-12T15:09:48.062 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f01567fc700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0144039b00 0x7f014403bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:48.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f01580495d0 con 0x7f01640aac00 2020-02-12T15:09:48.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f0168d17700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=THROTTLE_DONE pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f01567fc700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6826/22605,v1:172.21.15.105:6827/22605] conn(0x7f0144040750 0x7f0144042b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:48.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 --> [v2:172.21.15.105:6826/22605,v1:172.21.15.105:6827/22605] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0144043130 con 0x7f0144040750 2020-02-12T15:09:48.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.050+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) v2 ==== 24+0+0 (secure 0 0 0) 0x7f015802eb10 con 0x7f01640aac00 2020-02-12T15:09:48.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.051+0000 7f0169518700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0144039b00 0x7f014403bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.063 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.051+0000 7f0169d19700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6826/22605,v1:172.21.15.105:6827/22605] conn(0x7f0144040750 0x7f0144042b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.051+0000 7f0169518700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0144039b00 0x7f014403bfc0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:48.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.051+0000 7f0169d19700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6826/22605,v1:172.21.15.105:6827/22605] conn(0x7f0144040750 0x7f0144042b70 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:48.064 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.052+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== osd.7 v2:172.21.15.105:6826/22605 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23288 (crc 0 0 0) 0x7f0144043130 con 0x7f0144040750 2020-02-12T15:09:48.071 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.069+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 --> [v2:172.21.15.105:6826/22605,v1:172.21.15.105:6827/22605] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f01640565b0 con 0x7f0144040750 2020-02-12T15:09:48.072 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.070+0000 7f01567fc700 1 -- 172.21.15.180:0/2797326779 <== osd.7 v2:172.21.15.105:6826/22605 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f01640565b0 con 0x7f0144040750 2020-02-12T15:09:48.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6826/22605,v1:172.21.15.105:6827/22605] conn(0x7f0144040750 msgr2=0x7f0144042b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6826/22605,v1:172.21.15.105:6827/22605] conn(0x7f0144040750 0x7f0144042b70 crc :-1 s=READY pgs=6 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0144039b00 msgr2=0x7f014403bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0144039b00 0x7f014403bfc0 crc :-1 s=READY pgs=67 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.074 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 msgr2=0x7f01641351f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 secure :-1 s=READY pgs=141 cs=0 l=1 rx=0x7f0164127ec0 tx=0x7f0158010af0).stop 2020-02-12T15:09:48.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f0169d19700 1 -- 172.21.15.180:0/2797326779 reap_dead start 2020-02-12T15:09:48.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 shutdown_connections 2020-02-12T15:09:48.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 --2- 172.21.15.180:0/2797326779 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f01640aac00 0x7f01641351f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 >> 172.21.15.180:0/2797326779 conn(0x7f016409d450 msgr2=0x7f01640698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:48.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 shutdown_connections 2020-02-12T15:09:48.075 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.071+0000 7f016b77c700 1 -- 172.21.15.180:0/2797326779 wait complete. 2020-02-12T15:09:48.083 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:48.083 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-02-12T15:09:48.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.186+0000 7f6e77c15700 1 Processor -- start 2020-02-12T15:09:48.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.186+0000 7f6e77c15700 1 -- start start 2020-02-12T15:09:48.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.187+0000 7f6e77c15700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6e70134cc0 0x7f6e70135170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:48.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.187+0000 7f6e77c15700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e700a7300 con 0x7f6e700a1c60 2020-02-12T15:09:48.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.187+0000 7f6e77c15700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e70137c10 con 0x7f6e700a6db0 2020-02-12T15:09:48.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.187+0000 7f6e77c15700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e70137eb0 con 0x7f6e70134cc0 2020-02-12T15:09:48.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.187+0000 7f6e751b0700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f6e700a6db0 0x7f6e701345b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42628/0 (socket says 172.21.15.180:42628) 2020-02-12T15:09:48.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.187+0000 7f6e751b0700 1 -- 172.21.15.180:0/886638912 learned_addr learned my addr 172.21.15.180:0/886638912 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:48.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e761b2700 1 --2- 172.21.15.180:0/886638912 >> v2:172.21.15.105:3300/0 conn(0x7f6e70134cc0 0x7f6e70135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3861467268 0 0) 0x7f6e70137c10 con 0x7f6e700a6db0 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6e58003230 con 0x7f6e700a6db0 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 4111360836 0 0) 0x7f6e58003230 con 0x7f6e700a6db0 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 >> v2:172.21.15.105:3300/0 conn(0x7f6e70134cc0 msgr2=0x7f6e70135170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 --2- 172.21.15.180:0/886638912 >> v2:172.21.15.105:3300/0 conn(0x7f6e70134cc0 0x7f6e70135170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 >> v1:172.21.15.105:6789/0 conn(0x7f6e700a1c60 legacy=0x7f6e70138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e700a7910 con 0x7f6e700a6db0 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f6e6c0016d0 con 0x7f6e700a6db0 2020-02-12T15:09:48.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 >> v1:172.21.15.180:6789/0 conn(0x7f6e700a6db0 legacy=0x7f6e701345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e58003720 0x7f6e58003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:48.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:48.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e58004db0 0x7f6e5800b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:48.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e70137eb0 con 0x7f6e58003720 2020-02-12T15:09:48.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e580041c0 con 0x7f6e580044d0 2020-02-12T15:09:48.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5800bb80 con 0x7f6e58004db0 2020-02-12T15:09:48.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e759b1700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e58003720 0x7f6e58003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e761b2700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e58004db0 0x7f6e5800b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 -- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e58004db0 msgr2=0x7f6e5800b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f6e58004db0 0x7f6e5800b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 -- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e58003720 msgr2=0x7f6e58003b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e58003720 0x7f6e58003b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e761b2700 1 -- 172.21.15.180:0/886638912 reap_dead start 2020-02-12T15:09:48.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 -- 172.21.15.180:0/886638912 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e58003230 con 0x7f6e580044d0 2020-02-12T15:09:48.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e759b1700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f6e58003720 0x7f6e58003b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:48.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6e580054a0 tx=0x7f6e700a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6e580054a0 tx=0x7f6e700a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f6e580054a0 tx=0x7f6e700a7aa0).ready entity=mon.1 client_cookie=27b6b27e7827001a server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:48.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6e580054a0 tx=0x7f6e700a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e6c00ce70 con 0x7f6e580044d0 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6e580054a0 tx=0x7f6e700a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e6c00e350 con 0x7f6e580044d0 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e751b0700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 secure :-1 s=THROTTLE_DONE pgs=143 cs=0 l=1 rx=0x7f6e580054a0 tx=0x7f6e700a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e77c15700 1 -- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 msgr2=0x7f6e58004950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e749af700 1 -- 172.21.15.180:0/886638912 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e6c0100b0 con 0x7f6e580044d0 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.188+0000 7f6e77c15700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 secure :-1 s=READY pgs=143 cs=0 l=1 rx=0x7f6e580054a0 tx=0x7f6e700a7aa0).stop 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.189+0000 7f6e77c15700 1 -- 172.21.15.180:0/886638912 shutdown_connections 2020-02-12T15:09:48.203 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.189+0000 7f6e77c15700 1 --2- 172.21.15.180:0/886638912 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e58004950 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.204 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.189+0000 7f6e77c15700 1 -- 172.21.15.180:0/886638912 >> 172.21.15.180:0/886638912 conn(0x7f6e7009d450 msgr2=0x7f6e7009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:48.204 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.189+0000 7f6e77c15700 1 -- 172.21.15.180:0/886638912 shutdown_connections 2020-02-12T15:09:48.204 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.189+0000 7f6e77c15700 1 -- 172.21.15.180:0/886638912 wait complete. 2020-02-12T15:09:48.204 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e77c15700 1 Processor -- start 2020-02-12T15:09:48.204 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e77c15700 1 -- start start 2020-02-12T15:09:48.204 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e77c15700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f6e580044d0 0x7f6e7012a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:48.204 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e77c15700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f6e70136ee0 0x7f6e7012a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:48.205 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e77c15700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e7012bd00 con 0x7f6e700a9c70 2020-02-12T15:09:48.205 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e77c15700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e701367c0 con 0x7f6e70136ee0 2020-02-12T15:09:48.205 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e77c15700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e700a4930 con 0x7f6e580044d0 2020-02-12T15:09:48.205 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e759b1700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f6e580044d0 0x7f6e7012a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.205 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e759b1700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f6e580044d0 0x7f6e7012a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51126/0 (socket says 172.21.15.180:51126) 2020-02-12T15:09:48.205 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.190+0000 7f6e759b1700 1 -- 172.21.15.180:0/1085762900 learned_addr learned my addr 172.21.15.180:0/1085762900 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:48.205 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e751b0700 1 --2- 172.21.15.180:0/1085762900 >> v2:172.21.15.105:3300/0 conn(0x7f6e70136ee0 0x7f6e7012a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 -- 172.21.15.180:0/1085762900 >> v2:172.21.15.105:3300/0 conn(0x7f6e70136ee0 msgr2=0x7f6e7012a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> v2:172.21.15.105:3300/0 conn(0x7f6e70136ee0 0x7f6e7012a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 -- 172.21.15.180:0/1085762900 >> v1:172.21.15.105:6789/0 conn(0x7f6e700a9c70 legacy=0x7f6e70142520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 -- 172.21.15.180:0/1085762900 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e700a74f0 con 0x7f6e580044d0 2020-02-12T15:09:48.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> v2:172.21.15.180:3300/0 conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> v2:172.21.15.180:3300/0 conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e5effd700 1 -- 172.21.15.180:0/1085762900 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e600124c0 con 0x7f6e580044d0 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e5effd700 1 -- 172.21.15.180:0/1085762900 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e60012620 con 0x7f6e580044d0 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e70135c70 con 0x7f6e580044d0 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e5effd700 1 -- 172.21.15.180:0/1085762900 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6e600129c0 con 0x7f6e580044d0 2020-02-12T15:09:48.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.191+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e7012ae50 con 0x7f6e580044d0 2020-02-12T15:09:48.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.192+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.192+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.192+0000 7f6e5effd700 1 -- 172.21.15.180:0/1085762900 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f6e60012c30 con 0x7f6e580044d0 2020-02-12T15:09:48.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.192+0000 7f6e5effd700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6e50039c20 0x7f6e5003c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:48.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.192+0000 7f6e5effd700 1 -- 172.21.15.180:0/1085762900 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f6e60049460 con 0x7f6e580044d0 2020-02-12T15:09:48.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.192+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e700565b0 con 0x7f6e580044d0 2020-02-12T15:09:48.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.192+0000 7f6e751b0700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6e50039c20 0x7f6e5003c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:48.209 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.193+0000 7f6e751b0700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6e50039c20 0x7f6e5003c0e0 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:48.209 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.196+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.209 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.196+0000 7f6e5effd700 1 -- 172.21.15.180:0/1085762900 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f6e6002ea90 con 0x7f6e580044d0 2020-02-12T15:09:48.334 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.331+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6e700ab110 con 0x7f6e580044d0 2020-02-12T15:09:48.334 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.332+0000 7f6e759b1700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=THROTTLE_DONE pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:48.335 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.332+0000 7f6e5effd700 1 -- 172.21.15.180:0/1085762900 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e60031560 con 0x7f6e580044d0 2020-02-12T15:09:48.335 INFO:teuthology.orchestra.run.smithi180.stdout:55834574851 2020-02-12T15:09:48.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6e50039c20 msgr2=0x7f6e5003c0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.336 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6e50039c20 0x7f6e5003c0e0 crc :-1 s=READY pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 msgr2=0x7f6e7012a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:48.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 secure :-1 s=READY pgs=144 cs=0 l=1 rx=0x7f6e7009e020 tx=0x7f6e60001e40).stop 2020-02-12T15:09:48.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 shutdown_connections 2020-02-12T15:09:48.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6e50039c20 0x7f6e5003c0e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 --2- 172.21.15.180:0/1085762900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f6e580044d0 0x7f6e7012a590 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.338 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 --2- 172.21.15.180:0/1085762900 >> v2:172.21.15.105:3300/0 conn(0x7f6e70136ee0 0x7f6e7012a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:48.339 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 >> 172.21.15.180:0/1085762900 conn(0x7f6e7009d450 msgr2=0x7f6e700698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:48.339 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 shutdown_connections 2020-02-12T15:09:48.339 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:48.333+0000 7f6e77c15700 1 -- 172.21.15.180:0/1085762900 wait complete. 2020-02-12T15:09:48.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574851 for osd.0 2020-02-12T15:09:49.347 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.0 2020-02-12T15:09:49.465 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.463+0000 7fa50a9df700 1 Processor -- start 2020-02-12T15:09:49.466 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.463+0000 7fa50a9df700 1 -- start start 2020-02-12T15:09:49.473 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa50a9df700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa50412ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:49.473 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa50a9df700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fa50412ee90 0x7fa504134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:49.473 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa50a9df700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5040a3f10 con 0x7fa5040aac00 2020-02-12T15:09:49.473 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa50a9df700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040a41b0 con 0x7fa50412ee90 2020-02-12T15:09:49.473 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa50a9df700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5040a4450 con 0x7fa5040a3990 2020-02-12T15:09:49.473 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fa50412ee90 0x7fa504134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.474 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fa50412ee90 0x7fa504134c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51132/0 (socket says 172.21.15.180:51132) 2020-02-12T15:09:49.474 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 -- 172.21.15.180:0/3251089909 learned_addr learned my addr 172.21.15.180:0/3251089909 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:49.474 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa5037fe700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa50412ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.474 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 -- 172.21.15.180:0/3251089909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 msgr2=0x7fa50412ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:49.474 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa50412ea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:49.474 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 -- 172.21.15.180:0/3251089909 >> v1:172.21.15.105:6789/0 conn(0x7fa5040aac00 legacy=0x7fa5040a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:49.475 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 -- 172.21.15.180:0/3251089909 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50412f320 con 0x7fa50412ee90 2020-02-12T15:09:49.475 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- 172.21.15.180:0/3251089909 >> v2:172.21.15.180:3300/0 conn(0x7fa50412ee90 0x7fa504134c80 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fa504067480 tx=0x7fa4fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.475 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- 172.21.15.180:0/3251089909 >> v2:172.21.15.180:3300/0 conn(0x7fa50412ee90 0x7fa504134c80 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fa504067480 tx=0x7fa4fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.475 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fa50412ee90 0x7fa504134c80 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fa504067480 tx=0x7fa4fc008c60).ready entity=mon.1 client_cookie=d7c369e65db0fdf0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:49.475 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fa50412ee90 0x7fa504134c80 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa504067480 tx=0x7fa4fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.475 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa502ffd700 1 -- 172.21.15.180:0/3251089909 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc00a160 con 0x7fa50412ee90 2020-02-12T15:09:49.475 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fa50412ee90 0x7fa504134c80 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa504067480 tx=0x7fa4fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.476 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa508f7c700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fa50412ee90 0x7fa504134c80 secure :-1 s=THROTTLE_DONE pgs=145 cs=0 l=1 rx=0x7fa504067480 tx=0x7fa4fc008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.476 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa502ffd700 1 -- 172.21.15.180:0/3251089909 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00a2c0 con 0x7fa50412ee90 2020-02-12T15:09:49.476 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa502ffd700 1 -- 172.21.15.180:0/3251089909 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc00a660 con 0x7fa50412ee90 2020-02-12T15:09:49.476 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa50a9df700 1 -- 172.21.15.180:0/3251089909 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fa50412ee90 msgr2=0x7fa504134c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.476 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.464+0000 7fa50a9df700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fa50412ee90 0x7fa504134c80 secure :-1 s=READY pgs=145 cs=0 l=1 rx=0x7fa504067480 tx=0x7fa4fc008c60).stop 2020-02-12T15:09:49.476 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.465+0000 7fa50a9df700 1 -- 172.21.15.180:0/3251089909 shutdown_connections 2020-02-12T15:09:49.476 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.465+0000 7fa50a9df700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fa50412ee90 0x7fa504134c80 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.477 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.465+0000 7fa50a9df700 1 --2- 172.21.15.180:0/3251089909 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa50412ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:49.477 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.465+0000 7fa50a9df700 1 -- 172.21.15.180:0/3251089909 >> 172.21.15.180:0/3251089909 conn(0x7fa50409d450 msgr2=0x7fa50409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:49.477 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.465+0000 7fa50a9df700 1 -- 172.21.15.180:0/3251089909 shutdown_connections 2020-02-12T15:09:49.477 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.465+0000 7fa50a9df700 1 -- 172.21.15.180:0/3251089909 wait complete. 2020-02-12T15:09:49.477 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.466+0000 7fa50a9df700 1 Processor -- start 2020-02-12T15:09:49.477 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.466+0000 7fa50a9df700 1 -- start start 2020-02-12T15:09:49.477 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa50a9df700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:49.478 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa50a9df700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fa5040aac00 0x7fa50409e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:49.478 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa50a9df700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5040a0d30 con 0x7fa50412ee90 2020-02-12T15:09:49.478 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa50a9df700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5040a80a0 con 0x7fa5040aac00 2020-02-12T15:09:49.478 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa50a9df700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa50409fbd0 con 0x7fa5040a3990 2020-02-12T15:09:49.478 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa508f7c700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fa50412ee90 0x7fa504126550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42654/0 (socket says 172.21.15.180:42654) 2020-02-12T15:09:49.479 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa508f7c700 1 -- 172.21.15.180:0/869735314 learned_addr learned my addr 172.21.15.180:0/869735314 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:49.479 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.480 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa5037fe700 1 --2- 172.21.15.180:0/869735314 >> v2:172.21.15.105:3300/0 conn(0x7fa5040aac00 0x7fa50409e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.480 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1601584778 0 0) 0x7fa50412f320 con 0x7fa50412ee90 2020-02-12T15:09:49.480 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa4e4002fe0 con 0x7fa50412ee90 2020-02-12T15:09:49.480 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2117232248 0 0) 0x7fa4e4002fe0 con 0x7fa50412ee90 2020-02-12T15:09:49.480 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 -- 172.21.15.180:0/869735314 >> v2:172.21.15.105:3300/0 conn(0x7fa5040aac00 msgr2=0x7fa50409e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.480 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> v2:172.21.15.105:3300/0 conn(0x7fa5040aac00 0x7fa50409e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.481 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 -- 172.21.15.180:0/869735314 >> v1:172.21.15.180:6789/0 conn(0x7fa50412ee90 legacy=0x7fa504126550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.481 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 -- 172.21.15.180:0/869735314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504132b10 con 0x7fa5040a3990 2020-02-12T15:09:49.481 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa5037fe700 1 --2- 172.21.15.180:0/869735314 >> v2:172.21.15.105:3300/0 conn(0x7fa5040aac00 0x7fa50409e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:49.481 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.481 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.481 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:49.482 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.482 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4fc011da0 con 0x7fa5040a3990 2020-02-12T15:09:49.482 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.467+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.482 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f40069d0 con 0x7fa5040a3990 2020-02-12T15:09:49.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50412d950 con 0x7fa5040a3990 2020-02-12T15:09:49.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa4f4006d70 con 0x7fa5040a3990 2020-02-12T15:09:49.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa504126c60 con 0x7fa5040a3990 2020-02-12T15:09:49.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.483 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fa4f400a310 con 0x7fa5040a3990 2020-02-12T15:09:49.484 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.484 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5040565b0 con 0x7fa5040a3990 2020-02-12T15:09:49.484 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.468+0000 7fa5017fa700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fa4e4039e60 0x7fa4e403c320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:49.484 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.469+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fa4f4049710 con 0x7fa5040a3990 2020-02-12T15:09:49.484 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.469+0000 7fa5037fe700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fa4e4039e60 0x7fa4e403c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.484 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.469+0000 7fa5037fe700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fa4e4039e60 0x7fa4e403c320 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:49.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.472+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.472+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fa4f402ecc0 con 0x7fa5040a3990 2020-02-12T15:09:49.614 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.608+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fa50412db50 con 0x7fa5040a3990 2020-02-12T15:09:49.614 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.608+0000 7fa503fff700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=THROTTLE_DONE pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.614 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.609+0000 7fa5017fa700 1 -- 172.21.15.180:0/869735314 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa4f40317d0 con 0x7fa5040a3990 2020-02-12T15:09:49.614 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fa4e4039e60 msgr2=0x7fa4e403c320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.615 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fa4e4039e60 0x7fa4e403c320 crc :-1 s=READY pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.615 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 msgr2=0x7fa5040a08d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.615 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 secure :-1 s=READY pgs=37 cs=0 l=1 rx=0x7fa4fc011f00 tx=0x7fa4f4010880).stop 2020-02-12T15:09:49.615 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 shutdown_connections 2020-02-12T15:09:49.615 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fa4e4039e60 0x7fa4e403c320 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.615 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 --2- 172.21.15.180:0/869735314 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fa5040a3990 0x7fa5040a08d0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.615 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 --2- 172.21.15.180:0/869735314 >> v2:172.21.15.105:3300/0 conn(0x7fa5040aac00 0x7fa50409e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.616 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 >> 172.21.15.180:0/869735314 conn(0x7fa50409d450 msgr2=0x7fa5041292f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:49.616 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 shutdown_connections 2020-02-12T15:09:49.616 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.610+0000 7fa50a9df700 1 -- 172.21.15.180:0/869735314 wait complete. 2020-02-12T15:09:49.616 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:49.623 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2020-02-12T15:09:49.623 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.1 2020-02-12T15:09:49.729 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.727+0000 7f8331143700 1 Processor -- start 2020-02-12T15:09:49.730 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.727+0000 7f8331143700 1 -- start start 2020-02-12T15:09:49.732 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f8331143700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c135170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:49.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f8331143700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0a7300 con 0x7f832c0a1c60 2020-02-12T15:09:49.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f8331143700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c137c10 con 0x7f832c0a6db0 2020-02-12T15:09:49.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f8331143700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c137eb0 con 0x7f832c134cc0 2020-02-12T15:09:49.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832a59c700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f832c0a6db0 0x7f832c1345b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42658/0 (socket says 172.21.15.180:42658) 2020-02-12T15:09:49.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832a59c700 1 -- 172.21.15.180:0/1301953240 learned_addr learned my addr 172.21.15.180:0/1301953240 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:49.733 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 -- 172.21.15.180:0/1301953240 >> v1:172.21.15.180:6789/0 conn(0x7f832c0a6db0 legacy=0x7f832c1345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 -- 172.21.15.180:0/1301953240 >> v1:172.21.15.105:6789/0 conn(0x7f832c0a1c60 legacy=0x7f832c138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:49.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f8329d9b700 1 -- 172.21.15.180:0/1301953240 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3424443964 0 0) 0x7f832c137c10 con 0x7f832c0a6db0 2020-02-12T15:09:49.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 -- 172.21.15.180:0/1301953240 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c0a7910 con 0x7f832c134cc0 2020-02-12T15:09:49.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 --2- 172.21.15.180:0/1301953240 >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c135170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f832c09e020 tx=0x7f8324008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 --2- 172.21.15.180:0/1301953240 >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c135170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f832c09e020 tx=0x7f8324008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.734 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 --2- 172.21.15.180:0/1301953240 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c135170 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f8324008c60).ready entity=mon.1 client_cookie=3349a92e04de2934 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:49.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.728+0000 7f832b59e700 1 --2- 172.21.15.180:0/1301953240 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c135170 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f8324008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8329d9b700 1 -- 172.21.15.180:0/1301953240 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f832400a160 con 0x7f832c134cc0 2020-02-12T15:09:49.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f832b59e700 1 --2- 172.21.15.180:0/1301953240 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c135170 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f8324008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.735 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8329d9b700 1 -- 172.21.15.180:0/1301953240 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400a2c0 con 0x7f832c134cc0 2020-02-12T15:09:49.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f832b59e700 1 --2- 172.21.15.180:0/1301953240 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c135170 secure :-1 s=THROTTLE_DONE pgs=148 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f8324008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8329d9b700 1 -- 172.21.15.180:0/1301953240 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f832400a660 con 0x7f832c134cc0 2020-02-12T15:09:49.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8331143700 1 -- 172.21.15.180:0/1301953240 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 msgr2=0x7f832c135170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.736 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8331143700 1 --2- 172.21.15.180:0/1301953240 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c135170 secure :-1 s=READY pgs=148 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f8324008c60).stop 2020-02-12T15:09:49.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8331143700 1 -- 172.21.15.180:0/1301953240 shutdown_connections 2020-02-12T15:09:49.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8331143700 1 --2- 172.21.15.180:0/1301953240 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c135170 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8331143700 1 -- 172.21.15.180:0/1301953240 >> 172.21.15.180:0/1301953240 conn(0x7f832c09d450 msgr2=0x7f832c09d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:49.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8331143700 1 -- 172.21.15.180:0/1301953240 shutdown_connections 2020-02-12T15:09:49.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.729+0000 7f8331143700 1 -- 172.21.15.180:0/1301953240 wait complete. 2020-02-12T15:09:49.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.730+0000 7f8331143700 1 Processor -- start 2020-02-12T15:09:49.737 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.730+0000 7f8331143700 1 -- start start 2020-02-12T15:09:49.740 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8331143700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c09e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:49.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8331143700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c0a02e0 con 0x7f832c0a1c60 2020-02-12T15:09:49.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8331143700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c09fe70 con 0x7f832c0a6db0 2020-02-12T15:09:49.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8331143700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c135720 con 0x7f832c134cc0 2020-02-12T15:09:49.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832a59c700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f832c0a6db0 0x7f832c148f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42664/0 (socket says 172.21.15.180:42664) 2020-02-12T15:09:49.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832a59c700 1 -- 172.21.15.180:0/2370457235 learned_addr learned my addr 172.21.15.180:0/2370457235 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:49.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c09e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.741 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81512343 0 0) 0x7f832c09fe70 con 0x7f832c0a6db0 2020-02-12T15:09:49.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8310002fe0 con 0x7f832c0a6db0 2020-02-12T15:09:49.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 -- 172.21.15.180:0/2370457235 >> v1:172.21.15.180:6789/0 conn(0x7f832c0a6db0 legacy=0x7f832c148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.742 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 -- 172.21.15.180:0/2370457235 >> v1:172.21.15.105:6789/0 conn(0x7f832c0a1c60 legacy=0x7f832c065ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 -- 172.21.15.180:0/2370457235 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c09eed0 con 0x7f832c134cc0 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> v2:172.21.15.180:3300/0 conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f832400ae80 con 0x7f832c134cc0 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.743 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.744 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8324005c30 con 0x7f832c134cc0 2020-02-12T15:09:49.744 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c09f170 con 0x7f832c134cc0 2020-02-12T15:09:49.744 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f832400f570 con 0x7f832c134cc0 2020-02-12T15:09:49.744 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.731+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c09f990 con 0x7f832c134cc0 2020-02-12T15:09:49.744 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.732+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.744 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.732+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f832400f7e0 con 0x7f832c134cc0 2020-02-12T15:09:49.744 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.732+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.732+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c0565b0 con 0x7f832c134cc0 2020-02-12T15:09:49.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.732+0000 7f8323fff700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8310039f10 0x7f831003c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:49.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.732+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f832404a8f0 con 0x7f832c134cc0 2020-02-12T15:09:49.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.732+0000 7f832ad9d700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8310039f10 0x7f831003c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.733+0000 7f832ad9d700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8310039f10 0x7f831003c3d0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:49.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.736+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.745 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.736+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f8324032f30 con 0x7f832c134cc0 2020-02-12T15:09:49.873 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.871+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f832c0ab110 con 0x7f832c134cc0 2020-02-12T15:09:49.874 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.871+0000 7f832b59e700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=THROTTLE_DONE pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:49.874 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.871+0000 7f8323fff700 1 -- 172.21.15.180:0/2370457235 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8324032af0 con 0x7f832c134cc0 2020-02-12T15:09:49.874 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:49.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8310039f10 msgr2=0x7f831003c3d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8310039f10 0x7f831003c3d0 crc :-1 s=READY pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 msgr2=0x7f832c09e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:49.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 secure :-1 s=READY pgs=150 cs=0 l=1 rx=0x7f832c09e020 tx=0x7f832c0a7aa0).stop 2020-02-12T15:09:49.875 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 shutdown_connections 2020-02-12T15:09:49.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f8310039f10 0x7f831003c3d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 --2- 172.21.15.180:0/2370457235 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f832c134cc0 0x7f832c09e870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:49.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 >> 172.21.15.180:0/2370457235 conn(0x7f832c09d450 msgr2=0x7f832c0698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:49.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 shutdown_connections 2020-02-12T15:09:49.876 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.872+0000 7f8331143700 1 -- 172.21.15.180:0/2370457235 wait complete. 2020-02-12T15:09:49.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.1 2020-02-12T15:09:49.885 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.2 2020-02-12T15:09:49.991 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.989+0000 7fae15691700 1 Processor -- start 2020-02-12T15:09:49.992 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.989+0000 7fae15691700 1 -- start start 2020-02-12T15:09:49.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae15691700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae100aac00 0x7fae100a70c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:49.998 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae15691700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fae10139e90 0x7fae1012f670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:49.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae15691700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae100a78f0 con 0x7fae1009e9b0 2020-02-12T15:09:49.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae15691700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae101392e0 con 0x7fae10139e90 2020-02-12T15:09:49.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae15691700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae100a7b90 con 0x7fae100aac00 2020-02-12T15:09:49.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae0effd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae100aac00 0x7fae100a70c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae0f7fe700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fae10139e90 0x7fae1012f670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:49.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae0effd700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae100aac00 0x7fae100a70c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.180:51302/0 (socket says 172.21.15.180:51302) 2020-02-12T15:09:49.999 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.990+0000 7fae0effd700 1 -- 172.21.15.180:0/306987979 learned_addr learned my addr 172.21.15.180:0/306987979 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:50.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 -- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae100aac00 msgr2=0x7fae100a70c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:50.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae100aac00 0x7fae100a70c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:50.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 -- 172.21.15.180:0/306987979 >> v1:172.21.15.105:6789/0 conn(0x7fae1009e9b0 legacy=0x7fae10139780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0dffb700 1 -- 172.21.15.180:0/306987979 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2312394897 0 0) 0x7fae100a78f0 con 0x7fae1009e9b0 2020-02-12T15:09:50.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 -- 172.21.15.180:0/306987979 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100a7520 con 0x7fae10139e90 2020-02-12T15:09:50.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/306987979 >> v2:172.21.15.105:3300/0 conn(0x7fae10139e90 0x7fae1012f670 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fae080032b0 tx=0x7fae08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.000 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/306987979 >> v2:172.21.15.105:3300/0 conn(0x7fae10139e90 0x7fae1012f670 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fae080032b0 tx=0x7fae08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae10139e90 0x7fae1012f670 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fae080032b0 tx=0x7fae08008c60).ready entity=mon.0 client_cookie=584df0dbe8c994c5 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae10139e90 0x7fae1012f670 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fae080032b0 tx=0x7fae08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0dffb700 1 -- 172.21.15.180:0/306987979 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae08011e60 con 0x7fae10139e90 2020-02-12T15:09:50.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae10139e90 0x7fae1012f670 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fae080032b0 tx=0x7fae08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae10139e90 0x7fae1012f670 secure :-1 s=THROTTLE_DONE pgs=76 cs=0 l=1 rx=0x7fae080032b0 tx=0x7fae08008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0dffb700 1 -- 172.21.15.180:0/306987979 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae0800a160 con 0x7fae10139e90 2020-02-12T15:09:50.001 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae0dffb700 1 -- 172.21.15.180:0/306987979 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae0800a4c0 con 0x7fae10139e90 2020-02-12T15:09:50.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 -- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae10139e90 msgr2=0x7fae1012f670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae10139e90 0x7fae1012f670 secure :-1 s=READY pgs=76 cs=0 l=1 rx=0x7fae080032b0 tx=0x7fae08008c60).stop 2020-02-12T15:09:50.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 -- 172.21.15.180:0/306987979 shutdown_connections 2020-02-12T15:09:50.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fae10139e90 0x7fae1012f670 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 --2- 172.21.15.180:0/306987979 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae100aac00 0x7fae100a70c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:50.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 -- 172.21.15.180:0/306987979 >> 172.21.15.180:0/306987979 conn(0x7fae1009d450 msgr2=0x7fae1009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.002 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 -- 172.21.15.180:0/306987979 shutdown_connections 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.991+0000 7fae15691700 1 -- 172.21.15.180:0/306987979 wait complete. 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae15691700 1 Processor -- start 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae15691700 1 -- start start 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae15691700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 0x7fae10138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae15691700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae10133650 con 0x7fae100aac00 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae15691700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae10137ff0 con 0x7fae10139e90 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae15691700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae1012d6d0 con 0x7fae1009e9b0 2020-02-12T15:09:50.003 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae0f7fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fae10139e90 0x7fae10137570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42680/0 (socket says 172.21.15.180:42680) 2020-02-12T15:09:50.004 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae0f7fe700 1 -- 172.21.15.180:0/1493939707 learned_addr learned my addr 172.21.15.180:0/1493939707 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:50.004 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae0effd700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 0x7fae10138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.004 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3623518127 0 0) 0x7fae10137ff0 con 0x7fae10139e90 2020-02-12T15:09:50.004 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.993+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fadf4002fe0 con 0x7fae10139e90 2020-02-12T15:09:50.005 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2995982436 0 0) 0x7fadf4002fe0 con 0x7fae10139e90 2020-02-12T15:09:50.005 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7fae10137ff0 con 0x7fae10139e90 2020-02-12T15:09:50.005 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7fae08008940 con 0x7fae10139e90 2020-02-12T15:09:50.005 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 msgr2=0x7fae10138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.005 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 0x7fae10138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.006 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 >> v1:172.21.15.180:6789/0 conn(0x7fae10139e90 legacy=0x7fae10137570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.006 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 >> v1:172.21.15.105:6789/0 conn(0x7fae100aac00 legacy=0x7fae10136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.006 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 0x7fadf40049b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.006 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf4004e10 0x7fadf4005230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.006 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.006 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf40043e0 con 0x7fadf4004e10 2020-02-12T15:09:50.006 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4004550 con 0x7fadf40039e0 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadf4004710 con 0x7fae1009e9b0 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0effd700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 0x7fadf40049b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0e7fc700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf4004e10 0x7fadf4005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 -- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 msgr2=0x7fadf40049b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fae1009e9b0 0x7fadf40049b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 -- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf4004e10 msgr2=0x7fadf4005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.007 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf4004e10 0x7fadf4005230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.008 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae100a8590 con 0x7fadf40039e0 2020-02-12T15:09:50.008 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0e7fc700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fadf4004e10 0x7fadf4005230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:50.008 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae100a88b0 con 0x7fadf40039e0 2020-02-12T15:09:50.008 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae10137c80 con 0x7fadf40039e0 2020-02-12T15:09:50.008 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.008 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.008 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae08007c60 con 0x7fadf40039e0 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae08005c30 con 0x7fadf40039e0 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.994+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fae08005da0 con 0x7fadf40039e0 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.995+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.009 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.995+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fae08007340 con 0x7fadf40039e0 2020-02-12T15:09:50.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.995+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.995+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fade8003340 con 0x7fadf40039e0 2020-02-12T15:09:50.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.995+0000 7fae07fff700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fadf4041fd0 0x7fadf4044490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.995+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fae0804ae30 con 0x7fadf40039e0 2020-02-12T15:09:50.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.996+0000 7fae0effd700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fadf4041fd0 0x7fadf4044490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.010 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.996+0000 7fae0effd700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fadf4041fd0 0x7fadf4044490 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.011 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.999+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.011 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:49.999+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fae08030520 con 0x7fadf40039e0 2020-02-12T15:09:50.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.133+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fade80021d0 con 0x7fadf40039e0 2020-02-12T15:09:50.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.133+0000 7fae0f7fe700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=THROTTLE_DONE pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.136 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.133+0000 7fae07fff700 1 -- 172.21.15.180:0/1493939707 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fae08033010 con 0x7fadf40039e0 2020-02-12T15:09:50.136 INFO:teuthology.orchestra.run.smithi180.stdout:55834574854 2020-02-12T15:09:50.137 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fadf4041fd0 msgr2=0x7fadf4044490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fadf4041fd0 0x7fadf4044490 crc :-1 s=READY pgs=71 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 msgr2=0x7fadf4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 --2- 172.21.15.180:0/1493939707 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fadf40039e0 0x7fadf4003e60 secure :-1 s=READY pgs=152 cs=0 l=1 rx=0x7fae08003270 tx=0x7fae100a7710).stop 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae0f7fe700 1 -- 172.21.15.180:0/1493939707 reap_dead start 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae0f7fe700 1 -- 172.21.15.180:0/1493939707 reap_dead start 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 shutdown_connections 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 >> 172.21.15.180:0/1493939707 conn(0x7fae1009d450 msgr2=0x7fae100a4b60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.138 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 shutdown_connections 2020-02-12T15:09:50.139 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.135+0000 7fae15691700 1 -- 172.21.15.180:0/1493939707 wait complete. 2020-02-12T15:09:50.147 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.2 2020-02-12T15:09:50.147 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.3 2020-02-12T15:09:50.253 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.250+0000 7f65c163d700 1 Processor -- start 2020-02-12T15:09:50.253 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.250+0000 7f65c163d700 1 -- start start 2020-02-12T15:09:50.255 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65c163d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:50.255 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65c163d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a7240 0x7f65bc0a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:50.255 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65c163d700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc0a39c0 con 0x7f65bc0a1b30 2020-02-12T15:09:50.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65c163d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0a3c60 con 0x7f65bc0a7240 2020-02-12T15:09:50.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65c163d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0a66f0 con 0x7f65bc0a5dd0 2020-02-12T15:09:50.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65baffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65ba7fc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f65bc0a1b30 0x7f65bc0a6b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42690/0 (socket says 172.21.15.180:42690) 2020-02-12T15:09:50.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.251+0000 7f65ba7fc700 1 -- 172.21.15.180:0/2682681827 learned_addr learned my addr 172.21.15.180:0/2682681827 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:50.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/2682681827 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a7240 0x7f65bc0a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.256 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 -- 172.21.15.180:0/2682681827 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a7240 msgr2=0x7f65bc0a76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:50.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 --2- 172.21.15.180:0/2682681827 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a7240 0x7f65bc0a76b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:50.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65b9ffb700 1 -- 172.21.15.180:0/2682681827 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 375394022 0 0) 0x7f65bc0a39c0 con 0x7f65bc0a1b30 2020-02-12T15:09:50.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 -- 172.21.15.180:0/2682681827 >> v1:172.21.15.180:6789/0 conn(0x7f65bc0a1b30 legacy=0x7f65bc0a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 -- 172.21.15.180:0/2682681827 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0601d0 con 0x7f65bc0a5dd0 2020-02-12T15:09:50.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/2682681827 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a7240 0x7f65bc0a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:50.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 --2- 172.21.15.180:0/2682681827 >> v2:172.21.15.180:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f65ac002f30 tx=0x7f65ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.257 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 --2- 172.21.15.180:0/2682681827 >> v2:172.21.15.180:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f65ac002f30 tx=0x7f65ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 --2- 172.21.15.180:0/2682681827 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f65ac002f30 tx=0x7f65ac007a40).ready entity=mon.1 client_cookie=d1e808676962cc38 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 --2- 172.21.15.180:0/2682681827 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f65ac002f30 tx=0x7f65ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65b9ffb700 1 -- 172.21.15.180:0/2682681827 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ac011470 con 0x7f65bc0a5dd0 2020-02-12T15:09:50.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 --2- 172.21.15.180:0/2682681827 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f65ac002f30 tx=0x7f65ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.258 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65baffd700 1 --2- 172.21.15.180:0/2682681827 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 secure :-1 s=THROTTLE_DONE pgs=154 cs=0 l=1 rx=0x7f65ac002f30 tx=0x7f65ac007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65b9ffb700 1 -- 172.21.15.180:0/2682681827 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65ac0115d0 con 0x7f65bc0a5dd0 2020-02-12T15:09:50.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65b9ffb700 1 -- 172.21.15.180:0/2682681827 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65ac011970 con 0x7f65bc0a5dd0 2020-02-12T15:09:50.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65c163d700 1 -- 172.21.15.180:0/2682681827 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc0a5dd0 msgr2=0x7f65bc0a16d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65c163d700 1 --2- 172.21.15.180:0/2682681827 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 secure :-1 s=READY pgs=154 cs=0 l=1 rx=0x7f65ac002f30 tx=0x7f65ac007a40).stop 2020-02-12T15:09:50.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.252+0000 7f65c163d700 1 -- 172.21.15.180:0/2682681827 shutdown_connections 2020-02-12T15:09:50.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.253+0000 7f65c163d700 1 --2- 172.21.15.180:0/2682681827 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc0a5dd0 0x7f65bc0a16d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.259 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.253+0000 7f65c163d700 1 --2- 172.21.15.180:0/2682681827 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a7240 0x7f65bc0a76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:50.260 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.253+0000 7f65c163d700 1 -- 172.21.15.180:0/2682681827 >> 172.21.15.180:0/2682681827 conn(0x7f65bc05a530 msgr2=0x7f65bc05a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.260 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.253+0000 7f65c163d700 1 -- 172.21.15.180:0/2682681827 shutdown_connections 2020-02-12T15:09:50.260 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.253+0000 7f65c163d700 1 -- 172.21.15.180:0/2682681827 wait complete. 2020-02-12T15:09:50.263 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.253+0000 7f65c163d700 1 Processor -- start 2020-02-12T15:09:50.263 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.253+0000 7f65c163d700 1 -- start start 2020-02-12T15:09:50.263 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65c163d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc09bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.263 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65c163d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f65bc134540 0x7f65bc0a9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.264 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65c163d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65bc0aa110 con 0x7f65bc0a7240 2020-02-12T15:09:50.264 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65c163d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0aa350 con 0x7f65bc0a5dd0 2020-02-12T15:09:50.264 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65c163d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65bc0aa5f0 con 0x7f65bc134540 2020-02-12T15:09:50.264 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f65bc134540 0x7f65bc0a9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.264 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f65bc134540 0x7f65bc0a9cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51186/0 (socket says 172.21.15.180:51186) 2020-02-12T15:09:50.264 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 -- 172.21.15.180:0/3706309275 learned_addr learned my addr 172.21.15.180:0/3706309275 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:50.264 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65baffd700 1 --2- 172.21.15.180:0/3706309275 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc09bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 -- 172.21.15.180:0/3706309275 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a5dd0 msgr2=0x7f65bc09bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc09bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 -- 172.21.15.180:0/3706309275 >> v1:172.21.15.105:6789/0 conn(0x7f65bc0a7240 legacy=0x7f65bc09d430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 -- 172.21.15.180:0/3706309275 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65bc0aa890 con 0x7f65bc134540 2020-02-12T15:09:50.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65baffd700 1 --2- 172.21.15.180:0/3706309275 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc09bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:50.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> v2:172.21.15.180:3300/0 conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.265 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.254+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> v2:172.21.15.180:3300/0 conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65b3fff700 1 -- 172.21.15.180:0/3706309275 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65b40148c0 con 0x7f65bc134540 2020-02-12T15:09:50.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65b3fff700 1 -- 172.21.15.180:0/3706309275 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65b4014a20 con 0x7f65bc134540 2020-02-12T15:09:50.266 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65bc09db40 con 0x7f65bc134540 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65b3fff700 1 -- 172.21.15.180:0/3706309275 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f65b4014e40 con 0x7f65bc134540 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65bc140ea0 con 0x7f65bc134540 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65b3fff700 1 -- 172.21.15.180:0/3706309275 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f65b4007160 con 0x7f65bc134540 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.255+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.256+0000 7f65b3fff700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f65a0039b00 0x7f65a003bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.256+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65bc140b10 con 0x7f65bc134540 2020-02-12T15:09:50.267 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.256+0000 7f65b3fff700 1 -- 172.21.15.180:0/3706309275 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f65b404be20 con 0x7f65bc134540 2020-02-12T15:09:50.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.256+0000 7f65baffd700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f65a0039b00 0x7f65a003bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.256+0000 7f65baffd700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f65a0039b00 0x7f65a003bfc0 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.259+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.268 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.259+0000 7f65b3fff700 1 -- 172.21.15.180:0/3706309275 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f65b4031280 con 0x7f65bc134540 2020-02-12T15:09:50.397 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.395+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f65bc0565b0 con 0x7f65bc134540 2020-02-12T15:09:50.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.395+0000 7f65bb7fe700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=THROTTLE_DONE pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.398 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.395+0000 7f65b3fff700 1 -- 172.21.15.180:0/3706309275 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f65b4033f60 con 0x7f65bc134540 2020-02-12T15:09:50.398 INFO:teuthology.orchestra.run.smithi180.stdout:55834574854 2020-02-12T15:09:50.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f65a0039b00 msgr2=0x7f65a003bfc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f65a0039b00 0x7f65a003bfc0 crc :-1 s=READY pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.399 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 msgr2=0x7f65bc0a9cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 secure :-1 s=READY pgs=155 cs=0 l=1 rx=0x7f65b40032b0 tx=0x7f65b4013030).stop 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 shutdown_connections 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f65a0039b00 0x7f65a003bfc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 --2- 172.21.15.180:0/3706309275 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f65bc134540 0x7f65bc0a9cb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 --2- 172.21.15.180:0/3706309275 >> v2:172.21.15.105:3300/0 conn(0x7f65bc0a5dd0 0x7f65bc09bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.396+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 >> 172.21.15.180:0/3706309275 conn(0x7f65bc05a530 msgr2=0x7f65bc0a0090 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.397+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 shutdown_connections 2020-02-12T15:09:50.400 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.397+0000 7f65c163d700 1 -- 172.21.15.180:0/3706309275 wait complete. 2020-02-12T15:09:50.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.3 2020-02-12T15:09:50.410 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.4 2020-02-12T15:09:50.517 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.515+0000 7f7b8d282700 1 Processor -- start 2020-02-12T15:09:50.517 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.515+0000 7f7b8d282700 1 -- start start 2020-02-12T15:09:50.520 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b8d282700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f7b880a7740 0x7f7b880a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:50.520 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b8d282700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b880aaff0 con 0x7f7b880a1c20 2020-02-12T15:09:50.520 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b8d282700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b8805fe60 con 0x7f7b881380f0 2020-02-12T15:09:50.520 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b8d282700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b880a7bd0 con 0x7f7b880a7740 2020-02-12T15:09:50.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f7b880a7740 0x7f7b880a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b867fc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f7b881380f0 0x7f7b880a7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42706/0 (socket says 172.21.15.180:42706) 2020-02-12T15:09:50.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b867fc700 1 -- 172.21.15.180:0/1727190529 learned_addr learned my addr 172.21.15.180:0/1727190529 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:50.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- 172.21.15.180:0/1727190529 >> v2:172.21.15.180:3300/0 conn(0x7f7b880a7740 0x7f7b880a3d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51194/0 (socket says 172.21.15.180:51194) 2020-02-12T15:09:50.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 -- 172.21.15.180:0/1727190529 >> v1:172.21.15.180:6789/0 conn(0x7f7b881380f0 legacy=0x7f7b880a7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 -- 172.21.15.180:0/1727190529 >> v1:172.21.15.105:6789/0 conn(0x7f7b880a1c20 legacy=0x7f7b880a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.521 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b85ffb700 1 -- 172.21.15.180:0/1727190529 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1271772984 0 0) 0x7f7b8805fe60 con 0x7f7b881380f0 2020-02-12T15:09:50.522 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 -- 172.21.15.180:0/1727190529 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b880aaab0 con 0x7f7b880a7740 2020-02-12T15:09:50.522 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- 172.21.15.180:0/1727190529 >> v2:172.21.15.180:3300/0 conn(0x7f7b880a7740 0x7f7b880a3d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f7b78002f30 tx=0x7f7b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.522 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- 172.21.15.180:0/1727190529 >> v2:172.21.15.180:3300/0 conn(0x7f7b880a7740 0x7f7b880a3d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f7b78002f30 tx=0x7f7b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.522 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- 172.21.15.180:0/1727190529 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b880a7740 0x7f7b880a3d10 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b780088e0).ready entity=mon.1 client_cookie=374ec9eace1a5af6 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.522 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- 172.21.15.180:0/1727190529 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b880a7740 0x7f7b880a3d10 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.522 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b85ffb700 1 -- 172.21.15.180:0/1727190529 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b78008e40 con 0x7f7b880a7740 2020-02-12T15:09:50.522 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- 172.21.15.180:0/1727190529 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b880a7740 0x7f7b880a3d10 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b85ffb700 1 -- 172.21.15.180:0/1727190529 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b780138b0 con 0x7f7b880a7740 2020-02-12T15:09:50.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b877fe700 1 --2- 172.21.15.180:0/1727190529 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b880a7740 0x7f7b880a3d10 secure :-1 s=THROTTLE_DONE pgs=157 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b780088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b85ffb700 1 -- 172.21.15.180:0/1727190529 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b78013c90 con 0x7f7b880a7740 2020-02-12T15:09:50.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b8d282700 1 -- 172.21.15.180:0/1727190529 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b880a7740 msgr2=0x7f7b880a3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.516+0000 7f7b8d282700 1 --2- 172.21.15.180:0/1727190529 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b880a7740 0x7f7b880a3d10 secure :-1 s=READY pgs=157 cs=0 l=1 rx=0x7f7b78002f30 tx=0x7f7b780088e0).stop 2020-02-12T15:09:50.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.517+0000 7f7b8d282700 1 -- 172.21.15.180:0/1727190529 shutdown_connections 2020-02-12T15:09:50.523 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.517+0000 7f7b8d282700 1 --2- 172.21.15.180:0/1727190529 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b880a7740 0x7f7b880a3d10 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.517+0000 7f7b8d282700 1 -- 172.21.15.180:0/1727190529 >> 172.21.15.180:0/1727190529 conn(0x7f7b8809d450 msgr2=0x7f7b8809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.517+0000 7f7b8d282700 1 -- 172.21.15.180:0/1727190529 shutdown_connections 2020-02-12T15:09:50.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.517+0000 7f7b8d282700 1 -- 172.21.15.180:0/1727190529 wait complete. 2020-02-12T15:09:50.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b8d282700 1 Processor -- start 2020-02-12T15:09:50.524 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b8d282700 1 -- start start 2020-02-12T15:09:50.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b8d282700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 0x7f7b881284a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b8d282700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f7b881380f0 0x7f7b88128900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b8d282700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b88134400 con 0x7f7b880a1c20 2020-02-12T15:09:50.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b8d282700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b88134700 con 0x7f7b881380f0 2020-02-12T15:09:50.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b8d282700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880a04a0 con 0x7f7b880a7740 2020-02-12T15:09:50.529 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b86ffd700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f7b880a1c20 0x7f7b880a0760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42710/0 (socket says 172.21.15.180:42710) 2020-02-12T15:09:50.530 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.518+0000 7f7b86ffd700 1 -- 172.21.15.180:0/2961870165 learned_addr learned my addr 172.21.15.180:0/2961870165 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:50.530 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b867fc700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 0x7f7b881284a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.530 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b877fe700 1 --2- 172.21.15.180:0/2961870165 >> v2:172.21.15.105:3300/0 conn(0x7f7b881380f0 0x7f7b88128900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.530 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1414079307 0 0) 0x7f7b88134400 con 0x7f7b880a1c20 2020-02-12T15:09:50.530 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b6c002fe0 con 0x7f7b880a1c20 2020-02-12T15:09:50.530 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 2018792074 0 0) 0x7f7b6c002fe0 con 0x7f7b880a1c20 2020-02-12T15:09:50.530 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f7b88134400 con 0x7f7b880a1c20 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f7b80001c50 con 0x7f7b880a1c20 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 msgr2=0x7f7b881284a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 0x7f7b881284a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 >> v2:172.21.15.105:3300/0 conn(0x7f7b881380f0 msgr2=0x7f7b88128900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 --2- 172.21.15.180:0/2961870165 >> v2:172.21.15.105:3300/0 conn(0x7f7b881380f0 0x7f7b88128900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 >> v1:172.21.15.180:6789/0 conn(0x7f7b880a1c20 legacy=0x7f7b880a0760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.531 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 0x7f7b6c003920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b6c003d80 0x7f7b6c004200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b88134700 con 0x7f7b6c003d80 2020-02-12T15:09:50.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b880a04a0 con 0x7f7b6c0049b0 2020-02-12T15:09:50.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6c0052f0 con 0x7f7b880a7740 2020-02-12T15:09:50.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b867fc700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 0x7f7b6c003920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.532 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b877fe700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b6c003d80 0x7f7b6c004200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 -- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 msgr2=0x7f7b6c003920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f7b880a7740 0x7f7b6c003920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 -- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b6c003d80 msgr2=0x7f7b6c004200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f7b6c003d80 0x7f7b6c004200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b88135200 con 0x7f7b6c0049b0 2020-02-12T15:09:50.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b881354a0 con 0x7f7b6c0049b0 2020-02-12T15:09:50.533 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b88135910 con 0x7f7b6c0049b0 2020-02-12T15:09:50.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.519+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.520+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.520+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.520+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.534 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.520+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.520+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b80008630 con 0x7f7b6c0049b0 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.520+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b80005850 con 0x7f7b6c0049b0 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.520+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b80005c50 con 0x7f7b6c0049b0 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.521+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b880565b0 con 0x7f7b6c0049b0 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.521+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f7b80012050 con 0x7f7b6c0049b0 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.521+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.521+0000 7f7b7ffff700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f7b6c041e80 0x7f7b6c044340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.535 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.521+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f7b8004a500 con 0x7f7b6c0049b0 2020-02-12T15:09:50.536 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.521+0000 7f7b867fc700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f7b6c041e80 0x7f7b6c044340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.536 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.521+0000 7f7b867fc700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f7b6c041e80 0x7f7b6c044340 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.536 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.524+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.536 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.524+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f7b8002fd30 con 0x7f7b6c0049b0 2020-02-12T15:09:50.662 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.659+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7b8805e410 con 0x7f7b6c0049b0 2020-02-12T15:09:50.662 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.660+0000 7f7b86ffd700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=THROTTLE_DONE pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.662 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.660+0000 7f7b7ffff700 1 -- 172.21.15.180:0/2961870165 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7b80032840 con 0x7f7b6c0049b0 2020-02-12T15:09:50.662 INFO:teuthology.orchestra.run.smithi180.stdout:55834574854 2020-02-12T15:09:50.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f7b6c041e80 msgr2=0x7f7b6c044340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f7b6c041e80 0x7f7b6c044340 crc :-1 s=READY pgs=73 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 msgr2=0x7f7b6c004dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 --2- 172.21.15.180:0/2961870165 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f7b6c0049b0 0x7f7b6c004dd0 secure :-1 s=READY pgs=159 cs=0 l=1 rx=0x7f7b80001960 tx=0x7f7b800117d0).stop 2020-02-12T15:09:50.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b877fe700 1 -- 172.21.15.180:0/2961870165 reap_dead start 2020-02-12T15:09:50.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b877fe700 1 -- 172.21.15.180:0/2961870165 reap_dead start 2020-02-12T15:09:50.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 shutdown_connections 2020-02-12T15:09:50.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 >> 172.21.15.180:0/2961870165 conn(0x7f7b8809d450 msgr2=0x7f7b881366d0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 shutdown_connections 2020-02-12T15:09:50.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.661+0000 7f7b8d282700 1 -- 172.21.15.180:0/2961870165 wait complete. 2020-02-12T15:09:50.674 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2020-02-12T15:09:50.674 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.5 2020-02-12T15:09:50.780 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.777+0000 7f4c8da46700 1 Processor -- start 2020-02-12T15:09:50.780 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.777+0000 7f4c8da46700 1 -- start start 2020-02-12T15:09:50.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c8da46700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4c880a1c60 0x7f4c880a6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:50.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c8da46700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881311f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:50.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c8da46700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c88137c10 con 0x7f4c880aa880 2020-02-12T15:09:50.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c8da46700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c88137eb0 con 0x7f4c880a1c60 2020-02-12T15:09:50.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c8da46700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c880a7910 con 0x7f4c88138350 2020-02-12T15:09:50.783 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c867fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881311f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c867fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881311f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51212/0 (socket says 172.21.15.180:51212) 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c867fc700 1 -- 172.21.15.180:0/3872794739 learned_addr learned my addr 172.21.15.180:0/3872794739 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.778+0000 7f4c86ffd700 1 --2- 172.21.15.180:0/3872794739 >> v2:172.21.15.105:3300/0 conn(0x7f4c880a1c60 0x7f4c880a6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 -- 172.21.15.180:0/3872794739 >> v2:172.21.15.105:3300/0 conn(0x7f4c880a1c60 msgr2=0x7f4c880a6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 --2- 172.21.15.180:0/3872794739 >> v2:172.21.15.105:3300/0 conn(0x7f4c880a1c60 0x7f4c880a6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 -- 172.21.15.180:0/3872794739 >> v1:172.21.15.105:6789/0 conn(0x7f4c880aa880 legacy=0x7f4c88131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 -- 172.21.15.180:0/3872794739 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c88067310 con 0x7f4c88138350 2020-02-12T15:09:50.784 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c86ffd700 1 --2- 172.21.15.180:0/3872794739 >> v2:172.21.15.105:3300/0 conn(0x7f4c880a1c60 0x7f4c880a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 --2- 172.21.15.180:0/3872794739 >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881311f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4c880a2a20 tx=0x7f4c78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 --2- 172.21.15.180:0/3872794739 >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881311f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4c880a2a20 tx=0x7f4c78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 --2- 172.21.15.180:0/3872794739 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881311f0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f4c880a2a20 tx=0x7f4c78007a40).ready entity=mon.1 client_cookie=b64651442bec5376 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 --2- 172.21.15.180:0/3872794739 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881311f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f4c880a2a20 tx=0x7f4c78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c85ffb700 1 -- 172.21.15.180:0/3872794739 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c78011250 con 0x7f4c88138350 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 --2- 172.21.15.180:0/3872794739 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881311f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f4c880a2a20 tx=0x7f4c78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c867fc700 1 --2- 172.21.15.180:0/3872794739 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881311f0 secure :-1 s=THROTTLE_DONE pgs=160 cs=0 l=1 rx=0x7f4c880a2a20 tx=0x7f4c78007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.785 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c85ffb700 1 -- 172.21.15.180:0/3872794739 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c780113b0 con 0x7f4c88138350 2020-02-12T15:09:50.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c85ffb700 1 -- 172.21.15.180:0/3872794739 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c78011790 con 0x7f4c88138350 2020-02-12T15:09:50.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c8da46700 1 -- 172.21.15.180:0/3872794739 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 msgr2=0x7f4c881311f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c8da46700 1 --2- 172.21.15.180:0/3872794739 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881311f0 secure :-1 s=READY pgs=160 cs=0 l=1 rx=0x7f4c880a2a20 tx=0x7f4c78007a40).stop 2020-02-12T15:09:50.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.779+0000 7f4c8da46700 1 -- 172.21.15.180:0/3872794739 shutdown_connections 2020-02-12T15:09:50.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.780+0000 7f4c8da46700 1 --2- 172.21.15.180:0/3872794739 >> v2:172.21.15.105:3300/0 conn(0x7f4c880a1c60 0x7f4c880a6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:50.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.780+0000 7f4c8da46700 1 --2- 172.21.15.180:0/3872794739 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881311f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.786 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.780+0000 7f4c8da46700 1 -- 172.21.15.180:0/3872794739 >> 172.21.15.180:0/3872794739 conn(0x7f4c8809d450 msgr2=0x7f4c8809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.787 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.780+0000 7f4c8da46700 1 -- 172.21.15.180:0/3872794739 shutdown_connections 2020-02-12T15:09:50.787 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.780+0000 7f4c8da46700 1 -- 172.21.15.180:0/3872794739 wait complete. 2020-02-12T15:09:50.787 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.780+0000 7f4c8da46700 1 Processor -- start 2020-02-12T15:09:50.787 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.780+0000 7f4c8da46700 1 -- start start 2020-02-12T15:09:50.790 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c8da46700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4c880aa880 0x7f4c880a96a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c8da46700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881295e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c8da46700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c88142110 con 0x7f4c880a1c60 2020-02-12T15:09:50.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c8da46700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c880a9c40 con 0x7f4c880aa880 2020-02-12T15:09:50.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c8da46700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c881412c0 con 0x7f4c88138350 2020-02-12T15:09:50.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881295e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881295e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51218/0 (socket says 172.21.15.180:51218) 2020-02-12T15:09:50.791 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 -- 172.21.15.180:0/1100546796 learned_addr learned my addr 172.21.15.180:0/1100546796 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c867fc700 1 --2- 172.21.15.180:0/1100546796 >> v2:172.21.15.105:3300/0 conn(0x7f4c880aa880 0x7f4c880a96a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 -- 172.21.15.180:0/1100546796 >> v2:172.21.15.105:3300/0 conn(0x7f4c880aa880 msgr2=0x7f4c880a96a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> v2:172.21.15.105:3300/0 conn(0x7f4c880aa880 0x7f4c880a96a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 -- 172.21.15.180:0/1100546796 >> v1:172.21.15.105:6789/0 conn(0x7f4c880a1c60 legacy=0x7f4c88141a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 -- 172.21.15.180:0/1100546796 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c88141560 con 0x7f4c88138350 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.781+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> v2:172.21.15.180:3300/0 conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.792 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c77fff700 1 -- 172.21.15.180:0/1100546796 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c800122b0 con 0x7f4c88138350 2020-02-12T15:09:50.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c77fff700 1 -- 172.21.15.180:0/1100546796 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c80012410 con 0x7f4c88138350 2020-02-12T15:09:50.793 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c8812cf20 con 0x7f4c88138350 2020-02-12T15:09:50.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c77fff700 1 -- 172.21.15.180:0/1100546796 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c800127f0 con 0x7f4c88138350 2020-02-12T15:09:50.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c88136a60 con 0x7f4c88138350 2020-02-12T15:09:50.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c77fff700 1 -- 172.21.15.180:0/1100546796 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f4c80012a60 con 0x7f4c88138350 2020-02-12T15:09:50.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.782+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.783+0000 7f4c77fff700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c64039bf0 0x7f4c6403c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:50.794 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.783+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c880565b0 con 0x7f4c88138350 2020-02-12T15:09:50.795 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.783+0000 7f4c77fff700 1 -- 172.21.15.180:0/1100546796 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4c8004a130 con 0x7f4c88138350 2020-02-12T15:09:50.795 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.783+0000 7f4c86ffd700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c64039bf0 0x7f4c6403c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:50.795 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.783+0000 7f4c86ffd700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c64039bf0 0x7f4c6403c0b0 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:50.795 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.786+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.795 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.786+0000 7f4c77fff700 1 -- 172.21.15.180:0/1100546796 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4c8002f700 con 0x7f4c88138350 2020-02-12T15:09:50.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.922+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f4c8805e410 con 0x7f4c88138350 2020-02-12T15:09:50.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.922+0000 7f4c877fe700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=THROTTLE_DONE pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:50.925 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.922+0000 7f4c77fff700 1 -- 172.21.15.180:0/1100546796 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4c80032210 con 0x7f4c88138350 2020-02-12T15:09:50.925 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:50.926 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c64039bf0 msgr2=0x7f4c6403c0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.926 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c64039bf0 0x7f4c6403c0b0 crc :-1 s=READY pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.927 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 msgr2=0x7f4c881295e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:50.927 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 secure :-1 s=READY pgs=161 cs=0 l=1 rx=0x7f4c800022d0 tx=0x7f4c80010c10).stop 2020-02-12T15:09:50.927 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 shutdown_connections 2020-02-12T15:09:50.927 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c64039bf0 0x7f4c6403c0b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.927 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 --2- 172.21.15.180:0/1100546796 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4c88138350 0x7f4c881295e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.927 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 --2- 172.21.15.180:0/1100546796 >> v2:172.21.15.105:3300/0 conn(0x7f4c880aa880 0x7f4c880a96a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:50.927 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 >> 172.21.15.180:0/1100546796 conn(0x7f4c8809d450 msgr2=0x7f4c880698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:50.928 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 shutdown_connections 2020-02-12T15:09:50.928 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:50.923+0000 7f4c8da46700 1 -- 172.21.15.180:0/1100546796 wait complete. 2020-02-12T15:09:50.936 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2020-02-12T15:09:50.936 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.6 2020-02-12T15:09:51.049 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.039+0000 7f5ac9171700 1 Processor -- start 2020-02-12T15:09:51.049 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.039+0000 7f5ac9171700 1 -- start start 2020-02-12T15:09:51.049 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac9171700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f5ac40a1c20 0x7f5ac41380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.050 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac9171700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f5ac40a3d10 0x7f5ac40a2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.050 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac9171700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a7030 0x7f5ac40a7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.050 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac9171700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac40aaff0 con 0x7f5ac40a3d10 2020-02-12T15:09:51.050 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac9171700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ac405fe60 con 0x7f5ac40a1c20 2020-02-12T15:09:51.050 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac9171700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac40aaab0 con 0x7f5ac40a7030 2020-02-12T15:09:51.050 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f5ac40a1c20 0x7f5ac41380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.050 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f5ac40a1c20 0x7f5ac41380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51224/0 (socket says 172.21.15.180:51224) 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 -- 172.21.15.180:0/453529483 learned_addr learned my addr 172.21.15.180:0/453529483 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac359e700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a7030 0x7f5ac40a7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5abbfff700 1 --2- 172.21.15.180:0/453529483 >> v2:172.21.15.105:3300/0 conn(0x7f5ac40a3d10 0x7f5ac40a2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 -- 172.21.15.180:0/453529483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a7030 msgr2=0x7f5ac40a7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a7030 0x7f5ac40a7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 -- 172.21.15.180:0/453529483 >> v2:172.21.15.105:3300/0 conn(0x7f5ac40a3d10 msgr2=0x7f5ac40a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> v2:172.21.15.105:3300/0 conn(0x7f5ac40a3d10 0x7f5ac40a2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.051 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5ac2d9d700 1 -- 172.21.15.180:0/453529483 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac40aad50 con 0x7f5ac40a1c20 2020-02-12T15:09:51.052 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.040+0000 7f5abbfff700 1 --2- 172.21.15.180:0/453529483 >> v2:172.21.15.105:3300/0 conn(0x7f5ac40a3d10 0x7f5ac40a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:51.052 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> v2:172.21.15.180:3300/0 conn(0x7f5ac40a1c20 0x7f5ac41380f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f5ab4002f30 tx=0x7f5ab4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.052 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> v2:172.21.15.180:3300/0 conn(0x7f5ac40a1c20 0x7f5ac41380f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f5ab4002f30 tx=0x7f5ab4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.052 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f5ac40a1c20 0x7f5ac41380f0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f5ab4002f30 tx=0x7f5ab4007a40).ready entity=mon.1 client_cookie=60aad2645b0ba84e server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.052 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f5ac40a1c20 0x7f5ac41380f0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ab4002f30 tx=0x7f5ab4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.052 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f5ac40a1c20 0x7f5ac41380f0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ab4002f30 tx=0x7f5ab4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.052 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac259c700 1 -- 172.21.15.180:0/453529483 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab4011720 con 0x7f5ac40a1c20 2020-02-12T15:09:51.053 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f5ac40a1c20 0x7f5ac41380f0 secure :-1 s=THROTTLE_DONE pgs=162 cs=0 l=1 rx=0x7f5ab4002f30 tx=0x7f5ab4007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.053 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac259c700 1 -- 172.21.15.180:0/453529483 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ab4011880 con 0x7f5ac40a1c20 2020-02-12T15:09:51.053 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac259c700 1 -- 172.21.15.180:0/453529483 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ab4011c20 con 0x7f5ac40a1c20 2020-02-12T15:09:51.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 -- 172.21.15.180:0/453529483 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f5ac40a1c20 msgr2=0x7f5ac41380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f5ac40a1c20 0x7f5ac41380f0 secure :-1 s=READY pgs=162 cs=0 l=1 rx=0x7f5ab4002f30 tx=0x7f5ab4007a40).stop 2020-02-12T15:09:51.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 -- 172.21.15.180:0/453529483 shutdown_connections 2020-02-12T15:09:51.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f5ac40a1c20 0x7f5ac41380f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 --2- 172.21.15.180:0/453529483 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a7030 0x7f5ac40a7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 --2- 172.21.15.180:0/453529483 >> v2:172.21.15.105:3300/0 conn(0x7f5ac40a3d10 0x7f5ac40a2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.054 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 -- 172.21.15.180:0/453529483 >> 172.21.15.180:0/453529483 conn(0x7f5ac409d450 msgr2=0x7f5ac409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 -- 172.21.15.180:0/453529483 shutdown_connections 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.041+0000 7f5ac9171700 1 -- 172.21.15.180:0/453529483 wait complete. 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.042+0000 7f5ac9171700 1 Processor -- start 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.042+0000 7f5ac9171700 1 -- start start 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac9171700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac9171700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac4131d20 con 0x7f5ac40a1c20 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac9171700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ac4128270 con 0x7f5ac40a7030 2020-02-12T15:09:51.055 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac9171700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac412e330 con 0x7f5ac40a3d10 2020-02-12T15:09:51.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac359e700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f5ac40a7030 0x7f5ac4148d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42746/0 (socket says 172.21.15.180:42746) 2020-02-12T15:09:51.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac359e700 1 -- 172.21.15.180:0/1703130665 learned_addr learned my addr 172.21.15.180:0/1703130665 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:51.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582827648 0 0) 0x7f5ac4128270 con 0x7f5ac40a7030 2020-02-12T15:09:51.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5aa8002fe0 con 0x7f5ac40a7030 2020-02-12T15:09:51.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1221391896 0 0) 0x7f5ac4131d20 con 0x7f5ac40a1c20 2020-02-12T15:09:51.056 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac4128270 con 0x7f5ac40a1c20 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 1413576460 0 0) 0x7f5aa8002fe0 con 0x7f5ac40a7030 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5abbfff700 1 -- 172.21.15.180:0/1703130665 >> v1:172.21.15.180:6789/0 conn(0x7f5ac40a7030 legacy=0x7f5ac4148d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5abbfff700 1 -- 172.21.15.180:0/1703130665 >> v1:172.21.15.105:6789/0 conn(0x7f5ac40a1c20 legacy=0x7f5ac4131610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5abbfff700 1 -- 172.21.15.180:0/1703130665 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac4130590 con 0x7f5ac40a3d10 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.043+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.057 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5abc0018d0 con 0x7f5ac40a3d10 2020-02-12T15:09:51.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5aac009dd0 con 0x7f5ac40a3d10 2020-02-12T15:09:51.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ac4133db0 con 0x7f5ac40a3d10 2020-02-12T15:09:51.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5aac009390 con 0x7f5ac40a3d10 2020-02-12T15:09:51.058 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ac40a7a70 con 0x7f5ac40a3d10 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ac4131330 con 0x7f5ac40a3d10 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f5aac007170 con 0x7f5ac40a3d10 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.044+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.045+0000 7f5ac0d99700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f5aa8039ff0 0x7f5aa803c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.045+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f5aac048f70 con 0x7f5ac40a3d10 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.045+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f5aa8039ff0 0x7f5aa803c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.059 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.045+0000 7f5ac2d9d700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f5aa8039ff0 0x7f5aa803c4b0 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.048+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.060 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.048+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f5aac02e580 con 0x7f5ac40a3d10 2020-02-12T15:09:51.188 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.183+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f5ac40565b0 con 0x7f5ac40a3d10 2020-02-12T15:09:51.188 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.184+0000 7f5abbfff700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=THROTTLE_DONE pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.188 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.184+0000 7f5ac0d99700 1 -- 172.21.15.180:0/1703130665 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5aac031090 con 0x7f5ac40a3d10 2020-02-12T15:09:51.188 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f5aa8039ff0 msgr2=0x7f5aa803c4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f5aa8039ff0 0x7f5aa803c4b0 crc :-1 s=READY pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 msgr2=0x7f5ac41488e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 secure :-1 s=READY pgs=38 cs=0 l=1 rx=0x7f5abc0032b0 tx=0x7f5aac0109f0).stop 2020-02-12T15:09:51.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 shutdown_connections 2020-02-12T15:09:51.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f5aa8039ff0 0x7f5aa803c4b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.189 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 --2- 172.21.15.180:0/1703130665 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f5ac40a3d10 0x7f5ac41488e0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.190 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 >> 172.21.15.180:0/1703130665 conn(0x7f5ac409d450 msgr2=0x7f5ac409d830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.190 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 shutdown_connections 2020-02-12T15:09:51.190 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.185+0000 7f5ac9171700 1 -- 172.21.15.180:0/1703130665 wait complete. 2020-02-12T15:09:51.190 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:51.198 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.6 2020-02-12T15:09:51.198 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd last-stat-seq osd.7 2020-02-12T15:09:51.304 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 Processor -- start 2020-02-12T15:09:51.304 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 -- start start 2020-02-12T15:09:51.312 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f09280a5bc0 0x7f09280a1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.312 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f09280a5fa0 0x7f09280a18c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.313 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a6820 0x7f09280a6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.313 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09280a3b30 con 0x7f09280a5fa0 2020-02-12T15:09:51.313 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09280a23b0 con 0x7f09280a5bc0 2020-02-12T15:09:51.313 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f092cf9e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09280a2650 con 0x7f09280a6820 2020-02-12T15:09:51.313 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f09277fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f09280a5bc0 0x7f09280a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.313 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f09277fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f09280a5bc0 0x7f09280a1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51236/0 (socket says 172.21.15.180:51236) 2020-02-12T15:09:51.314 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f09277fe700 1 -- 172.21.15.180:0/2279632601 learned_addr learned my addr 172.21.15.180:0/2279632601 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:51.314 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f0927fff700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a6820 0x7f09280a6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.314 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.302+0000 7f0926ffd700 1 --2- 172.21.15.180:0/2279632601 >> v2:172.21.15.105:3300/0 conn(0x7f09280a5fa0 0x7f09280a18c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.314 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 -- 172.21.15.180:0/2279632601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a6820 msgr2=0x7f09280a6cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.314 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a6820 0x7f09280a6cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.314 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 -- 172.21.15.180:0/2279632601 >> v2:172.21.15.105:3300/0 conn(0x7f09280a5fa0 msgr2=0x7f09280a18c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.315 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> v2:172.21.15.105:3300/0 conn(0x7f09280a5fa0 0x7f09280a18c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.315 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 -- 172.21.15.180:0/2279632601 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09280a2af0 con 0x7f09280a5bc0 2020-02-12T15:09:51.315 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f0926ffd700 1 --2- 172.21.15.180:0/2279632601 >> v2:172.21.15.105:3300/0 conn(0x7f09280a5fa0 0x7f09280a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:51.315 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> v2:172.21.15.180:3300/0 conn(0x7f09280a5bc0 0x7f09280a1460 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f0918002f30 tx=0x7f0918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.315 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> v2:172.21.15.180:3300/0 conn(0x7f09280a5bc0 0x7f09280a1460 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f0918002f30 tx=0x7f0918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.316 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5bc0 0x7f09280a1460 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f0918002f30 tx=0x7f0918007a40).ready entity=mon.1 client_cookie=2231e293e95d9f82 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.316 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5bc0 0x7f09280a1460 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f0918002f30 tx=0x7f0918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.316 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09267fc700 1 -- 172.21.15.180:0/2279632601 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0918011670 con 0x7f09280a5bc0 2020-02-12T15:09:51.316 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5bc0 0x7f09280a1460 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f0918002f30 tx=0x7f0918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.316 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09277fe700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5bc0 0x7f09280a1460 secure :-1 s=THROTTLE_DONE pgs=164 cs=0 l=1 rx=0x7f0918002f30 tx=0x7f0918007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.316 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09267fc700 1 -- 172.21.15.180:0/2279632601 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09180117d0 con 0x7f09280a5bc0 2020-02-12T15:09:51.317 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f09267fc700 1 -- 172.21.15.180:0/2279632601 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0918011b70 con 0x7f09280a5bc0 2020-02-12T15:09:51.317 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 -- 172.21.15.180:0/2279632601 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5bc0 msgr2=0x7f09280a1460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.317 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5bc0 0x7f09280a1460 secure :-1 s=READY pgs=164 cs=0 l=1 rx=0x7f0918002f30 tx=0x7f0918007a40).stop 2020-02-12T15:09:51.317 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 -- 172.21.15.180:0/2279632601 shutdown_connections 2020-02-12T15:09:51.317 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5bc0 0x7f09280a1460 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.317 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 --2- 172.21.15.180:0/2279632601 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a6820 0x7f09280a6cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.318 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 --2- 172.21.15.180:0/2279632601 >> v2:172.21.15.105:3300/0 conn(0x7f09280a5fa0 0x7f09280a18c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.318 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 -- 172.21.15.180:0/2279632601 >> 172.21.15.180:0/2279632601 conn(0x7f092805a530 msgr2=0x7f092805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.318 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 -- 172.21.15.180:0/2279632601 shutdown_connections 2020-02-12T15:09:51.318 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.303+0000 7f092cf9e700 1 -- 172.21.15.180:0/2279632601 wait complete. 2020-02-12T15:09:51.318 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.304+0000 7f092cf9e700 1 Processor -- start 2020-02-12T15:09:51.318 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.304+0000 7f092cf9e700 1 -- start start 2020-02-12T15:09:51.319 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f092cf9e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a5bc0 0x7f0928132c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.319 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f092cf9e700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f09280a5fa0 0x7f09280a9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.319 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f092cf9e700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09281334b0 con 0x7f09280a6820 2020-02-12T15:09:51.319 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f092cf9e700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0928130fc0 con 0x7f09280a5fa0 2020-02-12T15:09:51.319 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f092cf9e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0928131260 con 0x7f09280a5bc0 2020-02-12T15:09:51.319 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f09280a5fa0 0x7f09280a9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.319 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0927fff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f09280a6820 0x7f092812ffb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42760/0 (socket says 172.21.15.180:42760) 2020-02-12T15:09:51.320 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0927fff700 1 -- 172.21.15.180:0/878006010 learned_addr learned my addr 172.21.15.180:0/878006010 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:51.320 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f09277fe700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a5bc0 0x7f0928132c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.320 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 -- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a5bc0 msgr2=0x7f0928132c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.320 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a5bc0 0x7f0928132c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.320 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 -- 172.21.15.180:0/878006010 >> v1:172.21.15.180:6789/0 conn(0x7f09280a6820 legacy=0x7f092812ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.320 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578224306 0 0) 0x7f09281334b0 con 0x7f09280a6820 2020-02-12T15:09:51.321 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 -- 172.21.15.180:0/878006010 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0928131700 con 0x7f09280a5fa0 2020-02-12T15:09:51.321 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> v2:172.21.15.180:3300/0 conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.321 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> v2:172.21.15.180:3300/0 conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.321 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.305+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.321 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.322 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091c005e90 con 0x7f09280a5fa0 2020-02-12T15:09:51.322 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.322 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09281330b0 con 0x7f09280a5fa0 2020-02-12T15:09:51.322 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.322 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f091c007160 con 0x7f09280a5fa0 2020-02-12T15:09:51.323 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f091c007540 con 0x7f09280a5fa0 2020-02-12T15:09:51.323 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09280a9710 con 0x7f09280a5fa0 2020-02-12T15:09:51.323 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.306+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.323 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.307+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f091c00e170 con 0x7f09280a5fa0 2020-02-12T15:09:51.323 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.307+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.323 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.307+0000 7f0924ff9700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0908039aa0 0x7f090803bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.324 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.307+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f091c007e40 con 0x7f09280a5fa0 2020-02-12T15:09:51.324 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.307+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0928131400 con 0x7f09280a5fa0 2020-02-12T15:09:51.324 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.307+0000 7f09277fe700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0908039aa0 0x7f090803bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.324 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.307+0000 7f09277fe700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0908039aa0 0x7f090803bf60 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.333 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.310+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.333 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.310+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f091c02ed70 con 0x7f09280a5fa0 2020-02-12T15:09:51.448 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.446+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f09280565b0 con 0x7f09280a5fa0 2020-02-12T15:09:51.449 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.447+0000 7f0926ffd700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=THROTTLE_DONE pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.450 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.447+0000 7f0924ff9700 1 -- 172.21.15.180:0/878006010 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f091c031880 con 0x7f09280a5fa0 2020-02-12T15:09:51.450 INFO:teuthology.orchestra.run.smithi180.stdout:55834574853 2020-02-12T15:09:51.452 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0908039aa0 msgr2=0x7f090803bf60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.452 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0908039aa0 0x7f090803bf60 crc :-1 s=READY pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.452 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 msgr2=0x7f09280a9070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.452 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 secure :-1 s=READY pgs=166 cs=0 l=1 rx=0x7f091c002f30 tx=0x7f091c010a90).stop 2020-02-12T15:09:51.452 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 shutdown_connections 2020-02-12T15:09:51.452 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f0908039aa0 0x7f090803bf60 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.452 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f09280a5bc0 0x7f0928132c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.453 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 --2- 172.21.15.180:0/878006010 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f09280a5fa0 0x7f09280a9070 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.453 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 >> 172.21.15.180:0/878006010 conn(0x7f092805a530 msgr2=0x7f092805ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.453 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 shutdown_connections 2020-02-12T15:09:51.453 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.449+0000 7f092cf9e700 1 -- 172.21.15.180:0/878006010 wait complete. 2020-02-12T15:09:51.467 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2020-02-12T15:09:51.468 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2020-02-12T15:09:51.468 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-12T15:09:51.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.571+0000 7ff76c66f700 1 Processor -- start 2020-02-12T15:09:51.574 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.571+0000 7ff76c66f700 1 -- start start 2020-02-12T15:09:51.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76c66f700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff7640a3990 0x7ff76412ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76c66f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff76412ee90 0x7ff764134c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76c66f700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7640a3f10 con 0x7ff7640aac00 2020-02-12T15:09:51.581 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76c66f700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7640a41b0 con 0x7ff7640a3990 2020-02-12T15:09:51.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76c66f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7640a4450 con 0x7ff76412ee90 2020-02-12T15:09:51.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff769c0a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff7640a3990 0x7ff76412ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76a40b700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7ff7640aac00 0x7ff7640a6520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42764/0 (socket says 172.21.15.180:42764) 2020-02-12T15:09:51.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76a40b700 1 -- 172.21.15.180:0/1645037532 learned_addr learned my addr 172.21.15.180:0/1645037532 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:51.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff769c0a700 1 -- 172.21.15.180:0/1645037532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff76412ee90 msgr2=0x7ff764134c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.582 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76ac0c700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff76412ee90 0x7ff764134c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.583 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff769409700 1 -- 172.21.15.180:0/1645037532 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3805674334 0 0) 0x7ff7640a3f10 con 0x7ff7640aac00 2020-02-12T15:09:51.583 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff769c0a700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff76412ee90 0x7ff764134c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.583 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff769c0a700 1 -- 172.21.15.180:0/1645037532 >> v1:172.21.15.180:6789/0 conn(0x7ff7640aac00 legacy=0x7ff7640a6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.583 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff769c0a700 1 -- 172.21.15.180:0/1645037532 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76412f320 con 0x7ff7640a3990 2020-02-12T15:09:51.583 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff76ac0c700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff76412ee90 0x7ff764134c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:51.583 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.572+0000 7ff769c0a700 1 --2- 172.21.15.180:0/1645037532 >> v2:172.21.15.180:3300/0 conn(0x7ff7640a3990 0x7ff76412ea30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7ff760002f30 tx=0x7ff7600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.584 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769c0a700 1 --2- 172.21.15.180:0/1645037532 >> v2:172.21.15.180:3300/0 conn(0x7ff7640a3990 0x7ff76412ea30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7ff760002f30 tx=0x7ff7600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.584 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769c0a700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640a3990 0x7ff76412ea30 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7ff760002f30 tx=0x7ff7600088e0).ready entity=mon.1 client_cookie=f02fd3d0e73af5ec server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.584 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769c0a700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640a3990 0x7ff76412ea30 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7ff760002f30 tx=0x7ff7600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.584 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769409700 1 -- 172.21.15.180:0/1645037532 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff760008e40 con 0x7ff7640a3990 2020-02-12T15:09:51.584 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769c0a700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640a3990 0x7ff76412ea30 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7ff760002f30 tx=0x7ff7600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.584 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769c0a700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640a3990 0x7ff76412ea30 secure :-1 s=THROTTLE_DONE pgs=168 cs=0 l=1 rx=0x7ff760002f30 tx=0x7ff7600088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.584 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769409700 1 -- 172.21.15.180:0/1645037532 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7600116a0 con 0x7ff7640a3990 2020-02-12T15:09:51.585 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff769409700 1 -- 172.21.15.180:0/1645037532 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff760011a40 con 0x7ff7640a3990 2020-02-12T15:09:51.585 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 -- 172.21.15.180:0/1645037532 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640a3990 msgr2=0x7ff76412ea30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.585 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640a3990 0x7ff76412ea30 secure :-1 s=READY pgs=168 cs=0 l=1 rx=0x7ff760002f30 tx=0x7ff7600088e0).stop 2020-02-12T15:09:51.585 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 -- 172.21.15.180:0/1645037532 shutdown_connections 2020-02-12T15:09:51.585 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff76412ee90 0x7ff764134c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.585 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 --2- 172.21.15.180:0/1645037532 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640a3990 0x7ff76412ea30 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.585 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 -- 172.21.15.180:0/1645037532 >> 172.21.15.180:0/1645037532 conn(0x7ff76409d450 msgr2=0x7ff76409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.587 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 -- 172.21.15.180:0/1645037532 shutdown_connections 2020-02-12T15:09:51.587 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.573+0000 7ff76c66f700 1 -- 172.21.15.180:0/1645037532 wait complete. 2020-02-12T15:09:51.587 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.574+0000 7ff76c66f700 1 Processor -- start 2020-02-12T15:09:51.587 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.574+0000 7ff76c66f700 1 -- start start 2020-02-12T15:09:51.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76c66f700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7640a3990 0x7ff764134670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76c66f700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff7640aac00 0x7ff764131140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76c66f700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff76412f560 con 0x7ff76412ee90 2020-02-12T15:09:51.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76c66f700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff764130920 con 0x7ff7640aac00 2020-02-12T15:09:51.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76c66f700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff764130b10 con 0x7ff7640a3990 2020-02-12T15:09:51.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff7640aac00 0x7ff764131140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.588 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7ff7640aac00 0x7ff764131140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51258/0 (socket says 172.21.15.180:51258) 2020-02-12T15:09:51.589 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 -- 172.21.15.180:0/3413069608 learned_addr learned my addr 172.21.15.180:0/3413069608 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:51.589 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76a40b700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7640a3990 0x7ff764134670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.589 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 -- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7640a3990 msgr2=0x7ff764134670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.589 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7640a3990 0x7ff764134670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.589 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 -- 172.21.15.180:0/3413069608 >> v1:172.21.15.105:6789/0 conn(0x7ff76412ee90 legacy=0x7ff764145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.589 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 -- 172.21.15.180:0/3413069608 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff76412f790 con 0x7ff7640aac00 2020-02-12T15:09:51.589 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> v2:172.21.15.180:3300/0 conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> v2:172.21.15.180:3300/0 conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff7577fe700 1 -- 172.21.15.180:0/3413069608 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff760007150 con 0x7ff7640aac00 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff7577fe700 1 -- 172.21.15.180:0/3413069608 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7600072b0 con 0x7ff7640aac00 2020-02-12T15:09:51.590 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff764131980 con 0x7ff7640aac00 2020-02-12T15:09:51.591 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff7577fe700 1 -- 172.21.15.180:0/3413069608 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff7600056c0 con 0x7ff7640aac00 2020-02-12T15:09:51.591 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.575+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff764131e20 con 0x7ff7640aac00 2020-02-12T15:09:51.591 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.576+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.591 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.576+0000 7ff7577fe700 1 -- 172.21.15.180:0/3413069608 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7ff7600058f0 con 0x7ff7640aac00 2020-02-12T15:09:51.591 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.576+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.591 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.576+0000 7ff7577fe700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff744039c70 0x7ff74403c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.591 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.576+0000 7ff7577fe700 1 -- 172.21.15.180:0/3413069608 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7ff76004a000 con 0x7ff7640aac00 2020-02-12T15:09:51.592 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.576+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff764131790 con 0x7ff7640aac00 2020-02-12T15:09:51.592 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.577+0000 7ff76a40b700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff744039c70 0x7ff74403c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.592 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.577+0000 7ff76a40b700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff744039c70 0x7ff74403c130 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.592 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.580+0000 7ff769c0a700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=THROTTLE_DONE pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.593 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.580+0000 7ff7577fe700 1 -- 172.21.15.180:0/3413069608 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7ff76002f710 con 0x7ff7640aac00 2020-02-12T15:09:51.714 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.711+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 --> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff76412f990 con 0x7ff744039c70 2020-02-12T15:09:51.718 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.713+0000 7ff7577fe700 1 -- 172.21.15.180:0/3413069608 <== mgr.4101 v2:172.21.15.105:6800/21618 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66349 (crc 0 0 0) 0x7ff75c001b10 con 0x7ff744039c70 2020-02-12T15:09:51.718 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff744039c70 msgr2=0x7ff74403c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.719 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff744039c70 0x7ff74403c130 crc :-1 s=READY pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.719 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 msgr2=0x7ff764131140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.719 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 secure :-1 s=READY pgs=169 cs=0 l=1 rx=0x7ff764134cd0 tx=0x7ff7640aafe0).stop 2020-02-12T15:09:51.719 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 shutdown_connections 2020-02-12T15:09:51.719 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7ff744039c70 0x7ff74403c130 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.719 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7ff7640a3990 0x7ff764134670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.719 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 --2- 172.21.15.180:0/3413069608 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7ff7640aac00 0x7ff764131140 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.720 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 >> 172.21.15.180:0/3413069608 conn(0x7ff76409d450 msgr2=0x7ff76409d830 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.720 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 shutdown_connections 2020-02-12T15:09:51.720 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.715+0000 7ff76c66f700 1 -- 172.21.15.180:0/3413069608 wait complete. 2020-02-12T15:09:51.720 INFO:teuthology.orchestra.run.smithi180.stderr:dumped all 2020-02-12T15:09:51.720 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:51.728 INFO:teuthology.orchestra.run.smithi180.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-02-12T15:09:50.446906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":772188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":760,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000873"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.853146+0000","last_change":"2020-02-12T15:09:42.852799+0000","last_active":"2020-02-12T15:09:42.853146+0000","last_peered":"2020-02-12T15:09:42.853146+0000","last_clean":"2020-02-12T15:09:42.853146+0000","last_became_active":"2020-02-12T15:09:42.852180+0000","last_became_peered":"2020-02-12T15:09:42.852180+0000","last_unstale":"2020-02-12T15:09:42.853146+0000","last_undegraded":"2020-02-12T15:09:42.853146+0000","last_fullsized":"2020-02-12T15:09:42.853146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886890+0000","last_change":"2020-02-12T15:09:36.334621+0000","last_active":"2020-02-12T15:09:42.886890+0000","last_peered":"2020-02-12T15:09:42.886890+0000","last_clean":"2020-02-12T15:09:42.886890+0000","last_became_active":"2020-02-12T15:09:36.334249+0000","last_became_peered":"2020-02-12T15:09:36.334249+0000","last_unstale":"2020-02-12T15:09:42.886890+0000","last_undegraded":"2020-02-12T15:09:42.886890+0000","last_fullsized":"2020-02-12T15:09:42.886890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.445569+0000","last_change":"2020-02-12T15:09:39.406773+0000","last_active":"2020-02-12T15:09:45.445569+0000","last_peered":"2020-02-12T15:09:45.445569+0000","last_clean":"2020-02-12T15:09:45.445569+0000","last_became_active":"2020-02-12T15:09:39.406402+0000","last_became_peered":"2020-02-12T15:09:39.406402+0000","last_unstale":"2020-02-12T15:09:45.445569+0000","last_undegraded":"2020-02-12T15:09:45.445569+0000","last_fullsized":"2020-02-12T15:09:45.445569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.853085+0000","last_change":"2020-02-12T15:09:42.852657+0000","last_active":"2020-02-12T15:09:42.853085+0000","last_peered":"2020-02-12T15:09:42.853085+0000","last_clean":"2020-02-12T15:09:42.853085+0000","last_became_active":"2020-02-12T15:09:42.851995+0000","last_became_peered":"2020-02-12T15:09:42.851995+0000","last_unstale":"2020-02-12T15:09:42.853085+0000","last_undegraded":"2020-02-12T15:09:42.853085+0000","last_fullsized":"2020-02-12T15:09:42.853085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886075+0000","last_change":"2020-02-12T15:09:36.336526+0000","last_active":"2020-02-12T15:09:42.886075+0000","last_peered":"2020-02-12T15:09:42.886075+0000","last_clean":"2020-02-12T15:09:42.886075+0000","last_became_active":"2020-02-12T15:09:36.336182+0000","last_became_peered":"2020-02-12T15:09:36.336182+0000","last_unstale":"2020-02-12T15:09:42.886075+0000","last_undegraded":"2020-02-12T15:09:42.886075+0000","last_fullsized":"2020-02-12T15:09:42.886075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.448302+0000","last_change":"2020-02-12T15:09:39.406617+0000","last_active":"2020-02-12T15:09:45.448302+0000","last_peered":"2020-02-12T15:09:45.448302+0000","last_clean":"2020-02-12T15:09:45.448302+0000","last_became_active":"2020-02-12T15:09:39.406253+0000","last_became_peered":"2020-02-12T15:09:39.406253+0000","last_unstale":"2020-02-12T15:09:45.448302+0000","last_undegraded":"2020-02-12T15:09:45.448302+0000","last_fullsized":"2020-02-12T15:09:45.448302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.743611+0000","last_change":"2020-02-12T15:09:42.422852+0000","last_active":"2020-02-12T15:09:42.743611+0000","last_peered":"2020-02-12T15:09:42.743611+0000","last_clean":"2020-02-12T15:09:42.743611+0000","last_became_active":"2020-02-12T15:09:42.421613+0000","last_became_peered":"2020-02-12T15:09:42.421613+0000","last_unstale":"2020-02-12T15:09:42.743611+0000","last_undegraded":"2020-02-12T15:09:42.743611+0000","last_fullsized":"2020-02-12T15:09:42.743611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.743094+0000","last_change":"2020-02-12T15:09:36.336314+0000","last_active":"2020-02-12T15:09:42.743094+0000","last_peered":"2020-02-12T15:09:42.743094+0000","last_clean":"2020-02-12T15:09:42.743094+0000","last_became_active":"2020-02-12T15:09:36.335550+0000","last_became_peered":"2020-02-12T15:09:36.335550+0000","last_unstale":"2020-02-12T15:09:42.743094+0000","last_undegraded":"2020-02-12T15:09:42.743094+0000","last_fullsized":"2020-02-12T15:09:42.743094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.447565+0000","last_change":"2020-02-12T15:09:39.407166+0000","last_active":"2020-02-12T15:09:45.447565+0000","last_peered":"2020-02-12T15:09:45.447565+0000","last_clean":"2020-02-12T15:09:45.447565+0000","last_became_active":"2020-02-12T15:09:39.406783+0000","last_became_peered":"2020-02-12T15:09:39.406783+0000","last_unstale":"2020-02-12T15:09:45.447565+0000","last_undegraded":"2020-02-12T15:09:45.447565+0000","last_fullsized":"2020-02-12T15:09:45.447565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886040+0000","last_change":"2020-02-12T15:09:42.720288+0000","last_active":"2020-02-12T15:09:42.886040+0000","last_peered":"2020-02-12T15:09:42.886040+0000","last_clean":"2020-02-12T15:09:42.886040+0000","last_became_active":"2020-02-12T15:09:42.719736+0000","last_became_peered":"2020-02-12T15:09:42.719736+0000","last_unstale":"2020-02-12T15:09:42.886040+0000","last_undegraded":"2020-02-12T15:09:42.886040+0000","last_fullsized":"2020-02-12T15:09:42.886040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886321+0000","last_change":"2020-02-12T15:09:36.335902+0000","last_active":"2020-02-12T15:09:42.886321+0000","last_peered":"2020-02-12T15:09:42.886321+0000","last_clean":"2020-02-12T15:09:42.886321+0000","last_became_active":"2020-02-12T15:09:36.335528+0000","last_became_peered":"2020-02-12T15:09:36.335528+0000","last_unstale":"2020-02-12T15:09:42.886321+0000","last_undegraded":"2020-02-12T15:09:42.886321+0000","last_fullsized":"2020-02-12T15:09:42.886321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886111+0000","last_change":"2020-02-12T15:09:39.408932+0000","last_active":"2020-02-12T15:09:42.886111+0000","last_peered":"2020-02-12T15:09:42.886111+0000","last_clean":"2020-02-12T15:09:42.886111+0000","last_became_active":"2020-02-12T15:09:39.408578+0000","last_became_peered":"2020-02-12T15:09:39.408578+0000","last_unstale":"2020-02-12T15:09:42.886111+0000","last_undegraded":"2020-02-12T15:09:42.886111+0000","last_fullsized":"2020-02-12T15:09:42.886111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.853153+0000","last_change":"2020-02-12T15:09:42.852785+0000","last_active":"2020-02-12T15:09:42.853153+0000","last_peered":"2020-02-12T15:09:42.853153+0000","last_clean":"2020-02-12T15:09:42.853153+0000","last_became_active":"2020-02-12T15:09:42.852128+0000","last_became_peered":"2020-02-12T15:09:42.852128+0000","last_unstale":"2020-02-12T15:09:42.853153+0000","last_undegraded":"2020-02-12T15:09:42.853153+0000","last_fullsized":"2020-02-12T15:09:42.853153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.851321+0000","last_change":"2020-02-12T15:09:36.693006+0000","last_active":"2020-02-12T15:09:42.851321+0000","last_peered":"2020-02-12T15:09:42.851321+0000","last_clean":"2020-02-12T15:09:42.851321+0000","last_became_active":"2020-02-12T15:09:36.692653+0000","last_became_peered":"2020-02-12T15:09:36.692653+0000","last_unstale":"2020-02-12T15:09:42.851321+0000","last_undegraded":"2020-02-12T15:09:42.851321+0000","last_fullsized":"2020-02-12T15:09:42.851321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"24'5","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.445348+0000","last_change":"2020-02-12T15:09:39.900061+0000","last_active":"2020-02-12T15:09:45.445348+0000","last_peered":"2020-02-12T15:09:45.445348+0000","last_clean":"2020-02-12T15:09:45.445348+0000","last_became_active":"2020-02-12T15:09:39.899720+0000","last_became_peered":"2020-02-12T15:09:39.899720+0000","last_unstale":"2020-02-12T15:09:45.445348+0000","last_undegraded":"2020-02-12T15:09:45.445348+0000","last_fullsized":"2020-02-12T15:09:45.445348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.885871+0000","last_change":"2020-02-12T15:09:42.720387+0000","last_active":"2020-02-12T15:09:42.885871+0000","last_peered":"2020-02-12T15:09:42.885871+0000","last_clean":"2020-02-12T15:09:42.885871+0000","last_became_active":"2020-02-12T15:09:42.719898+0000","last_became_peered":"2020-02-12T15:09:42.719898+0000","last_unstale":"2020-02-12T15:09:42.885871+0000","last_undegraded":"2020-02-12T15:09:42.885871+0000","last_fullsized":"2020-02-12T15:09:42.885871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.740860+0000","last_change":"2020-02-12T15:09:36.336538+0000","last_active":"2020-02-12T15:09:42.740860+0000","last_peered":"2020-02-12T15:09:42.740860+0000","last_clean":"2020-02-12T15:09:42.740860+0000","last_became_active":"2020-02-12T15:09:36.336212+0000","last_became_peered":"2020-02-12T15:09:36.336212+0000","last_unstale":"2020-02-12T15:09:42.740860+0000","last_undegraded":"2020-02-12T15:09:42.740860+0000","last_fullsized":"2020-02-12T15:09:42.740860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:43.742040+0000","last_change":"2020-02-12T15:09:39.408454+0000","last_active":"2020-02-12T15:09:43.742040+0000","last_peered":"2020-02-12T15:09:43.742040+0000","last_clean":"2020-02-12T15:09:43.742040+0000","last_became_active":"2020-02-12T15:09:39.408106+0000","last_became_peered":"2020-02-12T15:09:39.408106+0000","last_unstale":"2020-02-12T15:09:43.742040+0000","last_undegraded":"2020-02-12T15:09:43.742040+0000","last_fullsized":"2020-02-12T15:09:43.742040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.743312+0000","last_change":"2020-02-12T15:09:42.422176+0000","last_active":"2020-02-12T15:09:42.743312+0000","last_peered":"2020-02-12T15:09:42.743312+0000","last_clean":"2020-02-12T15:09:42.743312+0000","last_became_active":"2020-02-12T15:09:42.421592+0000","last_became_peered":"2020-02-12T15:09:42.421592+0000","last_unstale":"2020-02-12T15:09:42.743312+0000","last_undegraded":"2020-02-12T15:09:42.743312+0000","last_fullsized":"2020-02-12T15:09:42.743312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.740733+0000","last_change":"2020-02-12T15:09:36.336287+0000","last_active":"2020-02-12T15:09:42.740733+0000","last_peered":"2020-02-12T15:09:42.740733+0000","last_clean":"2020-02-12T15:09:42.740733+0000","last_became_active":"2020-02-12T15:09:36.335926+0000","last_became_peered":"2020-02-12T15:09:36.335926+0000","last_unstale":"2020-02-12T15:09:42.740733+0000","last_undegraded":"2020-02-12T15:09:42.740733+0000","last_fullsized":"2020-02-12T15:09:42.740733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"24'6","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.447226+0000","last_change":"2020-02-12T15:09:39.406765+0000","last_active":"2020-02-12T15:09:45.447226+0000","last_peered":"2020-02-12T15:09:45.447226+0000","last_clean":"2020-02-12T15:09:45.447226+0000","last_became_active":"2020-02-12T15:09:39.406382+0000","last_became_peered":"2020-02-12T15:09:39.406382+0000","last_unstale":"2020-02-12T15:09:45.447226+0000","last_undegraded":"2020-02-12T15:09:45.447226+0000","last_fullsized":"2020-02-12T15:09:45.447226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886824+0000","last_change":"2020-02-12T15:09:42.421410+0000","last_active":"2020-02-12T15:09:42.886824+0000","last_peered":"2020-02-12T15:09:42.886824+0000","last_clean":"2020-02-12T15:09:42.886824+0000","last_became_active":"2020-02-12T15:09:42.420940+0000","last_became_peered":"2020-02-12T15:09:42.420940+0000","last_unstale":"2020-02-12T15:09:42.886824+0000","last_undegraded":"2020-02-12T15:09:42.886824+0000","last_fullsized":"2020-02-12T15:09:42.886824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.851605+0000","last_change":"2020-02-12T15:09:36.334733+0000","last_active":"2020-02-12T15:09:42.851605+0000","last_peered":"2020-02-12T15:09:42.851605+0000","last_clean":"2020-02-12T15:09:42.851605+0000","last_became_active":"2020-02-12T15:09:36.334342+0000","last_became_peered":"2020-02-12T15:09:36.334342+0000","last_unstale":"2020-02-12T15:09:42.851605+0000","last_undegraded":"2020-02-12T15:09:42.851605+0000","last_fullsized":"2020-02-12T15:09:42.851605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.446719+0000","last_change":"2020-02-12T15:09:39.407536+0000","last_active":"2020-02-12T15:09:45.446719+0000","last_peered":"2020-02-12T15:09:45.446719+0000","last_clean":"2020-02-12T15:09:45.446719+0000","last_became_active":"2020-02-12T15:09:39.407191+0000","last_became_peered":"2020-02-12T15:09:39.407191+0000","last_unstale":"2020-02-12T15:09:45.446719+0000","last_undegraded":"2020-02-12T15:09:45.446719+0000","last_fullsized":"2020-02-12T15:09:45.446719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":97478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":96518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":95986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":96712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":96112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":97478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-12T15:09:51.731 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early pg dump --format=json 2020-02-12T15:09:51.844 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc45517700 1 Processor -- start 2020-02-12T15:09:51.845 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc45517700 1 -- start start 2020-02-12T15:09:51.845 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc45517700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 0x7fbc4013c970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.845 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc45517700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fbc4013cdd0 0x7fbc4013f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.845 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc45517700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc400a3b30 con 0x7fbc400a5bc0 2020-02-12T15:09:51.845 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc45517700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc400a23b0 con 0x7fbc4013cdd0 2020-02-12T15:09:51.845 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc45517700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400a2650 con 0x7fbc400a5fa0 2020-02-12T15:09:51.853 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc3ffff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fbc400a5bc0 0x7fbc400a1460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42778/0 (socket says 172.21.15.180:42778) 2020-02-12T15:09:51.853 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc3ffff700 1 -- 172.21.15.180:0/2504290383 learned_addr learned my addr 172.21.15.180:0/2504290383 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:51.853 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 0x7fbc4013c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.854 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.834+0000 7fbc44d16700 1 --2- 172.21.15.180:0/2504290383 >> v2:172.21.15.105:3300/0 conn(0x7fbc4013cdd0 0x7fbc4013f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.854 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3258536595 0 0) 0x7fbc400a3b30 con 0x7fbc400a5bc0 2020-02-12T15:09:51.854 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc2c003230 con 0x7fbc400a5bc0 2020-02-12T15:09:51.854 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 315755506 0 0) 0x7fbc2c003230 con 0x7fbc400a5bc0 2020-02-12T15:09:51.854 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 msgr2=0x7fbc4013c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.854 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 0x7fbc4013c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 >> v2:172.21.15.105:3300/0 conn(0x7fbc4013cdd0 msgr2=0x7fbc4013f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 --2- 172.21.15.180:0/2504290383 >> v2:172.21.15.105:3300/0 conn(0x7fbc4013cdd0 0x7fbc4013f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc400a1b70 con 0x7fbc400a5bc0 2020-02-12T15:09:51.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7fbc300016d0 con 0x7fbc400a5bc0 2020-02-12T15:09:51.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 >> v1:172.21.15.180:6789/0 conn(0x7fbc400a5bc0 legacy=0x7fbc400a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 0x7fbc2c0044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2c004930 0x7fbc2c004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:51.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400a23b0 con 0x7fbc2c004930 2020-02-12T15:09:51.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc400a2650 con 0x7fbc2c003720 2020-02-12T15:09:51.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc2c005380 con 0x7fbc400a5fa0 2020-02-12T15:09:51.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc44d16700 1 --2- 172.21.15.180:0/2504290383 >> v2:172.21.15.105:3300/0 conn(0x7fbc4013cdd0 0x7fbc4013f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:51.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 0x7fbc2c0044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.857 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc44d16700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2c004930 0x7fbc2c004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.857 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 -- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 msgr2=0x7fbc2c0044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.857 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc400a5fa0 0x7fbc2c0044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.857 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 -- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2c004930 msgr2=0x7fbc2c004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:51.857 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7fbc2c004930 0x7fbc2c004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:51.857 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 -- 172.21.15.180:0/2504290383 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc2c003230 con 0x7fbc2c003720 2020-02-12T15:09:51.857 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fbc300013e0 tx=0x7fbc400a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.858 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fbc300013e0 tx=0x7fbc400a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.859 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.835+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fbc300013e0 tx=0x7fbc400a1d00).ready entity=mon.1 client_cookie=de32784e0e2a669a server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.860 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fbc300013e0 tx=0x7fbc400a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.860 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc3000ce80 con 0x7fbc2c003720 2020-02-12T15:09:51.860 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fbc300013e0 tx=0x7fbc400a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.860 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 secure :-1 s=THROTTLE_DONE pgs=171 cs=0 l=1 rx=0x7fbc300013e0 tx=0x7fbc400a1d00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.860 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3000e350 con 0x7fbc2c003720 2020-02-12T15:09:51.860 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc45517700 1 -- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 msgr2=0x7fbc2c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc3effd700 1 -- 172.21.15.180:0/2504290383 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc300100b0 con 0x7fbc2c003720 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc45517700 1 --2- 172.21.15.180:0/2504290383 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fbc2c003720 0x7fbc2c003b40 secure :-1 s=READY pgs=171 cs=0 l=1 rx=0x7fbc300013e0 tx=0x7fbc400a1d00).stop 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc44d16700 1 -- 172.21.15.180:0/2504290383 reap_dead start 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc45517700 1 -- 172.21.15.180:0/2504290383 shutdown_connections 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc45517700 1 -- 172.21.15.180:0/2504290383 >> 172.21.15.180:0/2504290383 conn(0x7fbc4005a530 msgr2=0x7fbc4005a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc45517700 1 -- 172.21.15.180:0/2504290383 shutdown_connections 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.836+0000 7fbc45517700 1 -- 172.21.15.180:0/2504290383 wait complete. 2020-02-12T15:09:51.861 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.837+0000 7fbc45517700 1 Processor -- start 2020-02-12T15:09:51.862 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.837+0000 7fbc45517700 1 -- start start 2020-02-12T15:09:51.863 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc45517700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.863 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc45517700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4009bc90 con 0x7fbc4009f4c0 2020-02-12T15:09:51.863 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc45517700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc4009bf30 con 0x7fbc4009cd90 2020-02-12T15:09:51.863 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc45517700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4009fb80 con 0x7fbc4009a280 2020-02-12T15:09:51.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc44d16700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fbc4009cd90 0x7fbc40134420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42792/0 (socket says 172.21.15.180:42792) 2020-02-12T15:09:51.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc44d16700 1 -- 172.21.15.180:0/2540486531 learned_addr learned my addr 172.21.15.180:0/2540486531 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:51.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 783866665 0 0) 0x7fbc4009bf30 con 0x7fbc4009cd90 2020-02-12T15:09:51.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc20002fe0 con 0x7fbc4009cd90 2020-02-12T15:09:51.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3885650297 0 0) 0x7fbc4009bc90 con 0x7fbc4009f4c0 2020-02-12T15:09:51.864 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 --> v1:172.21.15.105:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc4009bf30 con 0x7fbc4009f4c0 2020-02-12T15:09:51.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3442974585 0 0) 0x7fbc20002fe0 con 0x7fbc4009cd90 2020-02-12T15:09:51.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 -- 172.21.15.180:0/2540486531 >> v1:172.21.15.180:6789/0 conn(0x7fbc4009cd90 legacy=0x7fbc40134420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 -- 172.21.15.180:0/2540486531 >> v1:172.21.15.105:6789/0 conn(0x7fbc4009f4c0 legacy=0x7fbc4009c680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 -- 172.21.15.180:0/2540486531 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc4009fcc0 con 0x7fbc4009a280 2020-02-12T15:09:51.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.865 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.866 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.866 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.838+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc38001810 con 0x7fbc4009a280 2020-02-12T15:09:51.866 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.866 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.866 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34005ca0 con 0x7fbc4009a280 2020-02-12T15:09:51.866 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc34007160 con 0x7fbc4009a280 2020-02-12T15:09:51.866 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4009b8a0 con 0x7fbc4009a280 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc40134cf0 con 0x7fbc4009a280 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fbc34007390 con 0x7fbc4009a280 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.839+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.840+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc400565b0 con 0x7fbc4009a280 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.840+0000 7fbc3d7fa700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbc2003a0b0 0x7fbc2003c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.840+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fbc34049120 con 0x7fbc4009a280 2020-02-12T15:09:51.867 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.840+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbc2003a0b0 0x7fbc2003c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:51.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.840+0000 7fbc3ffff700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbc2003a0b0 0x7fbc2003c570 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:51.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.843+0000 7fbc3f7fe700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=THROTTLE_DONE pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:51.868 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.843+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fbc3402e7b0 con 0x7fbc4009a280 2020-02-12T15:09:51.978 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.975+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 --> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc4009c3e0 con 0x7fbc2003a0b0 2020-02-12T15:09:51.980 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.978+0000 7fbc3d7fa700 1 -- 172.21.15.180:0/2540486531 <== mgr.4101 v2:172.21.15.105:6800/21618 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+66349 (crc 0 0 0) 0x7fbc30001210 con 0x7fbc2003a0b0 2020-02-12T15:09:51.981 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:51.983 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbc2003a0b0 msgr2=0x7fbc2003c570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.983 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbc2003a0b0 0x7fbc2003c570 crc :-1 s=READY pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.983 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 msgr2=0x7fbc40133fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:51.983 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 secure :-1 s=READY pgs=39 cs=0 l=1 rx=0x7fbc38001970 tx=0x7fbc3400c420).stop 2020-02-12T15:09:51.983 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 shutdown_connections 2020-02-12T15:09:51.983 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fbc2003a0b0 0x7fbc2003c570 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.984 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 --2- 172.21.15.180:0/2540486531 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fbc4009a280 0x7fbc40133fc0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:51.984 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 >> 172.21.15.180:0/2540486531 conn(0x7fbc4005a530 msgr2=0x7fbc400aa9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:51.984 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 shutdown_connections 2020-02-12T15:09:51.984 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:51.980+0000 7fbc45517700 1 -- 172.21.15.180:0/2540486531 wait complete. 2020-02-12T15:09:51.984 INFO:teuthology.orchestra.run.smithi180.stderr:dumped all 2020-02-12T15:09:51.993 INFO:teuthology.orchestra.run.smithi180.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2020-02-12T15:09:50.446906+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":64,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":8390720,"kb_used_data":2048,"kb_used_omap":0,"kb_used_meta":8388608,"kb_avail":746584000,"statfs":{"total":773094113280,"available":764502016000,"internally_reserved":8589934592,"allocated":2097152,"data_stored":772188,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8589934592},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":760,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000873"},"pg_stats":[{"pgid":"3.7","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.853146+0000","last_change":"2020-02-12T15:09:42.852799+0000","last_active":"2020-02-12T15:09:42.853146+0000","last_peered":"2020-02-12T15:09:42.853146+0000","last_clean":"2020-02-12T15:09:42.853146+0000","last_became_active":"2020-02-12T15:09:42.852180+0000","last_became_peered":"2020-02-12T15:09:42.852180+0000","last_unstale":"2020-02-12T15:09:42.853146+0000","last_undegraded":"2020-02-12T15:09:42.853146+0000","last_fullsized":"2020-02-12T15:09:42.853146+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,7],"acting":[4,6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886890+0000","last_change":"2020-02-12T15:09:36.334621+0000","last_active":"2020-02-12T15:09:42.886890+0000","last_peered":"2020-02-12T15:09:42.886890+0000","last_clean":"2020-02-12T15:09:42.886890+0000","last_became_active":"2020-02-12T15:09:36.334249+0000","last_became_peered":"2020-02-12T15:09:36.334249+0000","last_unstale":"2020-02-12T15:09:42.886890+0000","last_undegraded":"2020-02-12T15:09:42.886890+0000","last_fullsized":"2020-02-12T15:09:42.886890+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"24'3","reported_seq":"16","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.445569+0000","last_change":"2020-02-12T15:09:39.406773+0000","last_active":"2020-02-12T15:09:45.445569+0000","last_peered":"2020-02-12T15:09:45.445569+0000","last_clean":"2020-02-12T15:09:45.445569+0000","last_became_active":"2020-02-12T15:09:39.406402+0000","last_became_peered":"2020-02-12T15:09:39.406402+0000","last_unstale":"2020-02-12T15:09:45.445569+0000","last_undegraded":"2020-02-12T15:09:45.445569+0000","last_fullsized":"2020-02-12T15:09:45.445569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.853085+0000","last_change":"2020-02-12T15:09:42.852657+0000","last_active":"2020-02-12T15:09:42.853085+0000","last_peered":"2020-02-12T15:09:42.853085+0000","last_clean":"2020-02-12T15:09:42.853085+0000","last_became_active":"2020-02-12T15:09:42.851995+0000","last_became_peered":"2020-02-12T15:09:42.851995+0000","last_unstale":"2020-02-12T15:09:42.853085+0000","last_undegraded":"2020-02-12T15:09:42.853085+0000","last_fullsized":"2020-02-12T15:09:42.853085+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1,0],"acting":[4,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886075+0000","last_change":"2020-02-12T15:09:36.336526+0000","last_active":"2020-02-12T15:09:42.886075+0000","last_peered":"2020-02-12T15:09:42.886075+0000","last_clean":"2020-02-12T15:09:42.886075+0000","last_became_active":"2020-02-12T15:09:36.336182+0000","last_became_peered":"2020-02-12T15:09:36.336182+0000","last_unstale":"2020-02-12T15:09:42.886075+0000","last_undegraded":"2020-02-12T15:09:42.886075+0000","last_fullsized":"2020-02-12T15:09:42.886075+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"24'7","reported_seq":"20","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.448302+0000","last_change":"2020-02-12T15:09:39.406617+0000","last_active":"2020-02-12T15:09:45.448302+0000","last_peered":"2020-02-12T15:09:45.448302+0000","last_clean":"2020-02-12T15:09:45.448302+0000","last_became_active":"2020-02-12T15:09:39.406253+0000","last_became_peered":"2020-02-12T15:09:39.406253+0000","last_unstale":"2020-02-12T15:09:45.448302+0000","last_undegraded":"2020-02-12T15:09:45.448302+0000","last_fullsized":"2020-02-12T15:09:45.448302+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":566,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.743611+0000","last_change":"2020-02-12T15:09:42.422852+0000","last_active":"2020-02-12T15:09:42.743611+0000","last_peered":"2020-02-12T15:09:42.743611+0000","last_clean":"2020-02-12T15:09:42.743611+0000","last_became_active":"2020-02-12T15:09:42.421613+0000","last_became_peered":"2020-02-12T15:09:42.421613+0000","last_unstale":"2020-02-12T15:09:42.743611+0000","last_undegraded":"2020-02-12T15:09:42.743611+0000","last_fullsized":"2020-02-12T15:09:42.743611+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.743094+0000","last_change":"2020-02-12T15:09:36.336314+0000","last_active":"2020-02-12T15:09:42.743094+0000","last_peered":"2020-02-12T15:09:42.743094+0000","last_clean":"2020-02-12T15:09:42.743094+0000","last_became_active":"2020-02-12T15:09:36.335550+0000","last_became_peered":"2020-02-12T15:09:36.335550+0000","last_unstale":"2020-02-12T15:09:42.743094+0000","last_undegraded":"2020-02-12T15:09:42.743094+0000","last_fullsized":"2020-02-12T15:09:42.743094+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.447565+0000","last_change":"2020-02-12T15:09:39.407166+0000","last_active":"2020-02-12T15:09:45.447565+0000","last_peered":"2020-02-12T15:09:45.447565+0000","last_clean":"2020-02-12T15:09:45.447565+0000","last_became_active":"2020-02-12T15:09:39.406783+0000","last_became_peered":"2020-02-12T15:09:39.406783+0000","last_unstale":"2020-02-12T15:09:45.447565+0000","last_undegraded":"2020-02-12T15:09:45.447565+0000","last_fullsized":"2020-02-12T15:09:45.447565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886040+0000","last_change":"2020-02-12T15:09:42.720288+0000","last_active":"2020-02-12T15:09:42.886040+0000","last_peered":"2020-02-12T15:09:42.886040+0000","last_clean":"2020-02-12T15:09:42.886040+0000","last_became_active":"2020-02-12T15:09:42.719736+0000","last_became_peered":"2020-02-12T15:09:42.719736+0000","last_unstale":"2020-02-12T15:09:42.886040+0000","last_undegraded":"2020-02-12T15:09:42.886040+0000","last_fullsized":"2020-02-12T15:09:42.886040+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"15","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886321+0000","last_change":"2020-02-12T15:09:36.335902+0000","last_active":"2020-02-12T15:09:42.886321+0000","last_peered":"2020-02-12T15:09:42.886321+0000","last_clean":"2020-02-12T15:09:42.886321+0000","last_became_active":"2020-02-12T15:09:36.335528+0000","last_became_peered":"2020-02-12T15:09:36.335528+0000","last_unstale":"2020-02-12T15:09:42.886321+0000","last_undegraded":"2020-02-12T15:09:42.886321+0000","last_fullsized":"2020-02-12T15:09:42.886321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"13","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886111+0000","last_change":"2020-02-12T15:09:39.408932+0000","last_active":"2020-02-12T15:09:42.886111+0000","last_peered":"2020-02-12T15:09:42.886111+0000","last_clean":"2020-02-12T15:09:42.886111+0000","last_became_active":"2020-02-12T15:09:39.408578+0000","last_became_peered":"2020-02-12T15:09:39.408578+0000","last_unstale":"2020-02-12T15:09:42.886111+0000","last_undegraded":"2020-02-12T15:09:42.886111+0000","last_fullsized":"2020-02-12T15:09:42.886111+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.853153+0000","last_change":"2020-02-12T15:09:42.852785+0000","last_active":"2020-02-12T15:09:42.853153+0000","last_peered":"2020-02-12T15:09:42.853153+0000","last_clean":"2020-02-12T15:09:42.853153+0000","last_became_active":"2020-02-12T15:09:42.852128+0000","last_became_peered":"2020-02-12T15:09:42.852128+0000","last_unstale":"2020-02-12T15:09:42.853153+0000","last_undegraded":"2020-02-12T15:09:42.853153+0000","last_fullsized":"2020-02-12T15:09:42.853153+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0,1],"acting":[4,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.851321+0000","last_change":"2020-02-12T15:09:36.693006+0000","last_active":"2020-02-12T15:09:42.851321+0000","last_peered":"2020-02-12T15:09:42.851321+0000","last_clean":"2020-02-12T15:09:42.851321+0000","last_became_active":"2020-02-12T15:09:36.692653+0000","last_became_peered":"2020-02-12T15:09:36.692653+0000","last_unstale":"2020-02-12T15:09:42.851321+0000","last_undegraded":"2020-02-12T15:09:42.851321+0000","last_fullsized":"2020-02-12T15:09:42.851321+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"24'5","reported_seq":"18","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.445348+0000","last_change":"2020-02-12T15:09:39.900061+0000","last_active":"2020-02-12T15:09:45.445348+0000","last_peered":"2020-02-12T15:09:45.445348+0000","last_clean":"2020-02-12T15:09:45.445348+0000","last_became_active":"2020-02-12T15:09:39.899720+0000","last_became_peered":"2020-02-12T15:09:39.899720+0000","last_unstale":"2020-02-12T15:09:45.445348+0000","last_undegraded":"2020-02-12T15:09:45.445348+0000","last_fullsized":"2020-02-12T15:09:45.445348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.885871+0000","last_change":"2020-02-12T15:09:42.720387+0000","last_active":"2020-02-12T15:09:42.885871+0000","last_peered":"2020-02-12T15:09:42.885871+0000","last_clean":"2020-02-12T15:09:42.885871+0000","last_became_active":"2020-02-12T15:09:42.719898+0000","last_became_peered":"2020-02-12T15:09:42.719898+0000","last_unstale":"2020-02-12T15:09:42.885871+0000","last_undegraded":"2020-02-12T15:09:42.885871+0000","last_fullsized":"2020-02-12T15:09:42.885871+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[0,2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.740860+0000","last_change":"2020-02-12T15:09:36.336538+0000","last_active":"2020-02-12T15:09:42.740860+0000","last_peered":"2020-02-12T15:09:42.740860+0000","last_clean":"2020-02-12T15:09:42.740860+0000","last_became_active":"2020-02-12T15:09:36.336212+0000","last_became_peered":"2020-02-12T15:09:36.336212+0000","last_unstale":"2020-02-12T15:09:42.740860+0000","last_undegraded":"2020-02-12T15:09:42.740860+0000","last_fullsized":"2020-02-12T15:09:42.740860+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"24'1","reported_seq":"14","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:43.742040+0000","last_change":"2020-02-12T15:09:39.408454+0000","last_active":"2020-02-12T15:09:43.742040+0000","last_peered":"2020-02-12T15:09:43.742040+0000","last_clean":"2020-02-12T15:09:43.742040+0000","last_became_active":"2020-02-12T15:09:39.408106+0000","last_became_peered":"2020-02-12T15:09:39.408106+0000","last_unstale":"2020-02-12T15:09:43.742040+0000","last_undegraded":"2020-02-12T15:09:43.742040+0000","last_fullsized":"2020-02-12T15:09:43.742040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.743312+0000","last_change":"2020-02-12T15:09:42.422176+0000","last_active":"2020-02-12T15:09:42.743312+0000","last_peered":"2020-02-12T15:09:42.743312+0000","last_clean":"2020-02-12T15:09:42.743312+0000","last_became_active":"2020-02-12T15:09:42.421592+0000","last_became_peered":"2020-02-12T15:09:42.421592+0000","last_unstale":"2020-02-12T15:09:42.743312+0000","last_undegraded":"2020-02-12T15:09:42.743312+0000","last_fullsized":"2020-02-12T15:09:42.743312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4,2],"acting":[6,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"16","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.740733+0000","last_change":"2020-02-12T15:09:36.336287+0000","last_active":"2020-02-12T15:09:42.740733+0000","last_peered":"2020-02-12T15:09:42.740733+0000","last_clean":"2020-02-12T15:09:42.740733+0000","last_became_active":"2020-02-12T15:09:36.335926+0000","last_became_peered":"2020-02-12T15:09:36.335926+0000","last_unstale":"2020-02-12T15:09:42.740733+0000","last_undegraded":"2020-02-12T15:09:42.740733+0000","last_fullsized":"2020-02-12T15:09:42.740733+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"24'6","reported_seq":"19","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.447226+0000","last_change":"2020-02-12T15:09:39.406765+0000","last_active":"2020-02-12T15:09:45.447226+0000","last_peered":"2020-02-12T15:09:45.447226+0000","last_clean":"2020-02-12T15:09:45.447226+0000","last_became_active":"2020-02-12T15:09:39.406382+0000","last_became_peered":"2020-02-12T15:09:39.406382+0000","last_unstale":"2020-02-12T15:09:45.447226+0000","last_undegraded":"2020-02-12T15:09:45.447226+0000","last_fullsized":"2020-02-12T15:09:45.447226+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":"12","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.886824+0000","last_change":"2020-02-12T15:09:42.421410+0000","last_active":"2020-02-12T15:09:42.886824+0000","last_peered":"2020-02-12T15:09:42.886824+0000","last_clean":"2020-02-12T15:09:42.886824+0000","last_became_active":"2020-02-12T15:09:42.420940+0000","last_became_peered":"2020-02-12T15:09:42.420940+0000","last_unstale":"2020-02-12T15:09:42.886824+0000","last_undegraded":"2020-02-12T15:09:42.886824+0000","last_fullsized":"2020-02-12T15:09:42.886824+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:41.408949+0000","last_clean_scrub_stamp":"2020-02-12T15:09:41.408949+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4,3],"acting":[2,6,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"14","reported_epoch":"23","state":"active+clean","last_fresh":"2020-02-12T15:09:42.851605+0000","last_change":"2020-02-12T15:09:36.334733+0000","last_active":"2020-02-12T15:09:42.851605+0000","last_peered":"2020-02-12T15:09:42.851605+0000","last_clean":"2020-02-12T15:09:42.851605+0000","last_became_active":"2020-02-12T15:09:36.334342+0000","last_became_peered":"2020-02-12T15:09:36.334342+0000","last_unstale":"2020-02-12T15:09:42.851605+0000","last_undegraded":"2020-02-12T15:09:42.851605+0000","last_fullsized":"2020-02-12T15:09:42.851605+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:35.324312+0000","last_clean_scrub_stamp":"2020-02-12T15:09:35.324312+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"24'8","reported_seq":"21","reported_epoch":"24","state":"active+clean","last_fresh":"2020-02-12T15:09:45.446719+0000","last_change":"2020-02-12T15:09:39.407536+0000","last_active":"2020-02-12T15:09:45.446719+0000","last_peered":"2020-02-12T15:09:45.446719+0000","last_clean":"2020-02-12T15:09:45.446719+0000","last_became_active":"2020-02-12T15:09:39.407191+0000","last_became_peered":"2020-02-12T15:09:39.407191+0000","last_unstale":"2020-02-12T15:09:45.446719+0000","last_undegraded":"2020-02-12T15:09:45.446719+0000","last_fullsized":"2020-02-12T15:09:45.446719+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-02-12T15:09:38.388881+0000","last_clean_scrub_stamp":"2020-02-12T15:09:38.388881+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1526,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":32,"acting":32,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":2286,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":97478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048832,"kb_used_data":248,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323008,"statfs":{"total":96636764160,"available":95562760192,"internally_reserved":1073741824,"allocated":253952,"data_stored":95952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":96518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048836,"kb_used_data":252,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323004,"statfs":{"total":96636764160,"available":95562756096,"internally_reserved":1073741824,"allocated":258048,"data_stored":95986,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048852,"kb_used_data":268,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322988,"statfs":{"total":96636764160,"available":95562739712,"internally_reserved":1073741824,"allocated":274432,"data_stored":96712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048840,"kb_used_data":256,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323000,"statfs":{"total":96636764160,"available":95562752000,"internally_reserved":1073741824,"allocated":262144,"data_stored":96112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048844,"kb_used_data":260,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93322996,"statfs":{"total":96636764160,"available":95562747904,"internally_reserved":1073741824,"allocated":266240,"data_stored":97478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}]}} 2020-02-12T15:09:51.995 INFO:tasks.ceph.ceph_manager.ceph:clean! 2020-02-12T15:09:51.995 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2020-02-12T15:09:51.996 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2020-02-12T15:09:51.996 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early health --format=json 2020-02-12T15:09:52.101 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.098+0000 7f3a7fed5700 1 Processor -- start 2020-02-12T15:09:52.101 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.098+0000 7f3a7fed5700 1 -- start start 2020-02-12T15:09:52.112 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7fed5700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f3a781380f0 0x7f3a780a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.113 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7fed5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.113 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7fed5700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a780aaff0 con 0x7f3a780a1c20 2020-02-12T15:09:52.113 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7fed5700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a7805fe60 con 0x7f3a781380f0 2020-02-12T15:09:52.114 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7fed5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a780aaab0 con 0x7f3a780a7030 2020-02-12T15:09:52.114 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7d470700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f3a781380f0 0x7f3a780a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.114 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7dc71700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f3a780a1c20 0x7f3a780a2130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42796/0 (socket says 172.21.15.180:42796) 2020-02-12T15:09:52.115 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7dc71700 1 -- 172.21.15.180:0/1275386263 learned_addr learned my addr 172.21.15.180:0/1275386263 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:52.115 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.099+0000 7f3a7e472700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.116 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 -- 172.21.15.180:0/1275386263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 msgr2=0x7f3a780a74b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:52.116 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a74b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.116 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 -- 172.21.15.180:0/1275386263 >> v1:172.21.15.180:6789/0 conn(0x7f3a780a1c20 legacy=0x7f3a780a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.116 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 -- 172.21.15.180:0/1275386263 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780aad50 con 0x7f3a781380f0 2020-02-12T15:09:52.117 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7cc6f700 1 -- 172.21.15.180:0/1275386263 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2503491717 0 0) 0x7f3a780aaff0 con 0x7f3a780a1c20 2020-02-12T15:09:52.117 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 --2- 172.21.15.180:0/1275386263 >> v2:172.21.15.180:3300/0 conn(0x7f3a781380f0 0x7f3a780a3d10 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f3a6c002f30 tx=0x7f3a6c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.118 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 --2- 172.21.15.180:0/1275386263 >> v2:172.21.15.180:3300/0 conn(0x7f3a781380f0 0x7f3a780a3d10 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f3a6c002f30 tx=0x7f3a6c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.118 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f3a781380f0 0x7f3a780a3d10 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a6c0088e0).ready entity=mon.1 client_cookie=1d7d9a0c4c234d04 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.118 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f3a781380f0 0x7f3a780a3d10 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a6c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.118 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7cc6f700 1 -- 172.21.15.180:0/1275386263 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c008e40 con 0x7f3a781380f0 2020-02-12T15:09:52.119 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f3a781380f0 0x7f3a780a3d10 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a6c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.119 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7d470700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f3a781380f0 0x7f3a780a3d10 secure :-1 s=THROTTLE_DONE pgs=174 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a6c0088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.119 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7cc6f700 1 -- 172.21.15.180:0/1275386263 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c0115f0 con 0x7f3a781380f0 2020-02-12T15:09:52.119 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7cc6f700 1 -- 172.21.15.180:0/1275386263 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c011990 con 0x7f3a781380f0 2020-02-12T15:09:52.120 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 -- 172.21.15.180:0/1275386263 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f3a781380f0 msgr2=0x7f3a780a3d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.120 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f3a781380f0 0x7f3a780a3d10 secure :-1 s=READY pgs=174 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a6c0088e0).stop 2020-02-12T15:09:52.120 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 -- 172.21.15.180:0/1275386263 shutdown_connections 2020-02-12T15:09:52.120 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a74b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.121 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/1275386263 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f3a781380f0 0x7f3a780a3d10 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.121 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 -- 172.21.15.180:0/1275386263 >> 172.21.15.180:0/1275386263 conn(0x7f3a7809d450 msgr2=0x7f3a7809d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:52.121 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 -- 172.21.15.180:0/1275386263 shutdown_connections 2020-02-12T15:09:52.121 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.100+0000 7f3a7fed5700 1 -- 172.21.15.180:0/1275386263 wait complete. 2020-02-12T15:09:52.122 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.101+0000 7f3a7fed5700 1 Processor -- start 2020-02-12T15:09:52.122 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.101+0000 7f3a7fed5700 1 -- start start 2020-02-12T15:09:52.122 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7fed5700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.122 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7fed5700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a781380f0 0x7f3a78126710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.123 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7fed5700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a78129b30 con 0x7f3a780a1c20 2020-02-12T15:09:52.123 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7fed5700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a780a5220 con 0x7f3a781380f0 2020-02-12T15:09:52.123 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7fed5700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a78127f40 con 0x7f3a780a7030 2020-02-12T15:09:52.123 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7d470700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.124 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7e472700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a781380f0 0x7f3a78126710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.124 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7e472700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f3a781380f0 0x7f3a78126710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.180:38488/0 (socket says 172.21.15.180:38488) 2020-02-12T15:09:52.124 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7d470700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.180:51436/0 (socket says 172.21.15.180:51436) 2020-02-12T15:09:52.125 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7dc71700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f3a780a1c20 0x7f3a78065410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.180:37380/0 (socket says 172.21.15.180:37380) 2020-02-12T15:09:52.125 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7e472700 1 -- 172.21.15.180:0/809142816 learned_addr learned my addr 172.21.15.180:0/809142816 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:52.125 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7d470700 1 -- 172.21.15.180:0/809142816 >> v2:172.21.15.105:3300/0 conn(0x7f3a781380f0 msgr2=0x7f3a78126710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.126 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> v2:172.21.15.105:3300/0 conn(0x7f3a781380f0 0x7f3a78126710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.126 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7d470700 1 -- 172.21.15.180:0/809142816 >> v1:172.21.15.105:6789/0 conn(0x7f3a780a1c20 legacy=0x7f3a78065410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.126 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2792988819 0 0) 0x7f3a78129b30 con 0x7f3a780a1c20 2020-02-12T15:09:52.126 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.102+0000 7f3a7d470700 1 -- 172.21.15.180:0/809142816 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a78065b20 con 0x7f3a780a7030 2020-02-12T15:09:52.127 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7e472700 1 --2- 172.21.15.180:0/809142816 >> v2:172.21.15.105:3300/0 conn(0x7f3a781380f0 0x7f3a78126710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:52.127 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.127 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.128 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.128 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.128 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c011980 con 0x7f3a780a7030 2020-02-12T15:09:52.129 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.129 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.129 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a6c007150 con 0x7f3a780a7030 2020-02-12T15:09:52.129 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3a6c007530 con 0x7f3a780a7030 2020-02-12T15:09:52.129 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a781283e0 con 0x7f3a780a7030 2020-02-12T15:09:52.130 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a780a59e0 con 0x7f3a780a7030 2020-02-12T15:09:52.130 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.103+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.130 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.104+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.130 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.104+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.2 v2:172.21.15.105:3301/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f3a6c0056c0 con 0x7f3a780a7030 2020-02-12T15:09:52.131 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.104+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a780565b0 con 0x7f3a780a7030 2020-02-12T15:09:52.131 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.104+0000 7f3a6affd700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3a58039b30 0x7f3a5803bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.131 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.104+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.2 v2:172.21.15.105:3301/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f3a6c049eb0 con 0x7f3a780a7030 2020-02-12T15:09:52.131 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.104+0000 7f3a7dc71700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3a58039b30 0x7f3a5803bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.132 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.104+0000 7f3a7dc71700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3a58039b30 0x7f3a5803bff0 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.132 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.108+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.132 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.108+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.2 v2:172.21.15.105:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f3a6c02f560 con 0x7f3a780a7030 2020-02-12T15:09:52.291 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.288+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3a78128080 con 0x7f3a780a7030 2020-02-12T15:09:52.292 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.289+0000 7f3a7d470700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=THROTTLE_DONE pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.292 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.289+0000 7f3a6affd700 1 -- 172.21.15.180:0/809142816 <== mon.2 v2:172.21.15.105:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f3a6c032070 con 0x7f3a780a7030 2020-02-12T15:09:52.292 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:52.293 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3a58039b30 msgr2=0x7f3a5803bff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.293 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3a58039b30 0x7f3a5803bff0 crc :-1 s=READY pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.294 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 msgr2=0x7f3a780a4c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.294 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 secure :-1 s=READY pgs=40 cs=0 l=1 rx=0x7f3a6c002f30 tx=0x7f3a780a2000).stop 2020-02-12T15:09:52.294 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 shutdown_connections 2020-02-12T15:09:52.294 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f3a58039b30 0x7f3a5803bff0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.295 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/809142816 >> v2:172.21.15.105:3300/0 conn(0x7f3a781380f0 0x7f3a78126710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.295 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 --2- 172.21.15.180:0/809142816 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f3a780a7030 0x7f3a780a4c30 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.295 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 >> 172.21.15.180:0/809142816 conn(0x7f3a7809d450 msgr2=0x7f3a780a74b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:52.295 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 shutdown_connections 2020-02-12T15:09:52.295 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.290+0000 7f3a7fed5700 1 -- 172.21.15.180:0/809142816 wait complete. 2020-02-12T15:09:52.308 INFO:teuthology.orchestra.run.smithi180.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2020-02-12T15:09:52.309 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2020-02-12T15:09:52.309 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:52.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.412+0000 7f282b553700 1 Processor -- start 2020-02-12T15:09:52.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.412+0000 7f282b553700 1 -- start start 2020-02-12T15:09:52.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f282b553700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f28241380f0 0x7f28240a3d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f282b553700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28240aaff0 con 0x7f28240a1c20 2020-02-12T15:09:52.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f282b553700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282405fe60 con 0x7f28240a7030 2020-02-12T15:09:52.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f282b553700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240a7bd0 con 0x7f28241380f0 2020-02-12T15:09:52.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2829af0700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f28240a7030 0x7f28240a74c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42810/0 (socket says 172.21.15.180:42810) 2020-02-12T15:09:52.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2829af0700 1 -- 172.21.15.180:0/3153099356 learned_addr learned my addr 172.21.15.180:0/3153099356 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:52.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2828aee700 1 --2- 172.21.15.180:0/3153099356 >> v2:172.21.15.105:3300/0 conn(0x7f28241380f0 0x7f28240a3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135652707 0 0) 0x7f282405fe60 con 0x7f28240a7030 2020-02-12T15:09:52.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f280c003230 con 0x7f28240a7030 2020-02-12T15:09:52.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 1060518608 0 0) 0x7f280c003230 con 0x7f28240a7030 2020-02-12T15:09:52.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 >> v2:172.21.15.105:3300/0 conn(0x7f28241380f0 msgr2=0x7f28240a3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:52.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 --2- 172.21.15.180:0/3153099356 >> v2:172.21.15.105:3300/0 conn(0x7f28241380f0 0x7f28240a3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 >> v1:172.21.15.105:6789/0 conn(0x7f28240a1c20 legacy=0x7f28240a2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28240aaab0 con 0x7f28240a7030 2020-02-12T15:09:52.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.413+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f281c001a50 con 0x7f28240a7030 2020-02-12T15:09:52.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 >> v1:172.21.15.180:6789/0 conn(0x7f28240a7030 legacy=0x7f28240a74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280c0044d0 0x7f280c004950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280c004db0 0x7f280c00b720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28240a7bd0 con 0x7f280c0044d0 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f280c0041c0 con 0x7f280c003720 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f280c00bb80 con 0x7f280c004db0 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2828aee700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280c0044d0 0x7f280c004950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.426 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2829af0700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280c004db0 0x7f280c00b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 -- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280c004db0 msgr2=0x7f280c00b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:52.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f280c004db0 0x7f280c00b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 -- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280c0044d0 msgr2=0x7f280c004950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:52.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280c0044d0 0x7f280c004950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 -- 172.21.15.180:0/3153099356 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f280c003230 con 0x7f280c003720 2020-02-12T15:09:52.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2829af0700 1 -- 172.21.15.180:0/3153099356 reap_dead start 2020-02-12T15:09:52.427 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2828aee700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f280c0044d0 0x7f280c004950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:52.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f280c0054a0 tx=0x7f281400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f280c0054a0 tx=0x7f281400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f280c0054a0 tx=0x7f281400fe00).ready entity=mon.1 client_cookie=3e2e25a01698c4fa server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f280c0054a0 tx=0x7f281400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2814003540 con 0x7f280c003720 2020-02-12T15:09:52.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f280c0054a0 tx=0x7f281400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.428 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f28292ef700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 secure :-1 s=THROTTLE_DONE pgs=176 cs=0 l=1 rx=0x7f280c0054a0 tx=0x7f281400fe00).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28140036a0 con 0x7f280c003720 2020-02-12T15:09:52.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f2813fff700 1 -- 172.21.15.180:0/3153099356 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2814003a40 con 0x7f280c003720 2020-02-12T15:09:52.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f282b553700 1 -- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 msgr2=0x7f280c003b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.414+0000 7f282b553700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 secure :-1 s=READY pgs=176 cs=0 l=1 rx=0x7f280c0054a0 tx=0x7f281400fe00).stop 2020-02-12T15:09:52.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.415+0000 7f282b553700 1 -- 172.21.15.180:0/3153099356 shutdown_connections 2020-02-12T15:09:52.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.415+0000 7f282b553700 1 --2- 172.21.15.180:0/3153099356 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f280c003720 0x7f280c003b40 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.429 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.415+0000 7f282b553700 1 -- 172.21.15.180:0/3153099356 >> 172.21.15.180:0/3153099356 conn(0x7f282409d450 msgr2=0x7f282409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:52.430 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.415+0000 7f282b553700 1 -- 172.21.15.180:0/3153099356 shutdown_connections 2020-02-12T15:09:52.430 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.415+0000 7f282b553700 1 -- 172.21.15.180:0/3153099356 wait complete. 2020-02-12T15:09:52.430 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f282b553700 1 Processor -- start 2020-02-12T15:09:52.430 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f282b553700 1 -- start start 2020-02-12T15:09:52.430 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f282b553700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f282412d240 0x7f2824128fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.430 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f282b553700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28241443f0 0x7f2824144860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.430 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f282b553700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f282405edb0 con 0x7f280c003720 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f282b553700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28240a49a0 con 0x7f282412d240 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f282b553700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2824133c90 con 0x7f28241443f0 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f2828aee700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f282412d240 0x7f2824128fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f2829af0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28241443f0 0x7f2824144860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f2828aee700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f282412d240 0x7f2824128fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.180:38504/0 (socket says 172.21.15.180:38504) 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f2828aee700 1 -- 172.21.15.180:0/3251493224 learned_addr learned my addr 172.21.15.180:0/3251493224 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.416+0000 7f2829af0700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28241443f0 0x7f2824144860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.180:51456/0 (socket says 172.21.15.180:51456) 2020-02-12T15:09:52.431 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 -- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28241443f0 msgr2=0x7f2824144860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.432 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28241443f0 0x7f2824144860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.432 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3187098813 0 0) 0x7f282405edb0 con 0x7f280c003720 2020-02-12T15:09:52.432 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 -- 172.21.15.180:0/3251493224 >> v1:172.21.15.105:6789/0 conn(0x7f280c003720 legacy=0x7f282412a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.432 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 -- 172.21.15.180:0/3251493224 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f282412a030 con 0x7f282412d240 2020-02-12T15:09:52.432 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2829af0700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28241443f0 0x7f2824144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> v2:172.21.15.105:3300/0 conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> v2:172.21.15.105:3300/0 conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2820005e90 con 0x7f282412d240 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2820007160 con 0x7f282412d240 2020-02-12T15:09:52.433 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f282412abe0 con 0x7f282412d240 2020-02-12T15:09:52.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2820007540 con 0x7f282412d240 2020-02-12T15:09:52.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.417+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2824144cc0 con 0x7f282412d240 2020-02-12T15:09:52.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.418+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.418+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v2:172.21.15.105:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f282000e250 con 0x7f282412d240 2020-02-12T15:09:52.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.418+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.434 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.418+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f282412a1c0 con 0x7f282412d240 2020-02-12T15:09:52.435 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.418+0000 7f28127fc700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2804039ae0 0x7f280403bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.435 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.418+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v2:172.21.15.105:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f2820049c90 con 0x7f282412d240 2020-02-12T15:09:52.435 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.418+0000 7f28292ef700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2804039ae0 0x7f280403bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.435 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.419+0000 7f28292ef700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2804039ae0 0x7f280403bfa0 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.423+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.436 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.423+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v2:172.21.15.105:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f282002f2a0 con 0x7f282412d240 2020-02-12T15:09:52.560 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.558+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28240565b0 con 0x7f282412d240 2020-02-12T15:09:52.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.559+0000 7f2828aee700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=THROTTLE_DONE pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.561 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.559+0000 7f28127fc700 1 -- 172.21.15.180:0/3251493224 <== mon.0 v2:172.21.15.105:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14981 (secure 0 0 0) 0x7f2820031db0 con 0x7f282412d240 2020-02-12T15:09:52.562 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:52.562 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":24,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:43.739063+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:52.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2804039ae0 msgr2=0x7f280403bfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2804039ae0 0x7f280403bfa0 crc :-1 s=READY pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 msgr2=0x7f2824128fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 secure :-1 s=READY pgs=88 cs=0 l=1 rx=0x7f2820002f30 tx=0x7f2820010ac0).stop 2020-02-12T15:09:52.563 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 shutdown_connections 2020-02-12T15:09:52.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f2804039ae0 0x7f280403bfa0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f28241443f0 0x7f2824144860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 --2- 172.21.15.180:0/3251493224 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f282412d240 0x7f2824128fd0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 >> 172.21.15.180:0/3251493224 conn(0x7f282409d450 msgr2=0x7f28240698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:52.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 shutdown_connections 2020-02-12T15:09:52.564 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.560+0000 7f282b553700 1 -- 172.21.15.180:0/3251493224 wait complete. 2020-02-12T15:09:52.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:34.556683+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:37.409320+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:40.417450+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T15:09:52.575 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T15:09:52.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.681+0000 7f644e018700 1 Processor -- start 2020-02-12T15:09:52.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.681+0000 7f644e018700 1 -- start start 2020-02-12T15:09:52.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f644e018700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f644805f3a0 0x7f64480a99a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f644e018700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f64480a9e00 0x7f644809e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f644e018700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6448065a60 con 0x7f644809e790 2020-02-12T15:09:52.695 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f644e018700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6448065d00 con 0x7f64480a9e00 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f644e018700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64480a8f90 con 0x7f644805f3a0 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f644805f3a0 0x7f64480a99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f644805f3a0 0x7f64480a99a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51314/0 (socket says 172.21.15.180:51314) 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 -- 172.21.15.180:0/3036688613 learned_addr learned my addr 172.21.15.180:0/3036688613 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f6447fff700 1 --1- 172.21.15.180:0/3036688613 >> v1:172.21.15.180:6789/0 conn(0x7f644809e790 0x7f6448131c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42832/0 (socket says 172.21.15.180:42832) 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 -- 172.21.15.180:0/3036688613 >> v2:172.21.15.105:3300/0 conn(0x7f64480a9e00 msgr2=0x7f644809e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f6446ffd700 1 --2- 172.21.15.180:0/3036688613 >> v2:172.21.15.105:3300/0 conn(0x7f64480a9e00 0x7f644809e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.696 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64467fc700 1 -- 172.21.15.180:0/3036688613 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3257722412 0 0) 0x7f6448065a60 con 0x7f644809e790 2020-02-12T15:09:52.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- 172.21.15.180:0/3036688613 >> v2:172.21.15.105:3300/0 conn(0x7f64480a9e00 0x7f644809e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 -- 172.21.15.180:0/3036688613 >> v1:172.21.15.180:6789/0 conn(0x7f644809e790 legacy=0x7f6448131c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 -- 172.21.15.180:0/3036688613 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f644809ebb0 con 0x7f644805f3a0 2020-02-12T15:09:52.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- 172.21.15.180:0/3036688613 >> v2:172.21.15.180:3300/0 conn(0x7f644805f3a0 0x7f64480a99a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f6438002f30 tx=0x7f6438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- 172.21.15.180:0/3036688613 >> v2:172.21.15.180:3300/0 conn(0x7f644805f3a0 0x7f64480a99a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f6438002f30 tx=0x7f6438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- 172.21.15.180:0/3036688613 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644805f3a0 0x7f64480a99a0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f6438002f30 tx=0x7f6438007a40).ready entity=mon.1 client_cookie=666443026747577f server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.697 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- 172.21.15.180:0/3036688613 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644805f3a0 0x7f64480a99a0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f6438002f30 tx=0x7f6438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.704 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64467fc700 1 -- 172.21.15.180:0/3036688613 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6438011720 con 0x7f644805f3a0 2020-02-12T15:09:52.704 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- 172.21.15.180:0/3036688613 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644805f3a0 0x7f64480a99a0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f6438002f30 tx=0x7f6438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.705 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.682+0000 7f64477fe700 1 --2- 172.21.15.180:0/3036688613 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644805f3a0 0x7f64480a99a0 secure :-1 s=THROTTLE_DONE pgs=178 cs=0 l=1 rx=0x7f6438002f30 tx=0x7f6438007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.705 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f64467fc700 1 -- 172.21.15.180:0/3036688613 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6438011880 con 0x7f644805f3a0 2020-02-12T15:09:52.705 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f64467fc700 1 -- 172.21.15.180:0/3036688613 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6438011c20 con 0x7f644805f3a0 2020-02-12T15:09:52.705 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 -- 172.21.15.180:0/3036688613 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644805f3a0 msgr2=0x7f64480a99a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.706 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 --2- 172.21.15.180:0/3036688613 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644805f3a0 0x7f64480a99a0 secure :-1 s=READY pgs=178 cs=0 l=1 rx=0x7f6438002f30 tx=0x7f6438007a40).stop 2020-02-12T15:09:52.706 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 -- 172.21.15.180:0/3036688613 shutdown_connections 2020-02-12T15:09:52.706 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 --2- 172.21.15.180:0/3036688613 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644805f3a0 0x7f64480a99a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.706 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 --2- 172.21.15.180:0/3036688613 >> v2:172.21.15.105:3300/0 conn(0x7f64480a9e00 0x7f644809e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.706 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 -- 172.21.15.180:0/3036688613 >> 172.21.15.180:0/3036688613 conn(0x7f644805a880 msgr2=0x7f644805e910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:52.706 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 -- 172.21.15.180:0/3036688613 shutdown_connections 2020-02-12T15:09:52.707 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.683+0000 7f644e018700 1 -- 172.21.15.180:0/3036688613 wait complete. 2020-02-12T15:09:52.707 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.684+0000 7f644e018700 1 Processor -- start 2020-02-12T15:09:52.707 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.684+0000 7f644e018700 1 -- start start 2020-02-12T15:09:52.707 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f644e018700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f644809e790 0x7f64481379c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.707 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f644e018700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6448136cd0 con 0x7f64480a9e00 2020-02-12T15:09:52.708 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f644e018700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f644813a170 con 0x7f644805f3a0 2020-02-12T15:09:52.708 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f644e018700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6448137e20 con 0x7f644809e790 2020-02-12T15:09:52.708 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f644809e790 0x7f64481379c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.708 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f64477fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f644805f3a0 0x7f644813a5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42834/0 (socket says 172.21.15.180:42834) 2020-02-12T15:09:52.709 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f64477fe700 1 -- 172.21.15.180:0/640426090 learned_addr learned my addr 172.21.15.180:0/640426090 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:52.709 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 -- 172.21.15.180:0/640426090 >> v1:172.21.15.180:6789/0 conn(0x7f644805f3a0 legacy=0x7f644813a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.709 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 -- 172.21.15.180:0/640426090 >> v1:172.21.15.105:6789/0 conn(0x7f64480a9e00 legacy=0x7f644812e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.709 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4146768832 0 0) 0x7f644813a170 con 0x7f644805f3a0 2020-02-12T15:09:52.710 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 -- 172.21.15.180:0/640426090 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6448136f00 con 0x7f644809e790 2020-02-12T15:09:52.710 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> v2:172.21.15.180:3300/0 conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.710 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> v2:172.21.15.180:3300/0 conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.710 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.711 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.711 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c007540 con 0x7f644809e790 2020-02-12T15:09:52.711 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.711 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.712 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f643c0059c0 con 0x7f644809e790 2020-02-12T15:09:52.712 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f644813bdf0 con 0x7f644809e790 2020-02-12T15:09:52.712 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f643c005de0 con 0x7f644809e790 2020-02-12T15:09:52.712 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.685+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f644813b900 con 0x7f644809e790 2020-02-12T15:09:52.713 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.686+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.716 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.686+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64480565b0 con 0x7f644809e790 2020-02-12T15:09:52.716 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.686+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f643c008940 con 0x7f644809e790 2020-02-12T15:09:52.716 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.686+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.716 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.687+0000 7f6444ff9700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6428039ac0 0x7f642803bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.717 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.687+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f643c0497b0 con 0x7f644809e790 2020-02-12T15:09:52.717 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.687+0000 7f64477fe700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6428039ac0 0x7f642803bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.717 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.687+0000 7f64477fe700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6428039ac0 0x7f642803bf80 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.717 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.690+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.718 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.690+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f643c02ee20 con 0x7f644809e790 2020-02-12T15:09:52.829 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.826+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6448137100 con 0x7f644809e790 2020-02-12T15:09:52.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.826+0000 7f6446ffd700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=THROTTLE_DONE pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.830 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.826+0000 7f6444ff9700 1 -- 172.21.15.180:0/640426090 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f643c0318d0 con 0x7f644809e790 2020-02-12T15:09:52.830 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:52.831 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.827+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6428039ac0 msgr2=0x7f642803bf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.831 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.827+0000 7f644e018700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6428039ac0 0x7f642803bf80 crc :-1 s=READY pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.831 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 msgr2=0x7f64481379c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.831 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 secure :-1 s=READY pgs=180 cs=0 l=1 rx=0x7f644813b830 tx=0x7f643c010a30).stop 2020-02-12T15:09:52.831 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 shutdown_connections 2020-02-12T15:09:52.832 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f6428039ac0 0x7f642803bf80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.832 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 --2- 172.21.15.180:0/640426090 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f644809e790 0x7f64481379c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.832 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 >> 172.21.15.180:0/640426090 conn(0x7f644805a880 msgr2=0x7f644809de50 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:52.832 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 shutdown_connections 2020-02-12T15:09:52.832 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.828+0000 7f644e018700 1 -- 172.21.15.180:0/640426090 wait complete. 2020-02-12T15:09:52.842 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-12T15:09:52.955 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc89b78700 1 Processor -- start 2020-02-12T15:09:52.955 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc89b78700 1 -- start start 2020-02-12T15:09:52.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc89b78700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc89b78700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7fdc841368e0 0x7fdc84139490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:52.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc89b78700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc84136050 con 0x7fdc841398f0 2020-02-12T15:09:52.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc89b78700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc840a0030 con 0x7fdc841368e0 2020-02-12T15:09:52.961 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc89b78700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc840a3f90 con 0x7fdc840a8ef0 2020-02-12T15:09:52.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc83fff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fdc841398f0 0x7fdc84139d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42846/0 (socket says 172.21.15.180:42846) 2020-02-12T15:09:52.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc83fff700 1 -- 172.21.15.180:0/250557271 learned_addr learned my addr 172.21.15.180:0/250557271 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:52.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.953+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/250557271 >> v2:172.21.15.105:3300/0 conn(0x7fdc841368e0 0x7fdc84139490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc827fc700 1 -- 172.21.15.180:0/250557271 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 220310385 0 0) 0x7fdc84136050 con 0x7fdc841398f0 2020-02-12T15:09:52.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc827fc700 1 -- 172.21.15.180:0/250557271 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc70003230 con 0x7fdc841398f0 2020-02-12T15:09:52.962 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 -- 172.21.15.180:0/250557271 >> v2:172.21.15.105:3300/0 conn(0x7fdc841368e0 msgr2=0x7fdc84139490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> v2:172.21.15.105:3300/0 conn(0x7fdc841368e0 0x7fdc84139490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 -- 172.21.15.180:0/250557271 >> v1:172.21.15.180:6789/0 conn(0x7fdc841398f0 legacy=0x7fdc84139d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 -- 172.21.15.180:0/250557271 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840a88c0 con 0x7fdc840a8ef0 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fdc74002f30 tx=0x7fdc740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fdc74002f30 tx=0x7fdc740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc740088e0).ready entity=mon.2 client_cookie=fa2cbec536920858 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.963 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc827fc700 1 -- 172.21.15.180:0/250557271 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc74008e40 con 0x7fdc840a8ef0 2020-02-12T15:09:52.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc827fc700 1 -- 172.21.15.180:0/250557271 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc74011540 con 0x7fdc840a8ef0 2020-02-12T15:09:52.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc837fe700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 secure :-1 s=THROTTLE_DONE pgs=41 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc740088e0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc89b78700 1 -- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 msgr2=0x7fdc84136480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc827fc700 1 -- 172.21.15.180:0/250557271 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc740118e0 con 0x7fdc840a8ef0 2020-02-12T15:09:52.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.954+0000 7fdc89b78700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 secure :-1 s=READY pgs=41 cs=0 l=1 rx=0x7fdc74002f30 tx=0x7fdc740088e0).stop 2020-02-12T15:09:52.964 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.955+0000 7fdc89b78700 1 -- 172.21.15.180:0/250557271 shutdown_connections 2020-02-12T15:09:52.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.955+0000 7fdc89b78700 1 --2- 172.21.15.180:0/250557271 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7fdc840a8ef0 0x7fdc84136480 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:52.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.955+0000 7fdc89b78700 1 --2- 172.21.15.180:0/250557271 >> v2:172.21.15.105:3300/0 conn(0x7fdc841368e0 0x7fdc84139490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:52.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.955+0000 7fdc89b78700 1 -- 172.21.15.180:0/250557271 >> 172.21.15.180:0/250557271 conn(0x7fdc8405a530 msgr2=0x7fdc8405a910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:52.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.955+0000 7fdc89b78700 1 -- 172.21.15.180:0/250557271 shutdown_connections 2020-02-12T15:09:52.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.955+0000 7fdc89b78700 1 -- 172.21.15.180:0/250557271 wait complete. 2020-02-12T15:09:52.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.955+0000 7fdc89b78700 1 Processor -- start 2020-02-12T15:09:52.965 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc89b78700 1 -- start start 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc89b78700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdc841368e0 0x7fdc840aa8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc89b78700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840a1af0 con 0x7fdc840a8ef0 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc89b78700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc840a1d90 con 0x7fdc841398f0 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc89b78700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc840670a0 con 0x7fdc841368e0 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc82ffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdc841368e0 0x7fdc840aa8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc83fff700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7fdc841398f0 0x7fdc841332c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42852/0 (socket says 172.21.15.180:42852) 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc82ffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7fdc841368e0 0x7fdc840aa8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51336/0 (socket says 172.21.15.180:51336) 2020-02-12T15:09:52.966 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.956+0000 7fdc83fff700 1 -- 172.21.15.180:0/3563521638 learned_addr learned my addr 172.21.15.180:0/3563521638 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:52.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 -- 172.21.15.180:0/3563521638 >> v1:172.21.15.180:6789/0 conn(0x7fdc841398f0 legacy=0x7fdc841332c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 -- 172.21.15.180:0/3563521638 >> v1:172.21.15.105:6789/0 conn(0x7fdc840a8ef0 legacy=0x7fdc840a0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:52.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446293450 0 0) 0x7fdc840a1d90 con 0x7fdc841398f0 2020-02-12T15:09:52.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 -- 172.21.15.180:0/3563521638 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc840a16c0 con 0x7fdc841368e0 2020-02-12T15:09:52.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> v2:172.21.15.180:3300/0 conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> v2:172.21.15.180:3300/0 conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.967 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc78007530 con 0x7fdc841368e0 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc78012710 con 0x7fdc841368e0 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc78012af0 con 0x7fdc841368e0 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc84063550 con 0x7fdc841368e0 2020-02-12T15:09:52.968 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc840a1000 con 0x7fdc841368e0 2020-02-12T15:09:52.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.957+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.958+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fdc78012d60 con 0x7fdc841368e0 2020-02-12T15:09:52.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.958+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.958+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc84067ab0 con 0x7fdc841368e0 2020-02-12T15:09:52.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.958+0000 7fdc80ff9700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdc640399f0 0x7fdc6403beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:52.969 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.958+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fdc7800d0c0 con 0x7fdc841368e0 2020-02-12T15:09:52.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.958+0000 7fdc837fe700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdc640399f0 0x7fdc6403beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:52.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.958+0000 7fdc837fe700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdc640399f0 0x7fdc6403beb0 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:52.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.961+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:52.970 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:52.961+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7fdc7802f420 con 0x7fdc841368e0 2020-02-12T15:09:53.097 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.094+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdc84133d50 con 0x7fdc841368e0 2020-02-12T15:09:53.097 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.094+0000 7fdc82ffd700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=THROTTLE_DONE pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.097 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.095+0000 7fdc80ff9700 1 -- 172.21.15.180:0/3563521638 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7fdc78031f10 con 0x7fdc841368e0 2020-02-12T15:09:53.097 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:53.098 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdc640399f0 msgr2=0x7fdc6403beb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.098 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdc640399f0 0x7fdc6403beb0 crc :-1 s=READY pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.099 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 msgr2=0x7fdc840aa8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.099 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rx=0x7fdc78002f30 tx=0x7fdc78010c80).stop 2020-02-12T15:09:53.099 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 shutdown_connections 2020-02-12T15:09:53.099 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fdc640399f0 0x7fdc6403beb0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.099 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 --2- 172.21.15.180:0/3563521638 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7fdc841368e0 0x7fdc840aa8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.099 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 >> 172.21.15.180:0/3563521638 conn(0x7fdc8405a530 msgr2=0x7fdc840698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:53.099 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 shutdown_connections 2020-02-12T15:09:53.100 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.096+0000 7fdc89b78700 1 -- 172.21.15.180:0/3563521638 wait complete. 2020-02-12T15:09:53.108 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-12T15:09:53.216 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.214+0000 7f4cb43bf700 1 Processor -- start 2020-02-12T15:09:53.217 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.214+0000 7f4cb43bf700 1 -- start start 2020-02-12T15:09:53.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb43bf700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4cac05ee20 0x7f4cac1358f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:53.227 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb43bf700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac138320 con 0x7f4cac0a8ed0 2020-02-12T15:09:53.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb43bf700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cac138580 con 0x7f4cac0a92b0 2020-02-12T15:09:53.228 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb43bf700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac139130 con 0x7f4cac05ee20 2020-02-12T15:09:53.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4cac05ee20 0x7f4cac1358f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb195a700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f4cac0a92b0 0x7f4cac1351e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42858/0 (socket says 172.21.15.180:42858) 2020-02-12T15:09:53.229 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb195a700 1 -- 172.21.15.180:0/873309294 learned_addr learned my addr 172.21.15.180:0/873309294 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:53.230 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 -- 172.21.15.180:0/873309294 >> v1:172.21.15.180:6789/0 conn(0x7f4cac0a92b0 legacy=0x7f4cac1351e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.230 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 -- 172.21.15.180:0/873309294 >> v1:172.21.15.105:6789/0 conn(0x7f4cac0a8ed0 legacy=0x7f4cac138a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:53.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb1159700 1 -- 172.21.15.180:0/873309294 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240200266 0 0) 0x7f4cac138580 con 0x7f4cac0a92b0 2020-02-12T15:09:53.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 -- 172.21.15.180:0/873309294 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac05f330 con 0x7f4cac05ee20 2020-02-12T15:09:53.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 --2- 172.21.15.180:0/873309294 >> v2:172.21.15.180:3300/0 conn(0x7f4cac05ee20 0x7f4cac1358f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f4cac062420 tx=0x7f4ca4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.231 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 --2- 172.21.15.180:0/873309294 >> v2:172.21.15.180:3300/0 conn(0x7f4cac05ee20 0x7f4cac1358f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f4cac062420 tx=0x7f4ca4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.232 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 --2- 172.21.15.180:0/873309294 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac05ee20 0x7f4cac1358f0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4ca4008c60).ready entity=mon.1 client_cookie=208042b8073815d3 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:53.232 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 --2- 172.21.15.180:0/873309294 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac05ee20 0x7f4cac1358f0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4ca4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.232 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb1159700 1 -- 172.21.15.180:0/873309294 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca400a160 con 0x7f4cac05ee20 2020-02-12T15:09:53.232 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 --2- 172.21.15.180:0/873309294 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac05ee20 0x7f4cac1358f0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4ca4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb1159700 1 -- 172.21.15.180:0/873309294 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca400a2c0 con 0x7f4cac05ee20 2020-02-12T15:09:53.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb295c700 1 --2- 172.21.15.180:0/873309294 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac05ee20 0x7f4cac1358f0 secure :-1 s=THROTTLE_DONE pgs=185 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4ca4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb1159700 1 -- 172.21.15.180:0/873309294 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca400a660 con 0x7f4cac05ee20 2020-02-12T15:09:53.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb43bf700 1 -- 172.21.15.180:0/873309294 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac05ee20 msgr2=0x7f4cac1358f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.233 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.215+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/873309294 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac05ee20 0x7f4cac1358f0 secure :-1 s=READY pgs=185 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4ca4008c60).stop 2020-02-12T15:09:53.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.216+0000 7f4cb43bf700 1 -- 172.21.15.180:0/873309294 shutdown_connections 2020-02-12T15:09:53.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.216+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/873309294 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac05ee20 0x7f4cac1358f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.216+0000 7f4cb43bf700 1 -- 172.21.15.180:0/873309294 >> 172.21.15.180:0/873309294 conn(0x7f4cac05a530 msgr2=0x7f4cac05a910 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:53.234 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.216+0000 7f4cb43bf700 1 -- 172.21.15.180:0/873309294 shutdown_connections 2020-02-12T15:09:53.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.216+0000 7f4cb43bf700 1 -- 172.21.15.180:0/873309294 wait complete. 2020-02-12T15:09:53.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 Processor -- start 2020-02-12T15:09:53.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 -- start start 2020-02-12T15:09:53.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cac05ee20 0x7f4cac0a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:53.235 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f4cac0a8ed0 0x7f4cac0ab500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:53.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4cac0ac310 0x7f4cac0ab960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:53.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac135f10 con 0x7f4cac0a8ed0 2020-02-12T15:09:53.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cac0ac8b0 con 0x7f4cac0ac310 2020-02-12T15:09:53.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb43bf700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cac0acb50 con 0x7f4cac05ee20 2020-02-12T15:09:53.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb295c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4cac0ac310 0x7f4cac0ab960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb295c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f4cac0ac310 0x7f4cac0ab960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51352/0 (socket says 172.21.15.180:51352) 2020-02-12T15:09:53.236 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.217+0000 7f4cb295c700 1 -- 172.21.15.180:0/3679029645 learned_addr learned my addr 172.21.15.180:0/3679029645 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:53.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb215b700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cac05ee20 0x7f4cac0a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb195a700 1 --2- 172.21.15.180:0/3679029645 >> v2:172.21.15.105:3300/0 conn(0x7f4cac0a8ed0 0x7f4cac0ab500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 -- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cac05ee20 msgr2=0x7f4cac0a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.237 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cac05ee20 0x7f4cac0a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.241 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 -- 172.21.15.180:0/3679029645 >> v2:172.21.15.105:3300/0 conn(0x7f4cac0a8ed0 msgr2=0x7f4cac0ab500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.241 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> v2:172.21.15.105:3300/0 conn(0x7f4cac0a8ed0 0x7f4cac0ab500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.241 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 -- 172.21.15.180:0/3679029645 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cac0acdf0 con 0x7f4cac0ac310 2020-02-12T15:09:53.242 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb195a700 1 --2- 172.21.15.180:0/3679029645 >> v2:172.21.15.105:3300/0 conn(0x7f4cac0a8ed0 0x7f4cac0ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).send_auth_request state changed! 2020-02-12T15:09:53.242 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> v2:172.21.15.180:3300/0 conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.242 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> v2:172.21.15.180:3300/0 conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.242 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:53.242 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.242 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.242 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4c9b7fe700 1 -- 172.21.15.180:0/3679029645 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca4005c30 con 0x7f4cac0ac310 2020-02-12T15:09:53.243 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.243 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4c9b7fe700 1 -- 172.21.15.180:0/3679029645 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca4005d90 con 0x7f4cac0ac310 2020-02-12T15:09:53.243 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4c9b7fe700 1 -- 172.21.15.180:0/3679029645 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4ca400f760 con 0x7f4cac0ac310 2020-02-12T15:09:53.243 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cac0abdc0 con 0x7f4cac0ac310 2020-02-12T15:09:53.243 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.218+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cac0a2e60 con 0x7f4cac0ac310 2020-02-12T15:09:53.243 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.219+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.244 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.219+0000 7f4c9b7fe700 1 -- 172.21.15.180:0/3679029645 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f4ca400f8c0 con 0x7f4cac0ac310 2020-02-12T15:09:53.244 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.219+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.244 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.219+0000 7f4c9b7fe700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c8c039c40 0x7f4c8c03c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:53.244 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.219+0000 7f4c9b7fe700 1 -- 172.21.15.180:0/3679029645 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f4ca404aad0 con 0x7f4cac0ac310 2020-02-12T15:09:53.244 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.219+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cac067ab0 con 0x7f4cac0ac310 2020-02-12T15:09:53.244 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.219+0000 7f4cb215b700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c8c039c40 0x7f4c8c03c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.244 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.220+0000 7f4cb215b700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c8c039c40 0x7f4c8c03c100 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:53.245 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.223+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.245 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.223+0000 7f4c9b7fe700 1 -- 172.21.15.180:0/3679029645 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f4ca4033110 con 0x7f4cac0ac310 2020-02-12T15:09:53.360 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.357+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4cac0565b0 con 0x7f4cac0ac310 2020-02-12T15:09:53.360 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.358+0000 7f4cb295c700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=THROTTLE_DONE pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.360 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.358+0000 7f4c9b7fe700 1 -- 172.21.15.180:0/3679029645 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f4ca4032cd0 con 0x7f4cac0ac310 2020-02-12T15:09:53.360 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:53.362 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c8c039c40 msgr2=0x7f4c8c03c100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.362 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c8c039c40 0x7f4c8c03c100 crc :-1 s=READY pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.362 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 msgr2=0x7f4cac0ab960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.362 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 secure :-1 s=READY pgs=186 cs=0 l=1 rx=0x7f4cac062420 tx=0x7f4cac05f4c0).stop 2020-02-12T15:09:53.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 shutdown_connections 2020-02-12T15:09:53.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4c8c039c40 0x7f4c8c03c100 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f4cac0ac310 0x7f4cac0ab960 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/3679029645 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f4cac05ee20 0x7f4cac0a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 --2- 172.21.15.180:0/3679029645 >> v2:172.21.15.105:3300/0 conn(0x7f4cac0a8ed0 0x7f4cac0ab500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 >> 172.21.15.180:0/3679029645 conn(0x7f4cac05a530 msgr2=0x7f4cac09f9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:53.363 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 shutdown_connections 2020-02-12T15:09:53.364 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.359+0000 7f4cb43bf700 1 -- 172.21.15.180:0/3679029645 wait complete. 2020-02-12T15:09:53.372 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-12T15:09:53.478 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.475+0000 7f83ea187700 1 Processor -- start 2020-02-12T15:09:53.478 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.475+0000 7f83ea187700 1 -- start start 2020-02-12T15:09:53.484 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83ea187700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 0x7f83e40a7850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:53.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83ea187700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e412f4a0 con 0x7f83e4134c70 2020-02-12T15:09:53.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83ea187700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e40a16d0 con 0x7f83e40aad70 2020-02-12T15:09:53.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83ea187700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40a4260 con 0x7f83e40a44a0 2020-02-12T15:09:53.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83e37fe700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f83e40aad70 0x7f83e40a7140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42870/0 (socket says 172.21.15.180:42870) 2020-02-12T15:09:53.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83e37fe700 1 -- 172.21.15.180:0/251194929 learned_addr learned my addr 172.21.15.180:0/251194929 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:53.485 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 0x7f83e40a7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.486 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2104954837 0 0) 0x7f83e40a16d0 con 0x7f83e40aad70 2020-02-12T15:09:53.486 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.476+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83d0003230 con 0x7f83e40aad70 2020-02-12T15:09:53.486 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 390+0+0 (unknown 3198370571 0 0) 0x7f83d0003230 con 0x7f83e40aad70 2020-02-12T15:09:53.486 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 msgr2=0x7f83e40a7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:53.486 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 0x7f83e40a7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:53.486 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 >> v1:172.21.15.105:6789/0 conn(0x7f83e4134c70 legacy=0x7f83e413f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.486 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 --> v1:172.21.15.180:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e40a1a20 con 0x7f83e40aad70 2020-02-12T15:09:53.487 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f83d40016d0 con 0x7f83e40aad70 2020-02-12T15:09:53.487 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 >> v1:172.21.15.180:6789/0 conn(0x7f83e40aad70 legacy=0x7f83e40a7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.487 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:53.487 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 0x7f83d00044d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:53.487 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83d0004930 0x7f83d0004db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:53.487 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40a4260 con 0x7f83d0004930 2020-02-12T15:09:53.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0005300 con 0x7f83d0003750 2020-02-12T15:09:53.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83d0004120 con 0x7f83e40a44a0 2020-02-12T15:09:53.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 0x7f83d00044d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e3fff700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83d0004930 0x7f83d0004db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.488 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 -- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 msgr2=0x7f83d00044d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:53.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e40a44a0 0x7f83d00044d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:53.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 -- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83d0004930 msgr2=0x7f83d0004db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:53.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f83d0004930 0x7f83d0004db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:53.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 -- 172.21.15.180:0/251194929 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83d0003230 con 0x7f83d0003750 2020-02-12T15:09:53.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f83d40013e0 tx=0x7f83e40ab2d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f83d40013e0 tx=0x7f83e40ab2d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.489 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f83d40013e0 tx=0x7f83e40ab2d0).ready entity=mon.1 client_cookie=c596aa41b6b01699 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:53.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f83d40013e0 tx=0x7f83e40ab2d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d400ce80 con 0x7f83d0003750 2020-02-12T15:09:53.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f83d40013e0 tx=0x7f83e40ab2d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e37fe700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 secure :-1 s=THROTTLE_DONE pgs=188 cs=0 l=1 rx=0x7f83d40013e0 tx=0x7f83e40ab2d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d400e350 con 0x7f83d0003750 2020-02-12T15:09:53.490 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e27fc700 1 -- 172.21.15.180:0/251194929 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d40100b0 con 0x7f83d0003750 2020-02-12T15:09:53.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83ea187700 1 -- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 msgr2=0x7f83d0003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83ea187700 1 --2- 172.21.15.180:0/251194929 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83d0003750 0x7f83d0003b70 secure :-1 s=READY pgs=188 cs=0 l=1 rx=0x7f83d40013e0 tx=0x7f83e40ab2d0).stop 2020-02-12T15:09:53.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.477+0000 7f83e3fff700 1 -- 172.21.15.180:0/251194929 reap_dead start 2020-02-12T15:09:53.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.478+0000 7f83ea187700 1 -- 172.21.15.180:0/251194929 shutdown_connections 2020-02-12T15:09:53.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.478+0000 7f83ea187700 1 -- 172.21.15.180:0/251194929 >> 172.21.15.180:0/251194929 conn(0x7f83e409d450 msgr2=0x7f83e409d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:53.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.478+0000 7f83ea187700 1 -- 172.21.15.180:0/251194929 shutdown_connections 2020-02-12T15:09:53.491 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.478+0000 7f83ea187700 1 -- 172.21.15.180:0/251194929 wait complete. 2020-02-12T15:09:53.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.479+0000 7f83ea187700 1 Processor -- start 2020-02-12T15:09:53.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.479+0000 7f83ea187700 1 -- start start 2020-02-12T15:09:53.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.479+0000 7f83ea187700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e4061380 0x7f83e4145760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:53.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.479+0000 7f83ea187700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f83e40630e0 0x7f83e4066870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:53.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.479+0000 7f83ea187700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83e40a0070 con 0x7f83e4145bc0 2020-02-12T15:09:53.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.479+0000 7f83ea187700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83e409f770 con 0x7f83e40630e0 2020-02-12T15:09:53.492 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.479+0000 7f83ea187700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83e40a1290 con 0x7f83e4061380 2020-02-12T15:09:53.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f83e40630e0 0x7f83e4066870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f83e40630e0 0x7f83e4066870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51370/0 (socket says 172.21.15.180:51370) 2020-02-12T15:09:53.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 -- 172.21.15.180:0/1084904823 learned_addr learned my addr 172.21.15.180:0/1084904823 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:53.493 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e37fe700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e4061380 0x7f83e4145760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 -- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e4061380 msgr2=0x7f83e4145760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e4061380 0x7f83e4145760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 -- 172.21.15.180:0/1084904823 >> v1:172.21.15.105:6789/0 conn(0x7f83e4145bc0 legacy=0x7f83e4066cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 -- 172.21.15.180:0/1084904823 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83e41323f0 con 0x7f83e40630e0 2020-02-12T15:09:53.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> v2:172.21.15.180:3300/0 conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.494 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> v2:172.21.15.180:3300/0 conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e0ff9700 1 -- 172.21.15.180:0/1084904823 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d8005e90 con 0x7f83e40630e0 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e0ff9700 1 -- 172.21.15.180:0/1084904823 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83d8007160 con 0x7f83e40630e0 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83e40a02a0 con 0x7f83e40630e0 2020-02-12T15:09:53.495 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83e0ff9700 1 -- 172.21.15.180:0/1084904823 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f83d8007580 con 0x7f83e40630e0 2020-02-12T15:09:53.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.480+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83e40a0df0 con 0x7f83e40630e0 2020-02-12T15:09:53.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.481+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.481+0000 7f83e0ff9700 1 -- 172.21.15.180:0/1084904823 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f83d8009480 con 0x7f83e40630e0 2020-02-12T15:09:53.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.481+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.481+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83e40a0700 con 0x7f83e40630e0 2020-02-12T15:09:53.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.481+0000 7f83e0ff9700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83c4039c80 0x7f83c403c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:53.496 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.481+0000 7f83e0ff9700 1 -- 172.21.15.180:0/1084904823 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f83d8049fe0 con 0x7f83e40630e0 2020-02-12T15:09:53.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.481+0000 7f83e37fe700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83c4039c80 0x7f83c403c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:53.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.482+0000 7f83e37fe700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83c4039c80 0x7f83c403c140 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:53.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.485+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.497 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.485+0000 7f83e0ff9700 1 -- 172.21.15.180:0/1084904823 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f83d802f550 con 0x7f83e40630e0 2020-02-12T15:09:53.661 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.659+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f83e40565b0 con 0x7f83e40630e0 2020-02-12T15:09:53.662 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.660+0000 7f83e2ffd700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=THROTTLE_DONE pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:53.662 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.660+0000 7f83e0ff9700 1 -- 172.21.15.180:0/1084904823 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+2137 (secure 0 0 0) 0x7f83d8032060 con 0x7f83e40630e0 2020-02-12T15:09:53.662 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:53.663 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.180:6833/1572130938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6832","nonce":1572130938},{"type":"v1","addr":"172.21.15.180:6833","nonce":1572130938}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-12T15:09:42.737856+0000","modified":"2020-02-12T15:09:46.437448+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.105:6835/218853727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":218853727},{"type":"v1","addr":"172.21.15.105:6835","nonce":218853727}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-12T15:09:53.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83c4039c80 msgr2=0x7f83c403c140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83c4039c80 0x7f83c403c140 crc :-1 s=READY pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 msgr2=0x7f83e4066870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:53.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 secure :-1 s=READY pgs=189 cs=0 l=1 rx=0x7f83d8002f30 tx=0x7f83d8010d10).stop 2020-02-12T15:09:53.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 shutdown_connections 2020-02-12T15:09:53.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f83c4039c80 0x7f83c403c140 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.664 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f83e4061380 0x7f83e4145760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 --2- 172.21.15.180:0/1084904823 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f83e40630e0 0x7f83e4066870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:53.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 >> 172.21.15.180:0/1084904823 conn(0x7f83e409d450 msgr2=0x7f83e40698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:53.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 shutdown_connections 2020-02-12T15:09:53.665 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:53.661+0000 7f83ea187700 1 -- 172.21.15.180:0/1084904823 wait complete. 2020-02-12T15:09:53.665 INFO:teuthology.orchestra.run.smithi180.stderr:dumped fsmap epoch 6 2020-02-12T15:09:53.875 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4308}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 6, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4308': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4308, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 218853727, u'type': u'v2', u'addr': u'172.21.15.105:6834'}, {u'nonce': 218853727, u'type': u'v1', u'addr': u'172.21.15.105:6835'}]}, u'addr': u'172.21.15.105:6835/218853727'}}, u'fs_name': u'cephfs', u'created': u'2020-02-12T15:09:42.737856+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-02-12T15:09:46.437448+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-02-12T15:09:53.876 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-02-12T15:09:53.876 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-02-12T15:09:54.004 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-02-12T15:09:54.004 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "c77fb549-2ffe-4090-8606-e21e8ca1873f", 2020-02-12T15:09:54.004 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2020-02-12T15:09:54.004 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4308, 2020-02-12T15:09:54.004 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2020-02-12T15:09:54.005 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2020-02-12T15:09:54.005 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 8.5643622690000001, 2020-02-12T15:09:54.005 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 6, 2020-02-12T15:09:54.005 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 24, 2020-02-12T15:09:54.005 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 24, 2020-02-12T15:09:54.005 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 8.8858242749999992 2020-02-12T15:09:54.005 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-02-12T15:09:54.012 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "c77fb549-2ffe-4090-8606-e21e8ca1873f", "whoami": 0, "id": 4308, "want_state": "up:active", "state": "up:active", "rank_uptime": 8.5643622690000001, "mdsmap_epoch": 6, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 8.8858242749999992 } 2020-02-12T15:09:54.013 INFO:teuthology.run_tasks:Running task exec... 2020-02-12T15:09:54.046 INFO:teuthology.task.exec:Executing custom commands... 2020-02-12T15:09:54.046 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi180.front.sepia.ceph.com 2020-02-12T15:09:54.046 INFO:teuthology.orchestra.run.smithi180:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo ceph fs set cephfs inline_data true --yes-i-really-really-mean-it' 2020-02-12T15:09:54.193 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.165+0000 7f9edf41e700 1 Processor -- start 2020-02-12T15:09:54.193 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9edf41e700 1 -- start start 2020-02-12T15:09:54.193 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9edf41e700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f9ed805b140 0x7f9ed80a5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:54.193 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9edf41e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed8067170 con 0x7f9ed80a60d0 2020-02-12T15:09:54.193 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9edf41e700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed80a51c0 con 0x7f9ed80a01d0 2020-02-12T15:09:54.194 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9edf41e700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed80a4f20 con 0x7f9ed805b140 2020-02-12T15:09:54.194 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9edd9bb700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f9ed805b140 0x7f9ed80a5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.194 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9ede1bc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f9ed80a01d0 0x7f9ed80a0620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42890/0 (socket says 172.21.15.180:42890) 2020-02-12T15:09:54.195 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.166+0000 7f9ede1bc700 1 -- 172.21.15.180:0/1617947038 learned_addr learned my addr 172.21.15.180:0/1617947038 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:54.195 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 -- 172.21.15.180:0/1617947038 >> v1:172.21.15.180:6789/0 conn(0x7f9ed80a01d0 legacy=0x7f9ed80a0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.195 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 -- 172.21.15.180:0/1617947038 >> v1:172.21.15.105:6789/0 conn(0x7f9ed80a60d0 legacy=0x7f9ed809fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:54.195 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edc9b9700 1 -- 172.21.15.180:0/1617947038 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 541354946 0 0) 0x7f9ed80a51c0 con 0x7f9ed80a01d0 2020-02-12T15:09:54.195 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 -- 172.21.15.180:0/1617947038 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed807fdd0 con 0x7f9ed805b140 2020-02-12T15:09:54.195 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1617947038 >> v2:172.21.15.180:3300/0 conn(0x7f9ed805b140 0x7f9ed80a5c70 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f9ed809e9d0 tx=0x7f9ed4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.195 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1617947038 >> v2:172.21.15.180:3300/0 conn(0x7f9ed805b140 0x7f9ed80a5c70 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f9ed809e9d0 tx=0x7f9ed4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.196 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1617947038 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ed805b140 0x7f9ed80a5c70 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f9ed809e9d0 tx=0x7f9ed4008c60).ready entity=mon.1 client_cookie=f84fe298a80f9c12 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.196 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1617947038 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ed805b140 0x7f9ed80a5c70 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f9ed809e9d0 tx=0x7f9ed4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.196 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edc9b9700 1 -- 172.21.15.180:0/1617947038 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed4010e60 con 0x7f9ed805b140 2020-02-12T15:09:54.196 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1617947038 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ed805b140 0x7f9ed80a5c70 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f9ed809e9d0 tx=0x7f9ed4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.196 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edc9b9700 1 -- 172.21.15.180:0/1617947038 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed40110c0 con 0x7f9ed805b140 2020-02-12T15:09:54.196 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1617947038 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ed805b140 0x7f9ed80a5c70 secure :-1 s=THROTTLE_DONE pgs=191 cs=0 l=1 rx=0x7f9ed809e9d0 tx=0x7f9ed4008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.196 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edc9b9700 1 -- 172.21.15.180:0/1617947038 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ed4011420 con 0x7f9ed805b140 2020-02-12T15:09:54.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edf41e700 1 -- 172.21.15.180:0/1617947038 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ed805b140 msgr2=0x7f9ed80a5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edf41e700 1 --2- 172.21.15.180:0/1617947038 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ed805b140 0x7f9ed80a5c70 secure :-1 s=READY pgs=191 cs=0 l=1 rx=0x7f9ed809e9d0 tx=0x7f9ed4008c60).stop 2020-02-12T15:09:54.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edf41e700 1 -- 172.21.15.180:0/1617947038 shutdown_connections 2020-02-12T15:09:54.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edf41e700 1 --2- 172.21.15.180:0/1617947038 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ed805b140 0x7f9ed80a5c70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edf41e700 1 -- 172.21.15.180:0/1617947038 >> 172.21.15.180:0/1617947038 conn(0x7f9ed805c3a0 msgr2=0x7f9ed805a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:54.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edf41e700 1 -- 172.21.15.180:0/1617947038 shutdown_connections 2020-02-12T15:09:54.197 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.167+0000 7f9edf41e700 1 -- 172.21.15.180:0/1617947038 wait complete. 2020-02-12T15:09:54.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.168+0000 7f9edf41e700 1 Processor -- start 2020-02-12T15:09:54.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9edf41e700 1 -- start start 2020-02-12T15:09:54.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9edf41e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f9ed805b140 0x7f9ed80648e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9edf41e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed809ff10 con 0x7f9ed80a01d0 2020-02-12T15:09:54.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9edf41e700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ed8061370 con 0x7f9ed80a60d0 2020-02-12T15:09:54.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9edf41e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ed8061610 con 0x7f9ed805b140 2020-02-12T15:09:54.198 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9ede1bc700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f9ed80a60d0 0x7f9ed8134610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42898/0 (socket says 172.21.15.180:42898) 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9ede1bc700 1 -- 172.21.15.180:0/1306550185 learned_addr learned my addr 172.21.15.180:0/1306550185 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1306550185 >> v2:172.21.15.105:3300/0 conn(0x7f9ed805b140 0x7f9ed80648e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4229468470 0 0) 0x7f9ed8061370 con 0x7f9ed80a60d0 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.169+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9ec0003230 con 0x7f9ed80a60d0 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v1:172.21.15.180:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 935+0+0 (unknown 3842530750 0 0) 0x7f9ec0003230 con 0x7f9ed80a60d0 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 --> v1:172.21.15.180:6789/0 -- auth(proto 2 165 bytes epoch 0) v1 -- 0x7f9ed8061370 con 0x7f9ed80a60d0 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v1:172.21.15.180:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 4132934812 0 0) 0x7f9ed0001860 con 0x7f9ed80a60d0 2020-02-12T15:09:54.199 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 >> v2:172.21.15.105:3300/0 conn(0x7f9ed805b140 msgr2=0x7f9ed80648e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 --2- 172.21.15.180:0/1306550185 >> v2:172.21.15.105:3300/0 conn(0x7f9ed805b140 0x7f9ed80648e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 >> v1:172.21.15.180:6789/0 conn(0x7f9ed80a60d0 legacy=0x7f9ed8134610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 >> v1:172.21.15.105:6789/0 conn(0x7f9ed80a01d0 legacy=0x7f9ed80661a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec00037f0 0x7f9ec0003c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec0004d70 0x7f9ec000b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.200 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ed8061610 con 0x7f9ec00037f0 2020-02-12T15:09:54.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec00051f0 con 0x7f9ec00044d0 2020-02-12T15:09:54.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ec000bb80 con 0x7f9ec0004d70 2020-02-12T15:09:54.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec00037f0 0x7f9ec0003c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ede1bc700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec0004d70 0x7f9ec000b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 -- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec0004d70 msgr2=0x7f9ec000b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.201 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec0004d70 0x7f9ec000b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 -- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec00037f0 msgr2=0x7f9ec0003c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f9ec00037f0 0x7f9ec0003c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80618b0 con 0x7f9ec00044d0 2020-02-12T15:09:54.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ed8061b50 con 0x7f9ec00044d0 2020-02-12T15:09:54.202 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ede1bc700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9ec0004d70 0x7f9ec000b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:54.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ede1bc700 1 -- 172.21.15.180:0/1306550185 reap_dead start 2020-02-12T15:09:54.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.206 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec80089d0 con 0x7f9ec00044d0 2020-02-12T15:09:54.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ec8008b30 con 0x7f9ec00044d0 2020-02-12T15:09:54.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ec8007160 con 0x7f9ec00044d0 2020-02-12T15:09:54.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.170+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ed8062ce0 con 0x7f9ec00044d0 2020-02-12T15:09:54.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.171+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.207 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.171+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f9ec80072c0 con 0x7f9ec00044d0 2020-02-12T15:09:54.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.171+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.171+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ed8062f90 con 0x7f9ec00044d0 2020-02-12T15:09:54.208 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.171+0000 7f9ece7fc700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9ec003dba0 0x7f9ec0040060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.214 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.171+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9ec8049480 con 0x7f9ec00044d0 2020-02-12T15:09:54.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.171+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9ec003dba0 0x7f9ec0040060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.172+0000 7f9edd9bb700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9ec003dba0 0x7f9ec0040060 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.175+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.215 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.175+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f9ec802eb70 con 0x7f9ec00044d0 2020-02-12T15:09:54.354 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.352+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f9ed8061ce0 con 0x7f9ec00044d0 2020-02-12T15:09:54.464 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.461+0000 7f9edd1ba700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=THROTTLE_DONE pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.465 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.462+0000 7f9ece7fc700 1 -- 172.21.15.180:0/1306550185 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "true", "yes_i_really_really_mean_it": true}]=0 inline data enabled v7) v1 ==== 168+0+0 (secure 0 0 0) 0x7f9ec8031680 con 0x7f9ec00044d0 2020-02-12T15:09:54.466 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9ec003dba0 msgr2=0x7f9ec0040060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.466 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9ec003dba0 0x7f9ec0040060 crc :-1 s=READY pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.466 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 msgr2=0x7f9ec0004910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.466 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 secure :-1 s=READY pgs=193 cs=0 l=1 rx=0x7f9ed805fb10 tx=0x7f9ed8069480).stop 2020-02-12T15:09:54.466 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 shutdown_connections 2020-02-12T15:09:54.466 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f9ec003dba0 0x7f9ec0040060 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.467 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 --2- 172.21.15.180:0/1306550185 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f9ec00044d0 0x7f9ec0004910 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.467 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 >> 172.21.15.180:0/1306550185 conn(0x7f9ed805c3a0 msgr2=0x7f9ed80a4770 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:54.467 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 shutdown_connections 2020-02-12T15:09:54.467 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.463+0000 7f9edf41e700 1 -- 172.21.15.180:0/1306550185 wait complete. 2020-02-12T15:09:54.467 INFO:teuthology.orchestra.run.smithi180.stderr:inline data enabled 2020-02-12T15:09:54.477 INFO:teuthology.run_tasks:Running task ceph-fuse... 2020-02-12T15:09:54.506 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2020-02-12T15:09:54.507 INFO:tasks.ceph_fuse:config is None 2020-02-12T15:09:54.507 INFO:tasks.ceph_fuse:new config is {'client.0': None} 2020-02-12T15:09:54.507 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2020-02-12T15:09:54.507 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd dump --format=json 2020-02-12T15:09:54.613 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.610+0000 7feaa4fdb700 1 Processor -- start 2020-02-12T15:09:54.613 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.610+0000 7feaa4fdb700 1 -- start start 2020-02-12T15:09:54.622 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7feaa4fdb700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7feaa00aac00 0x7feaa009e410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:54.623 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7feaa4fdb700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7feaa00a7570 0x7feaa012ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:54.623 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7feaa4fdb700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa0130380 con 0x7feaa00a70c0 2020-02-12T15:09:54.623 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7feaa4fdb700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa009ec00 con 0x7feaa00a7570 2020-02-12T15:09:54.623 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7feaa4fdb700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa00a4be0 con 0x7feaa00aac00 2020-02-12T15:09:54.624 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9e59c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7feaa00aac00 0x7feaa009e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.624 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9e59c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7feaa00aac00 0x7feaa009e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51394/0 (socket says 172.21.15.180:51394) 2020-02-12T15:09:54.624 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9e59c700 1 -- 172.21.15.180:0/4160962725 learned_addr learned my addr 172.21.15.180:0/4160962725 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:54.624 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9ed9d700 1 --2- 172.21.15.180:0/4160962725 >> v2:172.21.15.105:3300/0 conn(0x7feaa00a7570 0x7feaa012ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.624 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9e59c700 1 -- 172.21.15.180:0/4160962725 >> v2:172.21.15.105:3300/0 conn(0x7feaa00a7570 msgr2=0x7feaa012ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:54.625 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9e59c700 1 --2- 172.21.15.180:0/4160962725 >> v2:172.21.15.105:3300/0 conn(0x7feaa00a7570 0x7feaa012ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:54.625 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9e59c700 1 -- 172.21.15.180:0/4160962725 >> v1:172.21.15.105:6789/0 conn(0x7feaa00a70c0 legacy=0x7feaa012f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.625 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.611+0000 7fea9e59c700 1 -- 172.21.15.180:0/4160962725 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00a4e80 con 0x7feaa00aac00 2020-02-12T15:09:54.625 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9e59c700 1 --2- 172.21.15.180:0/4160962725 >> v2:172.21.15.180:3300/0 conn(0x7feaa00aac00 0x7feaa009e410 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9e59c700 1 --2- 172.21.15.180:0/4160962725 >> v2:172.21.15.180:3300/0 conn(0x7feaa00aac00 0x7feaa009e410 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9e59c700 1 --2- 172.21.15.180:0/4160962725 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00aac00 0x7feaa009e410 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).ready entity=mon.1 client_cookie=c74ebccf67641f69 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9e59c700 1 --2- 172.21.15.180:0/4160962725 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00aac00 0x7feaa009e410 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.626 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9d59a700 1 -- 172.21.15.180:0/4160962725 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea94011670 con 0x7feaa00aac00 2020-02-12T15:09:54.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9e59c700 1 --2- 172.21.15.180:0/4160962725 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00aac00 0x7feaa009e410 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9e59c700 1 --2- 172.21.15.180:0/4160962725 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00aac00 0x7feaa009e410 secure :-1 s=THROTTLE_DONE pgs=194 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9d59a700 1 -- 172.21.15.180:0/4160962725 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea940117d0 con 0x7feaa00aac00 2020-02-12T15:09:54.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7fea9d59a700 1 -- 172.21.15.180:0/4160962725 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea94011bb0 con 0x7feaa00aac00 2020-02-12T15:09:54.627 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 -- 172.21.15.180:0/4160962725 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00aac00 msgr2=0x7feaa009e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/4160962725 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00aac00 0x7feaa009e410 secure :-1 s=READY pgs=194 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).stop 2020-02-12T15:09:54.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 -- 172.21.15.180:0/4160962725 shutdown_connections 2020-02-12T15:09:54.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/4160962725 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00aac00 0x7feaa009e410 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.628 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/4160962725 >> v2:172.21.15.105:3300/0 conn(0x7feaa00a7570 0x7feaa012ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:54.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 -- 172.21.15.180:0/4160962725 >> 172.21.15.180:0/4160962725 conn(0x7feaa009d450 msgr2=0x7feaa009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:54.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 -- 172.21.15.180:0/4160962725 shutdown_connections 2020-02-12T15:09:54.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.612+0000 7feaa4fdb700 1 -- 172.21.15.180:0/4160962725 wait complete. 2020-02-12T15:09:54.629 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.613+0000 7feaa4fdb700 1 Processor -- start 2020-02-12T15:09:54.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.613+0000 7feaa4fdb700 1 -- start start 2020-02-12T15:09:54.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7feaa4fdb700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7feaa00a70c0 0x7feaa012a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7feaa4fdb700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaa00a7570 0x7feaa012ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7feaa4fdb700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaa012afb0 con 0x7feaa00aac00 2020-02-12T15:09:54.630 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7feaa4fdb700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaa0066280 con 0x7feaa00a70c0 2020-02-12T15:09:54.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7feaa4fdb700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaa0065590 con 0x7feaa00a7570 2020-02-12T15:09:54.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7feaa00a70c0 0x7feaa012a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7feaa00a70c0 0x7feaa012a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51400/0 (socket says 172.21.15.180:51400) 2020-02-12T15:09:54.631 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 -- 172.21.15.180:0/902599977 learned_addr learned my addr 172.21.15.180:0/902599977 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:54.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9dd9b700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaa00a7570 0x7feaa012ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 -- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaa00a7570 msgr2=0x7feaa012ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaa00a7570 0x7feaa012ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.632 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 -- 172.21.15.180:0/902599977 >> v1:172.21.15.105:6789/0 conn(0x7feaa00aac00 legacy=0x7feaa00a2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 -- 172.21.15.180:0/902599977 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaa00664e0 con 0x7feaa00a70c0 2020-02-12T15:09:54.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> v2:172.21.15.180:3300/0 conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> v2:172.21.15.180:3300/0 conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.633 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.634 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.634 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.634 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea8f7fe700 1 -- 172.21.15.180:0/902599977 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea94011e20 con 0x7feaa00a70c0 2020-02-12T15:09:54.634 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea8f7fe700 1 -- 172.21.15.180:0/902599977 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea94007340 con 0x7feaa00a70c0 2020-02-12T15:09:54.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7fea8f7fe700 1 -- 172.21.15.180:0/902599977 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea940056c0 con 0x7feaa00a70c0 2020-02-12T15:09:54.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaa005af00 con 0x7feaa00a70c0 2020-02-12T15:09:54.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.614+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaa01339d0 con 0x7feaa00a70c0 2020-02-12T15:09:54.635 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.615+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.615+0000 7fea8f7fe700 1 -- 172.21.15.180:0/902599977 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7fea94005930 con 0x7feaa00a70c0 2020-02-12T15:09:54.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.615+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.616+0000 7fea8f7fe700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fea7c039bb0 0x7fea7c03c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.616+0000 7fea8f7fe700 1 -- 172.21.15.180:0/902599977 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7fea94049c80 con 0x7feaa00a70c0 2020-02-12T15:09:54.636 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.616+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaa01339d0 con 0x7feaa00a70c0 2020-02-12T15:09:54.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.616+0000 7fea9dd9b700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fea7c039bb0 0x7fea7c03c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.616+0000 7fea9dd9b700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fea7c039bb0 0x7fea7c03c070 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.619+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.637 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.619+0000 7fea8f7fe700 1 -- 172.21.15.180:0/902599977 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7feaa01339d0 con 0x7feaa00a70c0 2020-02-12T15:09:54.758 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.756+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7feaa01339d0 con 0x7feaa00a70c0 2020-02-12T15:09:54.759 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.756+0000 7fea9e59c700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=THROTTLE_DONE pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.759 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.756+0000 7fea8f7fe700 1 -- 172.21.15.180:0/902599977 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) v1 ==== 74+0+14981 (secure 0 0 0) 0x7feaa01339d0 con 0x7feaa00a70c0 2020-02-12T15:09:54.759 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:54.759 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":24,"fsid":"c77fb549-2ffe-4090-8606-e21e8ca1873f","created":"2020-02-12T15:09:21.607512+0000","modified":"2020-02-12T15:09:43.739063+0000","last_up_change":"2020-02-12T15:09:30.504965+0000","last_in_change":"2020-02-12T15:09:30.504965+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2020-02-12T15:09:34.556683+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2020-02-12T15:09:37.409320+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2020-02-12T15:09:40.417450+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"4df100fd-8809-4246-a50a-3070bb4eebff","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6800","nonce":20943},{"type":"v1","addr":"172.21.15.180:6801","nonce":20943}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6802","nonce":20943},{"type":"v1","addr":"172.21.15.180:6803","nonce":20943}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6806","nonce":20943},{"type":"v1","addr":"172.21.15.180:6807","nonce":20943}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6804","nonce":20943},{"type":"v1","addr":"172.21.15.180:6805","nonce":20943}]},"public_addr":"172.21.15.180:6801/20943","cluster_addr":"172.21.15.180:6803/20943","heartbeat_back_addr":"172.21.15.180:6807/20943","heartbeat_front_addr":"172.21.15.180:6805/20943","state":["exists","up"]},{"osd":1,"uuid":"28d21319-600f-477f-9281-588b2f1d929c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6808","nonce":20944},{"type":"v1","addr":"172.21.15.180:6809","nonce":20944}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6810","nonce":20944},{"type":"v1","addr":"172.21.15.180:6811","nonce":20944}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6814","nonce":20944},{"type":"v1","addr":"172.21.15.180:6815","nonce":20944}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6812","nonce":20944},{"type":"v1","addr":"172.21.15.180:6813","nonce":20944}]},"public_addr":"172.21.15.180:6809/20944","cluster_addr":"172.21.15.180:6811/20944","heartbeat_back_addr":"172.21.15.180:6815/20944","heartbeat_front_addr":"172.21.15.180:6813/20944","state":["exists","up"]},{"osd":2,"uuid":"9e54fd0f-70fd-4edc-8fc5-fee610a01d5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6816","nonce":20953},{"type":"v1","addr":"172.21.15.180:6817","nonce":20953}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6818","nonce":20953},{"type":"v1","addr":"172.21.15.180:6819","nonce":20953}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6822","nonce":20953},{"type":"v1","addr":"172.21.15.180:6823","nonce":20953}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6820","nonce":20953},{"type":"v1","addr":"172.21.15.180:6821","nonce":20953}]},"public_addr":"172.21.15.180:6817/20953","cluster_addr":"172.21.15.180:6819/20953","heartbeat_back_addr":"172.21.15.180:6823/20953","heartbeat_front_addr":"172.21.15.180:6821/20953","state":["exists","up"]},{"osd":3,"uuid":"92456651-4a29-4c77-831c-f41578383662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6824","nonce":20974},{"type":"v1","addr":"172.21.15.180:6825","nonce":20974}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6826","nonce":20974},{"type":"v1","addr":"172.21.15.180:6827","nonce":20974}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6830","nonce":20974},{"type":"v1","addr":"172.21.15.180:6831","nonce":20974}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6828","nonce":20974},{"type":"v1","addr":"172.21.15.180:6829","nonce":20974}]},"public_addr":"172.21.15.180:6825/20974","cluster_addr":"172.21.15.180:6827/20974","heartbeat_back_addr":"172.21.15.180:6831/20974","heartbeat_front_addr":"172.21.15.180:6829/20974","state":["exists","up"]},{"osd":4,"uuid":"c4f6127f-eb03-4fd1-a750-64069fc04f5a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6818","nonce":22604},{"type":"v1","addr":"172.21.15.105:6819","nonce":22604}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6820","nonce":22604},{"type":"v1","addr":"172.21.15.105:6821","nonce":22604}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6824","nonce":22604},{"type":"v1","addr":"172.21.15.105:6825","nonce":22604}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6822","nonce":22604},{"type":"v1","addr":"172.21.15.105:6823","nonce":22604}]},"public_addr":"172.21.15.105:6819/22604","cluster_addr":"172.21.15.105:6821/22604","heartbeat_back_addr":"172.21.15.105:6825/22604","heartbeat_front_addr":"172.21.15.105:6823/22604","state":["exists","up"]},{"osd":5,"uuid":"0555444c-f7af-429e-8386-d1b9c43ece8c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6802","nonce":22574},{"type":"v1","addr":"172.21.15.105:6803","nonce":22574}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6804","nonce":22574},{"type":"v1","addr":"172.21.15.105:6805","nonce":22574}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6808","nonce":22574},{"type":"v1","addr":"172.21.15.105:6809","nonce":22574}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6806","nonce":22574},{"type":"v1","addr":"172.21.15.105:6807","nonce":22574}]},"public_addr":"172.21.15.105:6803/22574","cluster_addr":"172.21.15.105:6805/22574","heartbeat_back_addr":"172.21.15.105:6809/22574","heartbeat_front_addr":"172.21.15.105:6807/22574","state":["exists","up"]},{"osd":6,"uuid":"de4e35a2-4f35-47e5-84e7-a98c47c621f2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6810","nonce":22575},{"type":"v1","addr":"172.21.15.105:6811","nonce":22575}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6812","nonce":22575},{"type":"v1","addr":"172.21.15.105:6813","nonce":22575}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6816","nonce":22575},{"type":"v1","addr":"172.21.15.105:6817","nonce":22575}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6814","nonce":22575},{"type":"v1","addr":"172.21.15.105:6815","nonce":22575}]},"public_addr":"172.21.15.105:6811/22575","cluster_addr":"172.21.15.105:6813/22575","heartbeat_back_addr":"172.21.15.105:6817/22575","heartbeat_front_addr":"172.21.15.105:6815/22575","state":["exists","up"]},{"osd":7,"uuid":"f6e6b6ee-21c4-4ffd-a3cb-6b011377ccf5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6826","nonce":22605},{"type":"v1","addr":"172.21.15.105:6827","nonce":22605}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6828","nonce":22605},{"type":"v1","addr":"172.21.15.105:6829","nonce":22605}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6832","nonce":22605},{"type":"v1","addr":"172.21.15.105:6833","nonce":22605}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6830","nonce":22605},{"type":"v1","addr":"172.21.15.105:6831","nonce":22605}]},"public_addr":"172.21.15.105:6827/22605","cluster_addr":"172.21.15.105:6829/22605","heartbeat_back_addr":"172.21.15.105:6833/22605","heartbeat_front_addr":"172.21.15.105:6831/22605","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.786458+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.774321+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.830852+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.784418+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.771502+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.804659+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.828648+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2020-02-12T15:09:28.846220+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"cephfs_data":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2020-02-12T15:09:54.760 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fea7c039bb0 msgr2=0x7fea7c03c070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.761 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fea7c039bb0 0x7fea7c03c070 crc :-1 s=READY pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.761 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 msgr2=0x7feaa012a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.761 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 secure :-1 s=READY pgs=195 cs=0 l=1 rx=0x7fea94002f30 tx=0x7fea94007a40).stop 2020-02-12T15:09:54.761 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 shutdown_connections 2020-02-12T15:09:54.761 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7fea7c039bb0 0x7fea7c03c070 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.762 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7feaa00a70c0 0x7feaa012a6f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.762 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 --2- 172.21.15.180:0/902599977 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7feaa00a7570 0x7feaa012ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.762 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 >> 172.21.15.180:0/902599977 conn(0x7feaa009d450 msgr2=0x7feaa009e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:54.762 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 shutdown_connections 2020-02-12T15:09:54.762 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.758+0000 7feaa4fdb700 1 -- 172.21.15.180:0/902599977 wait complete. 2020-02-12T15:09:54.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:34.556683+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'17', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:37.409320+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'cephfs_metadata', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 2, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'metadata': u'cephfs'}}, u'options': {u'pg_autoscale_bias': 4, u'recovery_priority': 5, u'pg_num_min': 16}, u'hit_set_count': 0, u'flags': 1, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'23', u'min_write_recency_for_promote': 0, u'read_tier': -1}, {u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 8192, u'flags_names': u'hashpspool,ec_overwrites', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2020-02-12T15:09:40.417450+0000', u'snap_epoch': 0, u'erasure_code_profile': u'cephfs_data', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 4, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 3, u'grade_table': [], u'pool_name': u'cephfs_data', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 3, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 3, u'removed_snaps': u'[]', u'crush_rule': 1, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'cephfs': {u'data': u'cephfs'}}, u'options': {}, u'hit_set_count': 0, u'flags': 5, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'24', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2020-02-12T15:09:54.772 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get rbd pg_num 2020-02-12T15:09:54.880 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.878+0000 7f43bf18d700 1 Processor -- start 2020-02-12T15:09:54.881 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.878+0000 7f43bf18d700 1 -- start start 2020-02-12T15:09:54.883 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bf18d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f43b80a2e40 0x7f43b80a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:54.883 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bf18d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f43b8131a40 0x7f43b8131ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:54.883 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bf18d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b80a22f0 con 0x7f43b80a5f50 2020-02-12T15:09:54.884 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bf18d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80a2590 con 0x7f43b8131a40 2020-02-12T15:09:54.884 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bf18d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b80a2830 con 0x7f43b80a2e40 2020-02-12T15:09:54.884 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f43b80a2e40 0x7f43b80a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.884 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f43b80a2e40 0x7f43b80a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51408/0 (socket says 172.21.15.180:51408) 2020-02-12T15:09:54.884 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 -- 172.21.15.180:0/2719513900 learned_addr learned my addr 172.21.15.180:0/2719513900 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:54.884 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bd72a700 1 --2- 172.21.15.180:0/2719513900 >> v2:172.21.15.105:3300/0 conn(0x7f43b8131a40 0x7f43b8131ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.884 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 -- 172.21.15.180:0/2719513900 >> v2:172.21.15.105:3300/0 conn(0x7f43b8131a40 msgr2=0x7f43b8131ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:54.885 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- 172.21.15.180:0/2719513900 >> v2:172.21.15.105:3300/0 conn(0x7f43b8131a40 0x7f43b8131ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:54.885 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 -- 172.21.15.180:0/2719513900 >> v1:172.21.15.105:6789/0 conn(0x7f43b80a5f50 legacy=0x7f43b80a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:54.885 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 -- 172.21.15.180:0/2719513900 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80a63e0 con 0x7f43b80a2e40 2020-02-12T15:09:54.885 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- 172.21.15.180:0/2719513900 >> v2:172.21.15.180:3300/0 conn(0x7f43b80a2e40 0x7f43b80a15e0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f43b80a3af0 tx=0x7f43a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.885 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- 172.21.15.180:0/2719513900 >> v2:172.21.15.180:3300/0 conn(0x7f43b80a2e40 0x7f43b80a15e0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f43b80a3af0 tx=0x7f43a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.885 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- 172.21.15.180:0/2719513900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a2e40 0x7f43b80a15e0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f43b80a3af0 tx=0x7f43a8007a40).ready entity=mon.1 client_cookie=2b8344bb401e3efc server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.885 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- 172.21.15.180:0/2719513900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a2e40 0x7f43b80a15e0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f43b80a3af0 tx=0x7f43a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.886 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43b77fe700 1 -- 172.21.15.180:0/2719513900 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a80116e0 con 0x7f43b80a2e40 2020-02-12T15:09:54.886 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- 172.21.15.180:0/2719513900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a2e40 0x7f43b80a15e0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f43b80a3af0 tx=0x7f43a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.886 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43b77fe700 1 -- 172.21.15.180:0/2719513900 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43a8011840 con 0x7f43b80a2e40 2020-02-12T15:09:54.886 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bcf29700 1 --2- 172.21.15.180:0/2719513900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a2e40 0x7f43b80a15e0 secure :-1 s=THROTTLE_DONE pgs=196 cs=0 l=1 rx=0x7f43b80a3af0 tx=0x7f43a8007a40).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.886 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43b77fe700 1 -- 172.21.15.180:0/2719513900 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43a8011c20 con 0x7f43b80a2e40 2020-02-12T15:09:54.886 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bf18d700 1 -- 172.21.15.180:0/2719513900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a2e40 msgr2=0x7f43b80a15e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.887 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.879+0000 7f43bf18d700 1 --2- 172.21.15.180:0/2719513900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a2e40 0x7f43b80a15e0 secure :-1 s=READY pgs=196 cs=0 l=1 rx=0x7f43b80a3af0 tx=0x7f43a8007a40).stop 2020-02-12T15:09:54.887 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.880+0000 7f43bf18d700 1 -- 172.21.15.180:0/2719513900 shutdown_connections 2020-02-12T15:09:54.887 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.880+0000 7f43bf18d700 1 --2- 172.21.15.180:0/2719513900 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a2e40 0x7f43b80a15e0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.887 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.880+0000 7f43bf18d700 1 --2- 172.21.15.180:0/2719513900 >> v2:172.21.15.105:3300/0 conn(0x7f43b8131a40 0x7f43b8131ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:54.887 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.880+0000 7f43bf18d700 1 -- 172.21.15.180:0/2719513900 >> 172.21.15.180:0/2719513900 conn(0x7f43b805a530 msgr2=0x7f43b805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:54.887 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.880+0000 7f43bf18d700 1 -- 172.21.15.180:0/2719513900 shutdown_connections 2020-02-12T15:09:54.887 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.880+0000 7f43bf18d700 1 -- 172.21.15.180:0/2719513900 wait complete. 2020-02-12T15:09:54.888 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.881+0000 7f43bf18d700 1 Processor -- start 2020-02-12T15:09:54.888 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.881+0000 7f43bf18d700 1 -- start start 2020-02-12T15:09:54.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bf18d700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f43b80a2e40 0x7f43b8066670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bf18d700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f43b80a5f50 0x7f43b80657a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bf18d700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43b809dad0 con 0x7f43b8131a40 2020-02-12T15:09:54.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bf18d700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b808f690 con 0x7f43b80a2e40 2020-02-12T15:09:54.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bf18d700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43b808f930 con 0x7f43b80a5f50 2020-02-12T15:09:54.891 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f43b80a5f50 0x7f43b80657a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f43b80a5f50 0x7f43b80657a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51416/0 (socket says 172.21.15.180:51416) 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 -- 172.21.15.180:0/96415290 learned_addr learned my addr 172.21.15.180:0/96415290 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bcf29700 1 --2- 172.21.15.180:0/96415290 >> v2:172.21.15.105:3300/0 conn(0x7f43b80a2e40 0x7f43b8066670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 -- 172.21.15.180:0/96415290 >> v2:172.21.15.105:3300/0 conn(0x7f43b80a2e40 msgr2=0x7f43b8066670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> v2:172.21.15.105:3300/0 conn(0x7f43b80a2e40 0x7f43b8066670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 -- 172.21.15.180:0/96415290 >> v1:172.21.15.105:6789/0 conn(0x7f43b8131a40 legacy=0x7f43b8146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 -- 172.21.15.180:0/96415290 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b80a1700 con 0x7f43b80a5f50 2020-02-12T15:09:54.892 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> v2:172.21.15.180:3300/0 conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> v2:172.21.15.180:3300/0 conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b5ffb700 1 -- 172.21.15.180:0/96415290 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac0059f0 con 0x7f43b80a5f50 2020-02-12T15:09:54.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.893 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b5ffb700 1 -- 172.21.15.180:0/96415290 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43ac005b50 con 0x7f43b80a5f50 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43b808f2e0 con 0x7f43b80a5f50 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43b5ffb700 1 -- 172.21.15.180:0/96415290 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f43ac011290 con 0x7f43b80a5f50 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.882+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43b8147630 con 0x7f43b80a5f50 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.883+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.883+0000 7f43b5ffb700 1 -- 172.21.15.180:0/96415290 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f43ac011500 con 0x7f43b80a5f50 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.883+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.883+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43b80654e0 con 0x7f43b80a5f50 2020-02-12T15:09:54.894 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.883+0000 7f43b5ffb700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4398039c70 0x7f439803c130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:54.895 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.883+0000 7f43b5ffb700 1 -- 172.21.15.180:0/96415290 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f43ac049630 con 0x7f43b80a5f50 2020-02-12T15:09:54.895 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.883+0000 7f43bcf29700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4398039c70 0x7f439803c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:54.895 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.884+0000 7f43bcf29700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4398039c70 0x7f439803c130 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:54.895 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.887+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:54.895 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:54.887+0000 7f43b5ffb700 1 -- 172.21.15.180:0/96415290 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f43b80654e0 con 0x7f43b80a5f50 2020-02-12T15:09:55.028 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.023+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f43b8067ab0 con 0x7f43b80a5f50 2020-02-12T15:09:55.028 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.023+0000 7f43b7fff700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=THROTTLE_DONE pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.028 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.023+0000 7f43b5ffb700 1 -- 172.21.15.180:0/96415290 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v24) v1 ==== 92+0+10 (secure 0 0 0) 0x7f43ac02eaf0 con 0x7f43b80a5f50 2020-02-12T15:09:55.028 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:55.030 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4398039c70 msgr2=0x7f439803c130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.030 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4398039c70 0x7f439803c130 crc :-1 s=READY pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.030 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 msgr2=0x7f43b80657a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.030 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 secure :-1 s=READY pgs=197 cs=0 l=1 rx=0x7f43b809e3a0 tx=0x7f43ac0109a0).stop 2020-02-12T15:09:55.030 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 shutdown_connections 2020-02-12T15:09:55.030 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f4398039c70 0x7f439803c130 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.031 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 --2- 172.21.15.180:0/96415290 >> v2:172.21.15.105:3300/0 conn(0x7f43b80a2e40 0x7f43b8066670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.031 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 --2- 172.21.15.180:0/96415290 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f43b80a5f50 0x7f43b80657a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.031 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 >> 172.21.15.180:0/96415290 conn(0x7f43b805a530 msgr2=0x7f43b80a7520 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:55.031 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 shutdown_connections 2020-02-12T15:09:55.031 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.024+0000 7f43bf18d700 1 -- 172.21.15.180:0/96415290 wait complete. 2020-02-12T15:09:55.037 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_metadata pg_num 2020-02-12T15:09:55.146 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.143+0000 7f946e678700 1 Processor -- start 2020-02-12T15:09:55.146 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.143+0000 7f946e678700 1 -- start start 2020-02-12T15:09:55.149 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946e678700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94680a2e40 0x7f94680a15e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:55.149 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946e678700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:55.149 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946e678700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94680a22f0 con 0x7f94680a5f50 2020-02-12T15:09:55.149 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946e678700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94680a2590 con 0x7f94680a2e40 2020-02-12T15:09:55.149 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946e678700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680a2830 con 0x7f9468131a40 2020-02-12T15:09:55.149 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946cc15700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f9467fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94680a2e40 0x7f94680a15e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f945ffff700 1 --1- >> v1:172.21.15.105:6789/0 conn(0x7f94680a5f50 0x7f94680a0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.105:6789/0 says I am v1:172.21.15.180:37514/0 (socket says 172.21.15.180:37514) 2020-02-12T15:09:55.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946cc15700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3301/0 says I am v2:172.21.15.180:51568/0 (socket says 172.21.15.180:51568) 2020-02-12T15:09:55.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f9467fff700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f94680a2e40 0x7f94680a15e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.105:3300/0 says I am v2:172.21.15.180:38618/0 (socket says 172.21.15.180:38618) 2020-02-12T15:09:55.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f945ffff700 1 -- 172.21.15.180:0/2254536414 learned_addr learned my addr 172.21.15.180:0/2254536414 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:55.150 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946cc15700 1 -- 172.21.15.180:0/2254536414 >> v2:172.21.15.105:3300/0 conn(0x7f94680a2e40 msgr2=0x7f94680a15e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:55.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946cc15700 1 --2- 172.21.15.180:0/2254536414 >> v2:172.21.15.105:3300/0 conn(0x7f94680a2e40 0x7f94680a15e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:55.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946cc15700 1 -- 172.21.15.180:0/2254536414 >> v1:172.21.15.105:6789/0 conn(0x7f94680a5f50 legacy=0x7f94680a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f94677fe700 1 -- 172.21.15.180:0/2254536414 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3608162547 0 0) 0x7f94680a22f0 con 0x7f94680a5f50 2020-02-12T15:09:55.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f946cc15700 1 -- 172.21.15.180:0/2254536414 --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680a63e0 con 0x7f9468131a40 2020-02-12T15:09:55.151 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.144+0000 7f9467fff700 1 --2- 172.21.15.180:0/2254536414 >> v2:172.21.15.105:3300/0 conn(0x7f94680a2e40 0x7f94680a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_done state changed! 2020-02-12T15:09:55.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946cc15700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f94600032b0 tx=0x7f9460008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946cc15700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f94600032b0 tx=0x7f9460008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946cc15700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f94600032b0 tx=0x7f9460008c60).ready entity=mon.2 client_cookie=a623ff0871ebc991 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946cc15700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f94600032b0 tx=0x7f9460008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f94677fe700 1 -- 172.21.15.180:0/2254536414 <== mon.2 v2:172.21.15.105:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9460011e60 con 0x7f9468131a40 2020-02-12T15:09:55.152 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946cc15700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f94600032b0 tx=0x7f9460008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f94677fe700 1 -- 172.21.15.180:0/2254536414 <== mon.2 v2:172.21.15.105:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f946000a160 con 0x7f9468131a40 2020-02-12T15:09:55.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946cc15700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 secure :-1 s=THROTTLE_DONE pgs=42 cs=0 l=1 rx=0x7f94600032b0 tx=0x7f9460008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f94677fe700 1 -- 172.21.15.180:0/2254536414 <== mon.2 v2:172.21.15.105:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f946000a4c0 con 0x7f9468131a40 2020-02-12T15:09:55.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 -- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 msgr2=0x7f9468131ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 secure :-1 s=READY pgs=42 cs=0 l=1 rx=0x7f94600032b0 tx=0x7f9460008c60).stop 2020-02-12T15:09:55.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 -- 172.21.15.180:0/2254536414 shutdown_connections 2020-02-12T15:09:55.153 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 --2- 172.21.15.180:0/2254536414 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f9468131a40 0x7f9468131ea0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 --2- 172.21.15.180:0/2254536414 >> v2:172.21.15.105:3300/0 conn(0x7f94680a2e40 0x7f94680a15e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:55.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 -- 172.21.15.180:0/2254536414 >> 172.21.15.180:0/2254536414 conn(0x7f946805a530 msgr2=0x7f946805a940 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:55.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 -- 172.21.15.180:0/2254536414 shutdown_connections 2020-02-12T15:09:55.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.145+0000 7f946e678700 1 -- 172.21.15.180:0/2254536414 wait complete. 2020-02-12T15:09:55.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.146+0000 7f946e678700 1 Processor -- start 2020-02-12T15:09:55.154 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.146+0000 7f946e678700 1 -- start start 2020-02-12T15:09:55.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f946e678700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f94680a2e40 0x7f9468144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f946e678700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946809bfd0 con 0x7f94680a5f50 2020-02-12T15:09:55.157 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f946e678700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9468144860 con 0x7f9468131a40 2020-02-12T15:09:55.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f946e678700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9468144670 con 0x7f94680a2e40 2020-02-12T15:09:55.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f94680a2e40 0x7f9468144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f946cc15700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f9468131a40 0x7f946814caf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42946/0 (socket says 172.21.15.180:42946) 2020-02-12T15:09:55.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f94680a2e40 0x7f9468144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51428/0 (socket says 172.21.15.180:51428) 2020-02-12T15:09:55.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f946cc15700 1 -- 172.21.15.180:0/1980904016 learned_addr learned my addr 172.21.15.180:0/1980904016 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:55.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 -- 172.21.15.180:0/1980904016 >> v1:172.21.15.180:6789/0 conn(0x7f9468131a40 legacy=0x7f946814caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.158 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 -- 172.21.15.180:0/1980904016 >> v1:172.21.15.105:6789/0 conn(0x7f94680a5f50 legacy=0x7f9468145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1769230872 0 0) 0x7f9468144860 con 0x7f9468131a40 2020-02-12T15:09:55.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 -- 172.21.15.180:0/1980904016 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94681306a0 con 0x7f94680a2e40 2020-02-12T15:09:55.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> v2:172.21.15.180:3300/0 conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> v2:172.21.15.180:3300/0 conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.159 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458007540 con 0x7f94680a2e40 2020-02-12T15:09:55.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94580059c0 con 0x7f94680a2e40 2020-02-12T15:09:55.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9468134b90 con 0x7f94680a2e40 2020-02-12T15:09:55.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.147+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.148+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9458005d60 con 0x7f94680a2e40 2020-02-12T15:09:55.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.148+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94681466c0 con 0x7f94680a2e40 2020-02-12T15:09:55.160 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.148+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.148+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f9458012480 con 0x7f94680a2e40 2020-02-12T15:09:55.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.148+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.148+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9468067ab0 con 0x7f94680a2e40 2020-02-12T15:09:55.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.148+0000 7f9465ffb700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f944c03be50 0x7f944c03e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.149+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f9458049bc0 con 0x7f94680a2e40 2020-02-12T15:09:55.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.149+0000 7f945ffff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f944c03be50 0x7f944c03e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.161 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.149+0000 7f945ffff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f944c03be50 0x7f944c03e310 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.162 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.152+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.162 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.152+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f945802f230 con 0x7f94680a2e40 2020-02-12T15:09:55.287 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.285+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f946809c160 con 0x7f94680a2e40 2020-02-12T15:09:55.288 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.285+0000 7f9467fff700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=THROTTLE_DONE pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.288 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.285+0000 7f9465ffb700 1 -- 172.21.15.180:0/1980904016 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) v1 ==== 104+0+10 (secure 0 0 0) 0x7f9458031d40 con 0x7f94680a2e40 2020-02-12T15:09:55.288 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:55.289 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f944c03be50 msgr2=0x7f944c03e310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.289 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f944c03be50 0x7f944c03e310 crc :-1 s=READY pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.289 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 msgr2=0x7f9468144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 secure :-1 s=READY pgs=199 cs=0 l=1 rx=0x7f94680672a0 tx=0x7f9458010e20).stop 2020-02-12T15:09:55.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 shutdown_connections 2020-02-12T15:09:55.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f944c03be50 0x7f944c03e310 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 --2- 172.21.15.180:0/1980904016 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f94680a2e40 0x7f9468144d00 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.286+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 >> 172.21.15.180:0/1980904016 conn(0x7f946805a530 msgr2=0x7f94680698e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:55.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.287+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 shutdown_connections 2020-02-12T15:09:55.290 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.287+0000 7f946e678700 1 -- 172.21.15.180:0/1980904016 wait complete. 2020-02-12T15:09:55.299 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early osd pool get cephfs_data pg_num 2020-02-12T15:09:55.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.405+0000 7f970577e700 1 Processor -- start 2020-02-12T15:09:55.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.405+0000 7f970577e700 1 -- start start 2020-02-12T15:09:55.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f970577e700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f97000a7cb0 0x7f97000a3210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:55.415 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f970577e700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f970009aaa0 0x7f970009af50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f970577e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9700135200 con 0x7f97000a8090 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f970577e700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97000a3a00 con 0x7f97000a7cb0 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f970577e700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97001343b0 con 0x7f970009aaa0 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f970009aaa0 0x7f970009af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f970009aaa0 0x7f970009af50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51440/0 (socket says 172.21.15.180:51440) 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 -- 172.21.15.180:0/972918689 learned_addr learned my addr 172.21.15.180:0/972918689 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96feffd700 1 --2- 172.21.15.180:0/972918689 >> v2:172.21.15.105:3300/0 conn(0x7f97000a7cb0 0x7f97000a3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.416 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 -- 172.21.15.180:0/972918689 >> v2:172.21.15.105:3300/0 conn(0x7f97000a7cb0 msgr2=0x7f97000a3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2020-02-12T15:09:55.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/972918689 >> v2:172.21.15.105:3300/0 conn(0x7f97000a7cb0 0x7f97000a3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:55.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 -- 172.21.15.180:0/972918689 >> v1:172.21.15.105:6789/0 conn(0x7f97000a8090 legacy=0x7f9700134af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 -- 172.21.15.180:0/972918689 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700134650 con 0x7f970009aaa0 2020-02-12T15:09:55.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96feffd700 1 --2- 172.21.15.180:0/972918689 >> v2:172.21.15.105:3300/0 conn(0x7f97000a7cb0 0x7f97000a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).handle_auth_reply_more state changed! 2020-02-12T15:09:55.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/972918689 >> v2:172.21.15.180:3300/0 conn(0x7f970009aaa0 0x7f970009af50 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f96f80032b0 tx=0x7f96f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/972918689 >> v2:172.21.15.180:3300/0 conn(0x7f970009aaa0 0x7f970009af50 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f96f80032b0 tx=0x7f96f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.417 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/972918689 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f970009aaa0 0x7f970009af50 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f96f80032b0 tx=0x7f96f8007dc0).ready entity=mon.1 client_cookie=66368ae874dad1cc server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/972918689 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f970009aaa0 0x7f970009af50 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f96f80032b0 tx=0x7f96f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96fdffb700 1 -- 172.21.15.180:0/972918689 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96f800a160 con 0x7f970009aaa0 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/972918689 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f970009aaa0 0x7f970009af50 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f96f80032b0 tx=0x7f96f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/972918689 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f970009aaa0 0x7f970009af50 secure :-1 s=THROTTLE_DONE pgs=200 cs=0 l=1 rx=0x7f96f80032b0 tx=0x7f96f8007dc0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96fdffb700 1 -- 172.21.15.180:0/972918689 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f800a2c0 con 0x7f970009aaa0 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f96fdffb700 1 -- 172.21.15.180:0/972918689 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96f800a6a0 con 0x7f970009aaa0 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f970577e700 1 -- 172.21.15.180:0/972918689 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f970009aaa0 msgr2=0x7f970009af50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.418 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.406+0000 7f970577e700 1 --2- 172.21.15.180:0/972918689 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f970009aaa0 0x7f970009af50 secure :-1 s=READY pgs=200 cs=0 l=1 rx=0x7f96f80032b0 tx=0x7f96f8007dc0).stop 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.407+0000 7f970577e700 1 -- 172.21.15.180:0/972918689 shutdown_connections 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.407+0000 7f970577e700 1 --2- 172.21.15.180:0/972918689 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f970009aaa0 0x7f970009af50 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.407+0000 7f970577e700 1 --2- 172.21.15.180:0/972918689 >> v2:172.21.15.105:3300/0 conn(0x7f97000a7cb0 0x7f97000a3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rx=0 tx=0).stop 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.407+0000 7f970577e700 1 -- 172.21.15.180:0/972918689 >> 172.21.15.180:0/972918689 conn(0x7f97000ab5d0 msgr2=0x7f97000a75a0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.407+0000 7f970577e700 1 -- 172.21.15.180:0/972918689 shutdown_connections 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.407+0000 7f970577e700 1 -- 172.21.15.180:0/972918689 wait complete. 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f970577e700 1 Processor -- start 2020-02-12T15:09:55.419 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f970577e700 1 -- start start 2020-02-12T15:09:55.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f970577e700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f97000a7cb0 0x7f970009d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f970577e700 1 --2- >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97000a8090 0x7f970009d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f970577e700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9700134080 con 0x7f970009aaa0 2020-02-12T15:09:55.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f970577e700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9700137540 con 0x7f97000a7cb0 2020-02-12T15:09:55.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f970577e700 1 -- --> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970009da40 con 0x7f97000a8090 2020-02-12T15:09:55.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f96fe7fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f97000a7cb0 0x7f970009d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.420 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f96fe7fc700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f97000a7cb0 0x7f970009d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).handle_hello peer v2:172.21.15.180:3300/0 says I am v2:172.21.15.180:51444/0 (socket says 172.21.15.180:51444) 2020-02-12T15:09:55.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f96fe7fc700 1 -- 172.21.15.180:0/1965723012 learned_addr learned my addr 172.21.15.180:0/1965723012 (peer_addr_for_me v2:172.21.15.180:0/0) 2020-02-12T15:09:55.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.408+0000 7f96ff7fe700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97000a8090 0x7f970009d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 -- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97000a8090 msgr2=0x7f970009d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97000a8090 0x7f970009d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 -- 172.21.15.180:0/1965723012 >> v1:172.21.15.105:6789/0 conn(0x7f970009aaa0 legacy=0x7f9700137f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 -- 172.21.15.180:0/1965723012 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9700137750 con 0x7f97000a7cb0 2020-02-12T15:09:55.421 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> v2:172.21.15.180:3300/0 conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> v2:172.21.15.180:3300/0 conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96effff700 1 -- 172.21.15.180:0/1965723012 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96f400cc20 con 0x7f97000a7cb0 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96effff700 1 -- 172.21.15.180:0/1965723012 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96f400cd80 con 0x7f97000a7cb0 2020-02-12T15:09:55.422 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97001419c0 con 0x7f97000a7cb0 2020-02-12T15:09:55.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96effff700 1 -- 172.21.15.180:0/1965723012 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f96f4011140 con 0x7f97000a7cb0 2020-02-12T15:09:55.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9700141550 con 0x7f97000a7cb0 2020-02-12T15:09:55.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.409+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.410+0000 7f96effff700 1 -- 172.21.15.180:0/1965723012 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f96f40064e0 con 0x7f97000a7cb0 2020-02-12T15:09:55.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.410+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.410+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9700141d70 con 0x7f97000a7cb0 2020-02-12T15:09:55.423 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.410+0000 7f96effff700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f96dc039d50 0x7f96dc03c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.410+0000 7f96effff700 1 -- 172.21.15.180:0/1965723012 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f96f4049530 con 0x7f97000a7cb0 2020-02-12T15:09:55.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.410+0000 7f96feffd700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f96dc039d50 0x7f96dc03c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.424 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.410+0000 7f96feffd700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f96dc039d50 0x7f96dc03c210 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.413+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.425 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.413+0000 7f96effff700 1 -- 172.21.15.180:0/1965723012 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f96f402eb40 con 0x7f97000a7cb0 2020-02-12T15:09:55.551 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.549+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97000565b0 con 0x7f97000a7cb0 2020-02-12T15:09:55.552 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.550+0000 7f96fe7fc700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=THROTTLE_DONE pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.552 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.550+0000 7f96effff700 1 -- 172.21.15.180:0/1965723012 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) v1 ==== 100+0+10 (secure 0 0 0) 0x7f96f4031610 con 0x7f97000a7cb0 2020-02-12T15:09:55.553 INFO:teuthology.orchestra.run.smithi180.stdout:pg_num: 8 2020-02-12T15:09:55.553 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f96dc039d50 msgr2=0x7f96dc03c210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f96dc039d50 0x7f96dc03c210 crc :-1 s=READY pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 msgr2=0x7f970009d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 secure :-1 s=READY pgs=201 cs=0 l=1 rx=0x7f97000a3120 tx=0x7f96f4010960).stop 2020-02-12T15:09:55.554 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 shutdown_connections 2020-02-12T15:09:55.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f96dc039d50 0x7f96dc03c210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.105:3301/0,v1:172.21.15.105:6790/0] conn(0x7f97000a8090 0x7f970009d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 --2- 172.21.15.180:0/1965723012 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f97000a7cb0 0x7f970009d180 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 >> 172.21.15.180:0/1965723012 conn(0x7f97000ab5d0 msgr2=0x7f970005b1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:55.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 shutdown_connections 2020-02-12T15:09:55.555 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.551+0000 7f970577e700 1 -- 172.21.15.180:0/1965723012 wait complete. 2020-02-12T15:09:55.564 INFO:tasks.cephfs.mount:Wait for MDS to reach steady state... 2020-02-12T15:09:55.564 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --log-early fs dump --format=json 2020-02-12T15:09:55.669 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.667+0000 7f08f4cea700 1 Processor -- start 2020-02-12T15:09:55.670 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.667+0000 7f08f4cea700 1 -- start start 2020-02-12T15:09:55.672 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08f4cea700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f0135170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rx=0 tx=0).connect 2020-02-12T15:09:55.673 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08f4cea700 1 -- --> v1:172.21.15.105:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00a7300 con 0x7f08f00a1c60 2020-02-12T15:09:55.673 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08f4cea700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f0137c10 con 0x7f08f00a6db0 2020-02-12T15:09:55.673 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08f4cea700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f0137eb0 con 0x7f08f0134cc0 2020-02-12T15:09:55.673 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08edd9b700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f08f00a6db0 0x7f08f01345b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42964/0 (socket says 172.21.15.180:42964) 2020-02-12T15:09:55.673 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08edd9b700 1 -- 172.21.15.180:0/1571275293 learned_addr learned my addr 172.21.15.180:0/1571275293 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:55.673 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08eed9d700 1 --2- 172.21.15.180:0/1571275293 >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f0135170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.673 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08ed59a700 1 -- 172.21.15.180:0/1571275293 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3098635945 0 0) 0x7f08f0137c10 con 0x7f08f00a6db0 2020-02-12T15:09:55.674 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08ed59a700 1 -- 172.21.15.180:0/1571275293 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08d4003230 con 0x7f08f00a6db0 2020-02-12T15:09:55.674 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08eed9d700 1 -- 172.21.15.180:0/1571275293 >> v1:172.21.15.180:6789/0 conn(0x7f08f00a6db0 legacy=0x7f08f01345b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.674 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08eed9d700 1 -- 172.21.15.180:0/1571275293 >> v1:172.21.15.105:6789/0 conn(0x7f08f00a1c60 legacy=0x7f08f0138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.674 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08ed59a700 1 -- 172.21.15.180:0/1571275293 <== mon.0 v1:172.21.15.105:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3128624015 0 0) 0x7f08f00a7300 con 0x7f08f00a1c60 2020-02-12T15:09:55.674 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.668+0000 7f08eed9d700 1 -- 172.21.15.180:0/1571275293 --> v2:172.21.15.105:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f00a7910 con 0x7f08f0134cc0 2020-02-12T15:09:55.675 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08eed9d700 1 --2- 172.21.15.180:0/1571275293 >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f0135170 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=0 rx=0x7f08e80032b0 tx=0x7f08e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.675 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08eed9d700 1 --2- 172.21.15.180:0/1571275293 >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f0135170 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=0 rx=0x7f08e80032b0 tx=0x7f08e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.675 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08eed9d700 1 --2- 172.21.15.180:0/1571275293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08f0134cc0 0x7f08f0135170 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f08e80032b0 tx=0x7f08e8008c60).ready entity=mon.0 client_cookie=875cd86b2397a652 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.675 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08eed9d700 1 --2- 172.21.15.180:0/1571275293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08f0134cc0 0x7f08f0135170 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f08e80032b0 tx=0x7f08e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.675 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08ed59a700 1 -- 172.21.15.180:0/1571275293 <== mon.0 v2:172.21.15.105:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e8011e60 con 0x7f08f0134cc0 2020-02-12T15:09:55.675 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08eed9d700 1 --2- 172.21.15.180:0/1571275293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08f0134cc0 0x7f08f0135170 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f08e80032b0 tx=0x7f08e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.675 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08ed59a700 1 -- 172.21.15.180:0/1571275293 <== mon.0 v2:172.21.15.105:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e800a160 con 0x7f08f0134cc0 2020-02-12T15:09:55.676 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08eed9d700 1 --2- 172.21.15.180:0/1571275293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08f0134cc0 0x7f08f0135170 secure :-1 s=THROTTLE_DONE pgs=103 cs=0 l=1 rx=0x7f08e80032b0 tx=0x7f08e8008c60).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.676 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08f4cea700 1 -- 172.21.15.180:0/1571275293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08f0134cc0 msgr2=0x7f08f0135170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.676 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08ed59a700 1 -- 172.21.15.180:0/1571275293 <== mon.0 v2:172.21.15.105:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e800a4c0 con 0x7f08f0134cc0 2020-02-12T15:09:55.676 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08f4cea700 1 --2- 172.21.15.180:0/1571275293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08f0134cc0 0x7f08f0135170 secure :-1 s=READY pgs=103 cs=0 l=1 rx=0x7f08e80032b0 tx=0x7f08e8008c60).stop 2020-02-12T15:09:55.676 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08f4cea700 1 -- 172.21.15.180:0/1571275293 shutdown_connections 2020-02-12T15:09:55.676 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08f4cea700 1 --2- 172.21.15.180:0/1571275293 >> [v2:172.21.15.105:3300/0,v1:172.21.15.105:6789/0] conn(0x7f08f0134cc0 0x7f08f0135170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.676 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08f4cea700 1 -- 172.21.15.180:0/1571275293 >> 172.21.15.180:0/1571275293 conn(0x7f08f009d450 msgr2=0x7f08f009d860 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:55.677 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08f4cea700 1 -- 172.21.15.180:0/1571275293 shutdown_connections 2020-02-12T15:09:55.677 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.669+0000 7f08f4cea700 1 -- 172.21.15.180:0/1571275293 wait complete. 2020-02-12T15:09:55.677 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.670+0000 7f08f4cea700 1 Processor -- start 2020-02-12T15:09:55.677 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.670+0000 7f08f4cea700 1 -- start start 2020-02-12T15:09:55.680 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08f4cea700 1 --2- >> v2:172.21.15.180:3300/0 conn(0x7f08f00a6db0 0x7f08f012e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.680 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08f4cea700 1 --2- >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f012fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.680 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08f4cea700 1 -- --> v1:172.21.15.180:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f012c0b0 con 0x7f08f00a1c60 2020-02-12T15:09:55.680 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08f4cea700 1 -- --> v2:172.21.15.105:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f012c350 con 0x7f08f0134cc0 2020-02-12T15:09:55.680 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08f4cea700 1 -- --> v2:172.21.15.180:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f012fea0 con 0x7f08f00a6db0 2020-02-12T15:09:55.681 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08ee59c700 1 --1- >> v1:172.21.15.180:6789/0 conn(0x7f08f00a1c60 0x7f08f012c790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.180:6789/0 says I am v1:172.21.15.180:42968/0 (socket says 172.21.15.180:42968) 2020-02-12T15:09:55.681 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08ee59c700 1 -- 172.21.15.180:0/3774297591 learned_addr learned my addr 172.21.15.180:0/3774297591 (peer_addr_for_me v1:172.21.15.180:0/0) 2020-02-12T15:09:55.681 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> v2:172.21.15.180:3300/0 conn(0x7f08f00a6db0 0x7f08f012e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.681 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v1:172.21.15.180:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1294992452 0 0) 0x7f08f012c0b0 con 0x7f08f00a1c60 2020-02-12T15:09:55.681 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 --> v1:172.21.15.180:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08cc002fe0 con 0x7f08f00a1c60 2020-02-12T15:09:55.681 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08eed9d700 1 --2- 172.21.15.180:0/3774297591 >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f012fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.681 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 -- 172.21.15.180:0/3774297591 >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 msgr2=0x7f08f012fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f012fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 -- 172.21.15.180:0/3774297591 >> v1:172.21.15.180:6789/0 conn(0x7f08f00a1c60 legacy=0x7f08f012c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 -- 172.21.15.180:0/3774297591 --> v2:172.21.15.180:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f012bd30 con 0x7f08f00a6db0 2020-02-12T15:09:55.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> v2:172.21.15.180:3300/0 conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=AUTH_CONNECTING_SIGN pgs=0 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> v2:172.21.15.180:3300/0 conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=SESSION_CONNECTING pgs=0 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.682 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.683 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.671+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v2:172.21.15.180:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e0005cc0 con 0x7f08f00a6db0 2020-02-12T15:09:55.683 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.683 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v2:172.21.15.180:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e0005e20 con 0x7f08f00a6db0 2020-02-12T15:09:55.683 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.683 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f012de30 con 0x7f08f00a6db0 2020-02-12T15:09:55.683 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v2:172.21.15.180:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f08e00062b0 con 0x7f08f00a6db0 2020-02-12T15:09:55.683 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f012a680 con 0x7f08f00a6db0 2020-02-12T15:09:55.684 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.684 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v2:172.21.15.180:3300/0 4 ==== mgrmap(e 4) v1 ==== 45117+0+0 (secure 0 0 0) 0x7f08e0006530 con 0x7f08f00a6db0 2020-02-12T15:09:55.684 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.672+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.684 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.673+0000 7f08df7fe700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f08cc039ed0 0x7f08cc03c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rx=0 tx=0).connect 2020-02-12T15:09:55.684 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.673+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v2:172.21.15.180:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6031+0+0 (secure 0 0 0) 0x7f08e0049910 con 0x7f08f00a6db0 2020-02-12T15:09:55.685 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.673+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f00565b0 con 0x7f08f00a6db0 2020-02-12T15:09:55.685 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.673+0000 7f08ee59c700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f08cc039ed0 0x7f08cc03c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rx=0 tx=0)._handle_peer_banner_payload supported=0 required=0 2020-02-12T15:09:55.685 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.673+0000 7f08ee59c700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f08cc039ed0 0x7f08cc03c390 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).ready entity=mgr.4101 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2020-02-12T15:09:55.685 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.676+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.685 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.676+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v2:172.21.15.180:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+123772 (secure 0 0 0) 0x7f08e002edb0 con 0x7f08f00a6db0 2020-02-12T15:09:55.855 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.853+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 --> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08f00ab110 con 0x7f08f00a6db0 2020-02-12T15:09:55.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.853+0000 7f08edd9b700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=THROTTLE_DONE pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).handle_read_frame_epilogue_main read frame epilogue bytes=32 2020-02-12T15:09:55.856 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.853+0000 7f08df7fe700 1 -- 172.21.15.180:0/3774297591 <== mon.1 v2:172.21.15.180:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) v1 ==== 93+0+2207 (secure 0 0 0) 0x7f08e0031a90 con 0x7f08f00a6db0 2020-02-12T15:09:55.856 INFO:teuthology.orchestra.run.smithi180.stdout: 2020-02-12T15:09:55.857 INFO:teuthology.orchestra.run.smithi180.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4217,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.180:6833/1572130938","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.180:6832","nonce":1572130938},{"type":"v1","addr":"172.21.15.180:6833","nonce":1572130938}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0,"epoch":4}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2020-02-12T15:09:42.737856+0000","modified":"2020-02-12T15:09:54.455283+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4308},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4308":{"gid":4308,"name":"b","rank":0,"incarnation":5,"state":"up:active","state_seq":2,"addr":"172.21.15.105:6835/218853727","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.105:6834","nonce":218853727},{"type":"v1","addr":"172.21.15.105:6835","nonce":218853727}]},"join_fscid":-1,"export_targets":[],"features":4540138292836696063,"flags":0}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2020-02-12T15:09:55.858 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f08cc039ed0 msgr2=0x7f08cc03c390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.858 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f08cc039ed0 0x7f08cc03c390 crc :-1 s=READY pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.858 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 msgr2=0x7f08f012e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2020-02-12T15:09:55.858 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 secure :-1 s=READY pgs=204 cs=0 l=1 rx=0x7f08f012e6c0 tx=0x7f08e00108d0).stop 2020-02-12T15:09:55.858 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 shutdown_connections 2020-02-12T15:09:55.858 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.105:6800/21618,v1:172.21.15.105:6801/21618] conn(0x7f08cc039ed0 0x7f08cc03c390 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.859 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 --2- 172.21.15.180:0/3774297591 >> v2:172.21.15.105:3300/0 conn(0x7f08f0134cc0 0x7f08f012fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.859 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 --2- 172.21.15.180:0/3774297591 >> [v2:172.21.15.180:3300/0,v1:172.21.15.180:6789/0] conn(0x7f08f00a6db0 0x7f08f012e930 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rx=0 tx=0).stop 2020-02-12T15:09:55.859 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 >> 172.21.15.180:0/3774297591 conn(0x7f08f009d450 msgr2=0x7f08f00a6370 unknown :-1 s=STATE_NONE l=0).mark_down 2020-02-12T15:09:55.859 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 shutdown_connections 2020-02-12T15:09:55.859 INFO:teuthology.orchestra.run.smithi180.stderr:2020-02-12T15:09:55.855+0000 7f08f4cea700 1 -- 172.21.15.180:0/3774297591 wait complete. 2020-02-12T15:09:55.859 INFO:teuthology.orchestra.run.smithi180.stderr:dumped fsmap epoch 7 2020-02-12T15:09:56.069 INFO:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {u'session_autoclose': 300, u'balancer': u'', u'up': {u'mds_0': 4308}, u'last_failure_osd_epoch': 0, u'in': [0], u'last_failure': 0, u'max_file_size': 1099511627776, u'explicitly_allowed_features': 0, u'damaged': [], u'tableserver': 0, u'metadata_pool': 2, u'failed': [], u'epoch': 7, u'flags': 18, u'max_mds': 1, u'compat': {u'compat': {}, u'ro_compat': {}, u'incompat': {u'feature_10': u'snaprealm v2', u'feature_8': u'no anchor table', u'feature_9': u'file layout v2', u'feature_2': u'client writeable ranges', u'feature_3': u'default file layouts on dirs', u'feature_1': u'base v0.20', u'feature_6': u'dirfrag is stored in omap', u'feature_7': u'mds uses inline data', u'feature_4': u'dir inode in separate object', u'feature_5': u'mds uses versioned encoding'}}, u'min_compat_client': u'0 (unknown)', u'data_pools': [3], u'info': {u'gid_4308': {u'export_targets': [], u'name': u'b', u'incarnation': 5, u'state_seq': 2, u'state': u'up:active', u'gid': 4308, u'features': 4540138292836696063, u'rank': 0, u'flags': 0, u'join_fscid': -1, u'addrs': {u'addrvec': [{u'nonce': 218853727, u'type': u'v2', u'addr': u'172.21.15.105:6834'}, {u'nonce': 218853727, u'type': u'v1', u'addr': u'172.21.15.105:6835'}]}, u'addr': u'172.21.15.105:6835/218853727'}}, u'fs_name': u'cephfs', u'created': u'2020-02-12T15:09:42.737856+0000', u'standby_count_wanted': 0, u'enabled': True, u'modified': u'2020-02-12T15:09:54.455283+0000', u'session_timeout': 60, u'stopped': [], u'ever_allowed_features': 0, u'root': 0} 2020-02-12T15:09:56.069 INFO:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2020-02-12T15:09:56.070 INFO:teuthology.orchestra.run.smithi105:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok status 2020-02-12T15:09:56.198 INFO:teuthology.orchestra.run.smithi105.stdout:{ 2020-02-12T15:09:56.198 INFO:teuthology.orchestra.run.smithi105.stdout: "cluster_fsid": "c77fb549-2ffe-4090-8606-e21e8ca1873f", 2020-02-12T15:09:56.198 INFO:teuthology.orchestra.run.smithi105.stdout: "whoami": 0, 2020-02-12T15:09:56.199 INFO:teuthology.orchestra.run.smithi105.stdout: "id": 4308, 2020-02-12T15:09:56.199 INFO:teuthology.orchestra.run.smithi105.stdout: "want_state": "up:active", 2020-02-12T15:09:56.199 INFO:teuthology.orchestra.run.smithi105.stdout: "state": "up:active", 2020-02-12T15:09:56.200 INFO:teuthology.orchestra.run.smithi105.stdout: "rank_uptime": 10.758259613, 2020-02-12T15:09:56.200 INFO:teuthology.orchestra.run.smithi105.stdout: "mdsmap_epoch": 7, 2020-02-12T15:09:56.201 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch": 24, 2020-02-12T15:09:56.201 INFO:teuthology.orchestra.run.smithi105.stdout: "osdmap_epoch_barrier": 24, 2020-02-12T15:09:56.201 INFO:teuthology.orchestra.run.smithi105.stdout: "uptime": 11.079721971 2020-02-12T15:09:56.202 INFO:teuthology.orchestra.run.smithi105.stdout:} 2020-02-12T15:09:56.207 INFO:tasks.cephfs.filesystem:_json_asok output: { "cluster_fsid": "c77fb549-2ffe-4090-8606-e21e8ca1873f", "whoami": 0, "id": 4308, "want_state": "up:active", "state": "up:active", "rank_uptime": 10.758259613, "mdsmap_epoch": 7, "osdmap_epoch": 24, "osdmap_epoch_barrier": 24, "uptime": 11.079721971 } 2020-02-12T15:09:56.208 INFO:tasks.cephfs.mount:Ready to start FuseMount... 2020-02-12T15:09:56.208 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2020-02-12T15:09:56.208 INFO:tasks.cephfs.fuse_mount:Mounting ceph-fuse client.0 at ubuntu@smithi180.front.sepia.ceph.com /home/ubuntu/cephtest/mnt.0... 2020-02-12T15:09:56.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:56.209 INFO:teuthology.orchestra.run.smithi180:> mkdir -p /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:56.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:56.229 INFO:teuthology.orchestra.run.smithi180:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-12T15:09:56.294 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-02-12T15:09:56.301 INFO:teuthology.orchestra.run.smithi180.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-02-12T15:09:56.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:56.303 INFO:teuthology.orchestra.run.smithi180:> ls /sys/fs/fuse/connections 2020-02-12T15:09:56.350 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-02-12T15:09:56.355 INFO:teuthology.orchestra.run.smithi180.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-02-12T15:09:56.355 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2020-02-12T15:09:56.355 INFO:teuthology.orchestra.run.smithi180:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --name client.0 /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:56.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:56.393 INFO:teuthology.orchestra.run.smithi180:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-12T15:09:56.422 DEBUG:teuthology.orchestra.run:got remote process result: 32 2020-02-12T15:09:56.429 INFO:teuthology.orchestra.run.smithi180.stderr:mount: /sys/fs/fuse/connections: mount point does not exist. 2020-02-12T15:09:56.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:56.430 INFO:teuthology.orchestra.run.smithi180:> ls /sys/fs/fuse/connections 2020-02-12T15:09:56.469 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi180.stderr:2020-02-12T15:09:56.467+0000 7ff148ed11c0 -1 init, newargv = 0x55783b5fb010 newargc=7 2020-02-12T15:09:56.470 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi180.stderr:ceph-fuse[24024]: starting ceph client 2020-02-12T15:09:56.477 DEBUG:teuthology.orchestra.run:got remote process result: 2 2020-02-12T15:09:56.482 INFO:teuthology.orchestra.run.smithi180.stderr:ls: cannot access '/sys/fs/fuse/connections': No such file or directory 2020-02-12T15:09:56.514 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi180.stderr:ceph-fuse[24024]: starting fuse 2020-02-12T15:09:57.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:57.585 INFO:teuthology.orchestra.run.smithi180:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2020-02-12T15:09:57.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:57.621 INFO:teuthology.orchestra.run.smithi180:> ls /sys/fs/fuse/connections 2020-02-12T15:09:57.689 INFO:teuthology.orchestra.run.smithi180.stdout:47 2020-02-12T15:09:57.689 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2020-02-12T15:09:57.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:57.689 INFO:teuthology.orchestra.run.smithi180:> sudo python3 -c ' 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> import glob 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> import re 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> import os 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> import subprocess 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> def find_socket(client_name): 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2020-02-12T15:09:57.690 INFO:teuthology.orchestra.run.smithi180:> files = glob.glob(asok_path) 2020-02-12T15:09:57.691 INFO:teuthology.orchestra.run.smithi180:> 2020-02-12T15:09:57.691 INFO:teuthology.orchestra.run.smithi180:> # Given a non-glob path, it better be there 2020-02-12T15:09:57.691 INFO:teuthology.orchestra.run.smithi180:> if "*" not in asok_path: 2020-02-12T15:09:57.691 INFO:teuthology.orchestra.run.smithi180:> assert(len(files) == 1) 2020-02-12T15:09:57.691 INFO:teuthology.orchestra.run.smithi180:> return files[0] 2020-02-12T15:09:57.691 INFO:teuthology.orchestra.run.smithi180:> 2020-02-12T15:09:57.691 INFO:teuthology.orchestra.run.smithi180:> for f in files: 2020-02-12T15:09:57.692 INFO:teuthology.orchestra.run.smithi180:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2020-02-12T15:09:57.692 INFO:teuthology.orchestra.run.smithi180:> if os.path.exists("/proc/{0}".format(pid)): 2020-02-12T15:09:57.692 INFO:teuthology.orchestra.run.smithi180:> return f 2020-02-12T15:09:57.692 INFO:teuthology.orchestra.run.smithi180:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2020-02-12T15:09:57.692 INFO:teuthology.orchestra.run.smithi180:> 2020-02-12T15:09:57.692 INFO:teuthology.orchestra.run.smithi180:> print(find_socket("client.0")) 2020-02-12T15:09:57.692 INFO:teuthology.orchestra.run.smithi180:> ' 2020-02-12T15:09:57.791 INFO:teuthology.orchestra.run.smithi180.stdout:/var/run/ceph/ceph-client.0.24024.asok 2020-02-12T15:09:57.791 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.24024.asok 2020-02-12T15:09:57.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:57.791 INFO:teuthology.orchestra.run.smithi180:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.24024.asok status 2020-02-12T15:09:57.911 INFO:teuthology.orchestra.run.smithi180.stdout:{ 2020-02-12T15:09:57.911 INFO:teuthology.orchestra.run.smithi180.stdout: "metadata": { 2020-02-12T15:09:57.911 INFO:teuthology.orchestra.run.smithi180.stdout: "ceph_sha1": "7df2194963eaa185d198b9c90e899c7e7ae9eb30", 2020-02-12T15:09:57.912 INFO:teuthology.orchestra.run.smithi180.stdout: "ceph_version": "ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc)", 2020-02-12T15:09:57.912 INFO:teuthology.orchestra.run.smithi180.stdout: "entity_id": "0", 2020-02-12T15:09:57.912 INFO:teuthology.orchestra.run.smithi180.stdout: "hostname": "smithi180", 2020-02-12T15:09:57.912 INFO:teuthology.orchestra.run.smithi180.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2020-02-12T15:09:57.912 INFO:teuthology.orchestra.run.smithi180.stdout: "pid": "24024", 2020-02-12T15:09:57.912 INFO:teuthology.orchestra.run.smithi180.stdout: "root": "/" 2020-02-12T15:09:57.912 INFO:teuthology.orchestra.run.smithi180.stdout: }, 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: "dentry_count": 0, 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: "dentry_pinned_count": 0, 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: "id": 4708, 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: "inst": { 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: "name": { 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: "type": "client", 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: "num": 4708 2020-02-12T15:09:57.913 INFO:teuthology.orchestra.run.smithi180.stdout: }, 2020-02-12T15:09:57.914 INFO:teuthology.orchestra.run.smithi180.stdout: "addr": { 2020-02-12T15:09:57.914 INFO:teuthology.orchestra.run.smithi180.stdout: "type": "v1", 2020-02-12T15:09:57.914 INFO:teuthology.orchestra.run.smithi180.stdout: "addr": "172.21.15.180:0", 2020-02-12T15:09:57.914 INFO:teuthology.orchestra.run.smithi180.stdout: "nonce": 1116300235 2020-02-12T15:09:57.914 INFO:teuthology.orchestra.run.smithi180.stdout: } 2020-02-12T15:09:57.914 INFO:teuthology.orchestra.run.smithi180.stdout: }, 2020-02-12T15:09:57.914 INFO:teuthology.orchestra.run.smithi180.stdout: "addr": { 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: "type": "v1", 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: "addr": "172.21.15.180:0", 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: "nonce": 1116300235 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: }, 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: "inst_str": "client.4708 172.21.15.180:0/1116300235", 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: "addr_str": "172.21.15.180:0/1116300235", 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: "inode_count": 1, 2020-02-12T15:09:57.915 INFO:teuthology.orchestra.run.smithi180.stdout: "mds_epoch": 7, 2020-02-12T15:09:57.916 INFO:teuthology.orchestra.run.smithi180.stdout: "osd_epoch": 24, 2020-02-12T15:09:57.916 INFO:teuthology.orchestra.run.smithi180.stdout: "osd_epoch_barrier": 0, 2020-02-12T15:09:57.916 INFO:teuthology.orchestra.run.smithi180.stdout: "blacklisted": false 2020-02-12T15:09:57.916 INFO:teuthology.orchestra.run.smithi180.stdout:} 2020-02-12T15:09:57.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:57.917 INFO:teuthology.orchestra.run.smithi180:> stat --file-system '--printf=%T 2020-02-12T15:09:57.917 INFO:teuthology.orchestra.run.smithi180:> ' -- /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:57.937 INFO:teuthology.orchestra.run.smithi180.stdout:fuseblk 2020-02-12T15:09:57.938 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:57.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:09:57.938 INFO:teuthology.orchestra.run.smithi180:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:58.008 INFO:teuthology.run_tasks:Running task workunit... 2020-02-12T15:09:58.023 INFO:tasks.workunit:Pulling workunits from ref 7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T15:09:58.024 INFO:tasks.workunit:Making a separate scratch dir for every client... 2020-02-12T15:09:58.029 INFO:tasks.workunit:timeout=3h 2020-02-12T15:09:58.029 INFO:tasks.workunit:cleanup=True 2020-02-12T15:09:58.029 INFO:teuthology.orchestra.run.smithi180:> stat -- /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:58.056 INFO:teuthology.orchestra.run.smithi180.stdout: File: /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:58.056 INFO:teuthology.orchestra.run.smithi180.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2020-02-12T15:09:58.056 INFO:teuthology.orchestra.run.smithi180.stdout:Device: 2fh/47d Inode: 1 Links: 2 2020-02-12T15:09:58.056 INFO:teuthology.orchestra.run.smithi180.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2020-02-12T15:09:58.056 INFO:teuthology.orchestra.run.smithi180.stdout:Context: system_u:object_r:fusefs_t:s0 2020-02-12T15:09:58.056 INFO:teuthology.orchestra.run.smithi180.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2020-02-12T15:09:58.057 INFO:teuthology.orchestra.run.smithi180.stdout:Modify: 2020-02-12 15:09:45.438739268 +0000 2020-02-12T15:09:58.057 INFO:teuthology.orchestra.run.smithi180.stdout:Change: 2020-02-12 15:09:57.996779796 +0000 2020-02-12T15:09:58.058 INFO:teuthology.orchestra.run.smithi180.stdout: Birth: - 2020-02-12T15:09:58.058 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2020-02-12T15:09:58.058 INFO:teuthology.orchestra.run.smithi180:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2020-02-12T15:09:58.131 INFO:teuthology.orchestra.run.smithi180:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7df2194963eaa185d198b9c90e899c7e7ae9eb30 2020-02-12T15:09:58.242 INFO:tasks.workunit.client.0.smithi180.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2020-02-12T15:10:11.390 INFO:tasks.ceph.mon.b.smithi105.stderr:terminate called after throwing an instance of 'std::out_of_range' 2020-02-12T15:10:11.391 INFO:tasks.ceph.mon.b.smithi105.stderr: what(): map::at 2020-02-12T15:10:11.391 INFO:tasks.ceph.mon.b.smithi105.stderr:*** Caught signal (Aborted) ** 2020-02-12T15:10:11.391 INFO:tasks.ceph.mon.b.smithi105.stderr: in thread 7f33141f0700 thread_name:safe_timer 2020-02-12T15:10:11.392 INFO:tasks.ceph.mon.b.smithi105.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:11.392 INFO:tasks.ceph.mon.b.smithi105.stderr: 1: (()+0x12dc0) [0x7f331cdc0dc0] 2020-02-12T15:10:11.392 INFO:tasks.ceph.mon.b.smithi105.stderr: 2: (gsignal()+0x10f) [0x7f331ba9b8df] 2020-02-12T15:10:11.393 INFO:tasks.ceph.mon.b.smithi105.stderr: 3: (abort()+0x127) [0x7f331ba85cf5] 2020-02-12T15:10:11.393 INFO:tasks.ceph.mon.b.smithi105.stderr: 4: (()+0x9006b) [0x7f331c45106b] 2020-02-12T15:10:11.393 INFO:tasks.ceph.mon.b.smithi105.stderr: 5: (()+0x964cc) [0x7f331c4574cc] 2020-02-12T15:10:11.393 INFO:tasks.ceph.mon.b.smithi105.stderr: 6: (()+0x96527) [0x7f331c457527] 2020-02-12T15:10:11.394 INFO:tasks.ceph.mon.b.smithi105.stderr: 7: (()+0x96788) [0x7f331c457788] 2020-02-12T15:10:11.395 INFO:tasks.ceph.mon.b.smithi105.stderr: 8: (()+0x9200f) [0x7f331c45300f] 2020-02-12T15:10:11.395 INFO:tasks.ceph.mon.b.smithi105.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f331f567ff7] 2020-02-12T15:10:11.395 INFO:tasks.ceph.mon.b.smithi105.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x55ef28b1104f] 2020-02-12T15:10:11.395 INFO:tasks.ceph.mon.b.smithi105.stderr: 11: (MDSMonitor::tick()+0x32b) [0x55ef28b1240b] 2020-02-12T15:10:11.395 INFO:tasks.ceph.mon.b.smithi105.stderr: 12: (Monitor::tick()+0x140) [0x55ef28931260] 2020-02-12T15:10:11.396 INFO:tasks.ceph.mon.b.smithi105.stderr: 13: (Context::complete(int)+0xd) [0x55ef28948c0d] 2020-02-12T15:10:11.396 INFO:tasks.ceph.mon.b.smithi105.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f331f14d617] 2020-02-12T15:10:11.396 INFO:tasks.ceph.mon.b.smithi105.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f331f14ebf1] 2020-02-12T15:10:11.396 INFO:tasks.ceph.mon.b.smithi105.stderr: 16: (()+0x82de) [0x7f331cdb62de] 2020-02-12T15:10:11.397 INFO:tasks.ceph.mon.b.smithi105.stderr: 17: (clone()+0x43) [0x7f331bb60133] 2020-02-12T15:10:11.397 INFO:tasks.ceph.mon.b.smithi105.stderr:2020-02-12T15:10:11.390+0000 7f33141f0700 -1 *** Caught signal (Aborted) ** 2020-02-12T15:10:11.397 INFO:tasks.ceph.mon.b.smithi105.stderr: in thread 7f33141f0700 thread_name:safe_timer 2020-02-12T15:10:11.397 INFO:tasks.ceph.mon.b.smithi105.stderr: 2020-02-12T15:10:11.397 INFO:tasks.ceph.mon.b.smithi105.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:11.398 INFO:tasks.ceph.mon.b.smithi105.stderr: 1: (()+0x12dc0) [0x7f331cdc0dc0] 2020-02-12T15:10:11.398 INFO:tasks.ceph.mon.b.smithi105.stderr: 2: (gsignal()+0x10f) [0x7f331ba9b8df] 2020-02-12T15:10:11.398 INFO:tasks.ceph.mon.b.smithi105.stderr: 3: (abort()+0x127) [0x7f331ba85cf5] 2020-02-12T15:10:11.398 INFO:tasks.ceph.mon.b.smithi105.stderr: 4: (()+0x9006b) [0x7f331c45106b] 2020-02-12T15:10:11.399 INFO:tasks.ceph.mon.b.smithi105.stderr: 5: (()+0x964cc) [0x7f331c4574cc] 2020-02-12T15:10:11.399 INFO:tasks.ceph.mon.b.smithi105.stderr: 6: (()+0x96527) [0x7f331c457527] 2020-02-12T15:10:11.399 INFO:tasks.ceph.mon.b.smithi105.stderr: 7: (()+0x96788) [0x7f331c457788] 2020-02-12T15:10:11.399 INFO:tasks.ceph.mon.b.smithi105.stderr: 8: (()+0x9200f) [0x7f331c45300f] 2020-02-12T15:10:11.399 INFO:tasks.ceph.mon.b.smithi105.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f331f567ff7] 2020-02-12T15:10:11.400 INFO:tasks.ceph.mon.b.smithi105.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x55ef28b1104f] 2020-02-12T15:10:11.400 INFO:tasks.ceph.mon.b.smithi105.stderr: 11: (MDSMonitor::tick()+0x32b) [0x55ef28b1240b] 2020-02-12T15:10:11.400 INFO:tasks.ceph.mon.b.smithi105.stderr: 12: (Monitor::tick()+0x140) [0x55ef28931260] 2020-02-12T15:10:11.400 INFO:tasks.ceph.mon.b.smithi105.stderr: 13: (Context::complete(int)+0xd) [0x55ef28948c0d] 2020-02-12T15:10:11.401 INFO:tasks.ceph.mon.b.smithi105.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f331f14d617] 2020-02-12T15:10:11.401 INFO:tasks.ceph.mon.b.smithi105.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f331f14ebf1] 2020-02-12T15:10:11.401 INFO:tasks.ceph.mon.b.smithi105.stderr: 16: (()+0x82de) [0x7f331cdb62de] 2020-02-12T15:10:11.401 INFO:tasks.ceph.mon.b.smithi105.stderr: 17: (clone()+0x43) [0x7f331bb60133] 2020-02-12T15:10:11.401 INFO:tasks.ceph.mon.b.smithi105.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T15:10:11.401 INFO:tasks.ceph.mon.b.smithi105.stderr: 2020-02-12T15:10:11.408 INFO:tasks.ceph.mon.b.smithi105.stderr: 0> 2020-02-12T15:10:11.390+0000 7f33141f0700 -1 *** Caught signal (Aborted) ** 2020-02-12T15:10:11.408 INFO:tasks.ceph.mon.b.smithi105.stderr: in thread 7f33141f0700 thread_name:safe_timer 2020-02-12T15:10:11.409 INFO:tasks.ceph.mon.b.smithi105.stderr: 2020-02-12T15:10:11.409 INFO:tasks.ceph.mon.b.smithi105.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:11.409 INFO:tasks.ceph.mon.b.smithi105.stderr: 1: (()+0x12dc0) [0x7f331cdc0dc0] 2020-02-12T15:10:11.409 INFO:tasks.ceph.mon.b.smithi105.stderr: 2: (gsignal()+0x10f) [0x7f331ba9b8df] 2020-02-12T15:10:11.410 INFO:tasks.ceph.mon.b.smithi105.stderr: 3: (abort()+0x127) [0x7f331ba85cf5] 2020-02-12T15:10:11.410 INFO:tasks.ceph.mon.b.smithi105.stderr: 4: (()+0x9006b) [0x7f331c45106b] 2020-02-12T15:10:11.410 INFO:tasks.ceph.mon.b.smithi105.stderr: 5: (()+0x964cc) [0x7f331c4574cc] 2020-02-12T15:10:11.411 INFO:tasks.ceph.mon.b.smithi105.stderr: 6: (()+0x96527) [0x7f331c457527] 2020-02-12T15:10:11.411 INFO:tasks.ceph.mon.b.smithi105.stderr: 7: (()+0x96788) [0x7f331c457788] 2020-02-12T15:10:11.411 INFO:tasks.ceph.mon.b.smithi105.stderr: 8: (()+0x9200f) [0x7f331c45300f] 2020-02-12T15:10:11.411 INFO:tasks.ceph.mon.b.smithi105.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f331f567ff7] 2020-02-12T15:10:11.411 INFO:tasks.ceph.mon.b.smithi105.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x55ef28b1104f] 2020-02-12T15:10:11.412 INFO:tasks.ceph.mon.b.smithi105.stderr: 11: (MDSMonitor::tick()+0x32b) [0x55ef28b1240b] 2020-02-12T15:10:11.412 INFO:tasks.ceph.mon.b.smithi105.stderr: 12: (Monitor::tick()+0x140) [0x55ef28931260] 2020-02-12T15:10:11.412 INFO:tasks.ceph.mon.b.smithi105.stderr: 13: (Context::complete(int)+0xd) [0x55ef28948c0d] 2020-02-12T15:10:11.412 INFO:tasks.ceph.mon.b.smithi105.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f331f14d617] 2020-02-12T15:10:11.413 INFO:tasks.ceph.mon.b.smithi105.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f331f14ebf1] 2020-02-12T15:10:11.413 INFO:tasks.ceph.mon.b.smithi105.stderr: 16: (()+0x82de) [0x7f331cdb62de] 2020-02-12T15:10:11.413 INFO:tasks.ceph.mon.b.smithi105.stderr: 17: (clone()+0x43) [0x7f331bb60133] 2020-02-12T15:10:11.413 INFO:tasks.ceph.mon.b.smithi105.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T15:10:11.413 INFO:tasks.ceph.mon.b.smithi105.stderr: 2020-02-12T15:10:11.417 INFO:tasks.ceph.mon.b.smithi105.stderr: 0> 2020-02-12T15:10:11.390+0000 7f33141f0700 -1 *** Caught signal (Aborted) ** 2020-02-12T15:10:11.417 INFO:tasks.ceph.mon.b.smithi105.stderr: in thread 7f33141f0700 thread_name:safe_timer 2020-02-12T15:10:11.418 INFO:tasks.ceph.mon.b.smithi105.stderr: 2020-02-12T15:10:11.418 INFO:tasks.ceph.mon.b.smithi105.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:11.418 INFO:tasks.ceph.mon.b.smithi105.stderr: 1: (()+0x12dc0) [0x7f331cdc0dc0] 2020-02-12T15:10:11.418 INFO:tasks.ceph.mon.b.smithi105.stderr: 2: (gsignal()+0x10f) [0x7f331ba9b8df] 2020-02-12T15:10:11.418 INFO:tasks.ceph.mon.b.smithi105.stderr: 3: (abort()+0x127) [0x7f331ba85cf5] 2020-02-12T15:10:11.419 INFO:tasks.ceph.mon.b.smithi105.stderr: 4: (()+0x9006b) [0x7f331c45106b] 2020-02-12T15:10:11.419 INFO:tasks.ceph.mon.b.smithi105.stderr: 5: (()+0x964cc) [0x7f331c4574cc] 2020-02-12T15:10:11.419 INFO:tasks.ceph.mon.b.smithi105.stderr: 6: (()+0x96527) [0x7f331c457527] 2020-02-12T15:10:11.419 INFO:tasks.ceph.mon.b.smithi105.stderr: 7: (()+0x96788) [0x7f331c457788] 2020-02-12T15:10:11.420 INFO:tasks.ceph.mon.b.smithi105.stderr: 8: (()+0x9200f) [0x7f331c45300f] 2020-02-12T15:10:11.420 INFO:tasks.ceph.mon.b.smithi105.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f331f567ff7] 2020-02-12T15:10:11.420 INFO:tasks.ceph.mon.b.smithi105.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x55ef28b1104f] 2020-02-12T15:10:11.420 INFO:tasks.ceph.mon.b.smithi105.stderr: 11: (MDSMonitor::tick()+0x32b) [0x55ef28b1240b] 2020-02-12T15:10:11.420 INFO:tasks.ceph.mon.b.smithi105.stderr: 12: (Monitor::tick()+0x140) [0x55ef28931260] 2020-02-12T15:10:11.420 INFO:tasks.ceph.mon.b.smithi105.stderr: 13: (Context::complete(int)+0xd) [0x55ef28948c0d] 2020-02-12T15:10:11.420 INFO:tasks.ceph.mon.b.smithi105.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f331f14d617] 2020-02-12T15:10:11.421 INFO:tasks.ceph.mon.b.smithi105.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f331f14ebf1] 2020-02-12T15:10:11.421 INFO:tasks.ceph.mon.b.smithi105.stderr: 16: (()+0x82de) [0x7f331cdb62de] 2020-02-12T15:10:11.421 INFO:tasks.ceph.mon.b.smithi105.stderr: 17: (clone()+0x43) [0x7f331bb60133] 2020-02-12T15:10:11.421 INFO:tasks.ceph.mon.b.smithi105.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T15:10:11.422 INFO:tasks.ceph.mon.b.smithi105.stderr: 2020-02-12T15:10:11.838 INFO:tasks.ceph.mon.b.smithi105.stderr:daemon-helper: command crashed with signal 6 2020-02-12T15:10:12.572 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2020-02-12T15:10:15.451 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:15.455 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:18.995 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~6s 2020-02-12T15:10:25.409 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~13s 2020-02-12T15:10:31.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~19s 2020-02-12T15:10:38.237 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~26s 2020-02-12T15:10:41.397 INFO:tasks.ceph.mon.a.smithi180.stderr:terminate called after throwing an instance of 'std::out_of_range' 2020-02-12T15:10:41.397 INFO:tasks.ceph.mon.a.smithi180.stderr: what(): map::at 2020-02-12T15:10:41.397 INFO:tasks.ceph.mon.a.smithi180.stderr:*** Caught signal (Aborted) ** 2020-02-12T15:10:41.397 INFO:tasks.ceph.mon.a.smithi180.stderr: in thread 7f571f1bc700 thread_name:safe_timer 2020-02-12T15:10:41.398 INFO:tasks.ceph.mon.a.smithi180.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:41.398 INFO:tasks.ceph.mon.a.smithi180.stderr: 1: (()+0x12dc0) [0x7f5727d8cdc0] 2020-02-12T15:10:41.398 INFO:tasks.ceph.mon.a.smithi180.stderr: 2: (gsignal()+0x10f) [0x7f5726a678df] 2020-02-12T15:10:41.398 INFO:tasks.ceph.mon.a.smithi180.stderr: 3: (abort()+0x127) [0x7f5726a51cf5] 2020-02-12T15:10:41.398 INFO:tasks.ceph.mon.a.smithi180.stderr: 4: (()+0x9006b) [0x7f572741d06b] 2020-02-12T15:10:41.398 INFO:tasks.ceph.mon.a.smithi180.stderr: 5: (()+0x964cc) [0x7f57274234cc] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 6: (()+0x96527) [0x7f5727423527] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 7: (()+0x96788) [0x7f5727423788] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 8: (()+0x9200f) [0x7f572741f00f] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f572a533ff7] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x559d146fc04f] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 11: (MDSMonitor::tick()+0x32b) [0x559d146fd40b] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 12: (Monitor::tick()+0x140) [0x559d1451c260] 2020-02-12T15:10:41.399 INFO:tasks.ceph.mon.a.smithi180.stderr: 13: (Context::complete(int)+0xd) [0x559d14533c0d] 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f572a119617] 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f572a11abf1] 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr: 16: (()+0x82de) [0x7f5727d822de] 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr: 17: (clone()+0x43) [0x7f5726b2c133] 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr:2020-02-12T15:10:41.396+0000 7f571f1bc700 -1 *** Caught signal (Aborted) ** 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr: in thread 7f571f1bc700 thread_name:safe_timer 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr: 2020-02-12T15:10:41.400 INFO:tasks.ceph.mon.a.smithi180.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:41.401 INFO:tasks.ceph.mon.a.smithi180.stderr: 1: (()+0x12dc0) [0x7f5727d8cdc0] 2020-02-12T15:10:41.401 INFO:tasks.ceph.mon.a.smithi180.stderr: 2: (gsignal()+0x10f) [0x7f5726a678df] 2020-02-12T15:10:41.401 INFO:tasks.ceph.mon.a.smithi180.stderr: 3: (abort()+0x127) [0x7f5726a51cf5] 2020-02-12T15:10:41.401 INFO:tasks.ceph.mon.a.smithi180.stderr: 4: (()+0x9006b) [0x7f572741d06b] 2020-02-12T15:10:41.401 INFO:tasks.ceph.mon.a.smithi180.stderr: 5: (()+0x964cc) [0x7f57274234cc] 2020-02-12T15:10:41.401 INFO:tasks.ceph.mon.a.smithi180.stderr: 6: (()+0x96527) [0x7f5727423527] 2020-02-12T15:10:41.401 INFO:tasks.ceph.mon.a.smithi180.stderr: 7: (()+0x96788) [0x7f5727423788] 2020-02-12T15:10:41.402 INFO:tasks.ceph.mon.a.smithi180.stderr: 8: (()+0x9200f) [0x7f572741f00f] 2020-02-12T15:10:41.402 INFO:tasks.ceph.mon.a.smithi180.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f572a533ff7] 2020-02-12T15:10:41.402 INFO:tasks.ceph.mon.a.smithi180.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x559d146fc04f] 2020-02-12T15:10:41.402 INFO:tasks.ceph.mon.a.smithi180.stderr: 11: (MDSMonitor::tick()+0x32b) [0x559d146fd40b] 2020-02-12T15:10:41.402 INFO:tasks.ceph.mon.a.smithi180.stderr: 12: (Monitor::tick()+0x140) [0x559d1451c260] 2020-02-12T15:10:41.402 INFO:tasks.ceph.mon.a.smithi180.stderr: 13: (Context::complete(int)+0xd) [0x559d14533c0d] 2020-02-12T15:10:41.402 INFO:tasks.ceph.mon.a.smithi180.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f572a119617] 2020-02-12T15:10:41.403 INFO:tasks.ceph.mon.a.smithi180.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f572a11abf1] 2020-02-12T15:10:41.403 INFO:tasks.ceph.mon.a.smithi180.stderr: 16: (()+0x82de) [0x7f5727d822de] 2020-02-12T15:10:41.403 INFO:tasks.ceph.mon.a.smithi180.stderr: 17: (clone()+0x43) [0x7f5726b2c133] 2020-02-12T15:10:41.403 INFO:tasks.ceph.mon.a.smithi180.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T15:10:41.403 INFO:tasks.ceph.mon.a.smithi180.stderr: 2020-02-12T15:10:41.412 INFO:tasks.ceph.mon.a.smithi180.stderr: 0> 2020-02-12T15:10:41.396+0000 7f571f1bc700 -1 *** Caught signal (Aborted) ** 2020-02-12T15:10:41.412 INFO:tasks.ceph.mon.a.smithi180.stderr: in thread 7f571f1bc700 thread_name:safe_timer 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: 1: (()+0x12dc0) [0x7f5727d8cdc0] 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: 2: (gsignal()+0x10f) [0x7f5726a678df] 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: 3: (abort()+0x127) [0x7f5726a51cf5] 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: 4: (()+0x9006b) [0x7f572741d06b] 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: 5: (()+0x964cc) [0x7f57274234cc] 2020-02-12T15:10:41.413 INFO:tasks.ceph.mon.a.smithi180.stderr: 6: (()+0x96527) [0x7f5727423527] 2020-02-12T15:10:41.414 INFO:tasks.ceph.mon.a.smithi180.stderr: 7: (()+0x96788) [0x7f5727423788] 2020-02-12T15:10:41.414 INFO:tasks.ceph.mon.a.smithi180.stderr: 8: (()+0x9200f) [0x7f572741f00f] 2020-02-12T15:10:41.414 INFO:tasks.ceph.mon.a.smithi180.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f572a533ff7] 2020-02-12T15:10:41.414 INFO:tasks.ceph.mon.a.smithi180.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x559d146fc04f] 2020-02-12T15:10:41.414 INFO:tasks.ceph.mon.a.smithi180.stderr: 11: (MDSMonitor::tick()+0x32b) [0x559d146fd40b] 2020-02-12T15:10:41.414 INFO:tasks.ceph.mon.a.smithi180.stderr: 12: (Monitor::tick()+0x140) [0x559d1451c260] 2020-02-12T15:10:41.414 INFO:tasks.ceph.mon.a.smithi180.stderr: 13: (Context::complete(int)+0xd) [0x559d14533c0d] 2020-02-12T15:10:41.415 INFO:tasks.ceph.mon.a.smithi180.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f572a119617] 2020-02-12T15:10:41.415 INFO:tasks.ceph.mon.a.smithi180.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f572a11abf1] 2020-02-12T15:10:41.415 INFO:tasks.ceph.mon.a.smithi180.stderr: 16: (()+0x82de) [0x7f5727d822de] 2020-02-12T15:10:41.415 INFO:tasks.ceph.mon.a.smithi180.stderr: 17: (clone()+0x43) [0x7f5726b2c133] 2020-02-12T15:10:41.415 INFO:tasks.ceph.mon.a.smithi180.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T15:10:41.415 INFO:tasks.ceph.mon.a.smithi180.stderr: 2020-02-12T15:10:41.422 INFO:tasks.ceph.mon.a.smithi180.stderr: 0> 2020-02-12T15:10:41.396+0000 7f571f1bc700 -1 *** Caught signal (Aborted) ** 2020-02-12T15:10:41.423 INFO:tasks.ceph.mon.a.smithi180.stderr: in thread 7f571f1bc700 thread_name:safe_timer 2020-02-12T15:10:41.423 INFO:tasks.ceph.mon.a.smithi180.stderr: 2020-02-12T15:10:41.423 INFO:tasks.ceph.mon.a.smithi180.stderr: ceph version 15.1.0-567-g7df2194 (7df2194963eaa185d198b9c90e899c7e7ae9eb30) octopus (rc) 2020-02-12T15:10:41.423 INFO:tasks.ceph.mon.a.smithi180.stderr: 1: (()+0x12dc0) [0x7f5727d8cdc0] 2020-02-12T15:10:41.423 INFO:tasks.ceph.mon.a.smithi180.stderr: 2: (gsignal()+0x10f) [0x7f5726a678df] 2020-02-12T15:10:41.423 INFO:tasks.ceph.mon.a.smithi180.stderr: 3: (abort()+0x127) [0x7f5726a51cf5] 2020-02-12T15:10:41.423 INFO:tasks.ceph.mon.a.smithi180.stderr: 4: (()+0x9006b) [0x7f572741d06b] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 5: (()+0x964cc) [0x7f57274234cc] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 6: (()+0x96527) [0x7f5727423527] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 7: (()+0x96788) [0x7f5727423788] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 8: (()+0x9200f) [0x7f572741f00f] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 9: (FSMap::find_replacement_for(mds_role_t) const+0x127) [0x7f572a533ff7] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 10: (MDSMonitor::check_ranks(FSMap&, bool*)+0x4ff) [0x559d146fc04f] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 11: (MDSMonitor::tick()+0x32b) [0x559d146fd40b] 2020-02-12T15:10:41.424 INFO:tasks.ceph.mon.a.smithi180.stderr: 12: (Monitor::tick()+0x140) [0x559d1451c260] 2020-02-12T15:10:41.425 INFO:tasks.ceph.mon.a.smithi180.stderr: 13: (Context::complete(int)+0xd) [0x559d14533c0d] 2020-02-12T15:10:41.425 INFO:tasks.ceph.mon.a.smithi180.stderr: 14: (SafeTimer::timer_thread()+0x1b7) [0x7f572a119617] 2020-02-12T15:10:41.425 INFO:tasks.ceph.mon.a.smithi180.stderr: 15: (SafeTimerThread::entry()+0x11) [0x7f572a11abf1] 2020-02-12T15:10:41.425 INFO:tasks.ceph.mon.a.smithi180.stderr: 16: (()+0x82de) [0x7f5727d822de] 2020-02-12T15:10:41.425 INFO:tasks.ceph.mon.a.smithi180.stderr: 17: (clone()+0x43) [0x7f5726b2c133] 2020-02-12T15:10:41.425 INFO:tasks.ceph.mon.a.smithi180.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2020-02-12T15:10:41.425 INFO:tasks.ceph.mon.a.smithi180.stderr: 2020-02-12T15:10:41.877 INFO:tasks.ceph.mon.a.smithi180.stderr:daemon-helper: command crashed with signal 6 2020-02-12T15:10:44.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2020-02-12T15:10:44.548 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~32s 2020-02-12T15:10:45.520 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:45.523 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:10:50.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~6s 2020-02-12T15:10:50.869 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~38s 2020-02-12T15:10:57.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~13s 2020-02-12T15:10:57.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~45s 2020-02-12T15:11:03.492 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~19s 2020-02-12T15:11:03.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~51s 2020-02-12T15:11:09.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~25s 2020-02-12T15:11:09.803 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~57s 2020-02-12T15:11:15.583 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:15.585 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:16.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~32s 2020-02-12T15:11:16.115 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~64s 2020-02-12T15:11:22.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~38s 2020-02-12T15:11:22.427 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~70s 2020-02-12T15:11:28.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~44s 2020-02-12T15:11:28.740 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~76s 2020-02-12T15:11:31.016 INFO:tasks.workunit.client.0.smithi180.stderr:Note: checking out '7df2194963eaa185d198b9c90e899c7e7ae9eb30'. 2020-02-12T15:11:31.016 INFO:tasks.workunit.client.0.smithi180.stderr: 2020-02-12T15:11:31.016 INFO:tasks.workunit.client.0.smithi180.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2020-02-12T15:11:31.017 INFO:tasks.workunit.client.0.smithi180.stderr:changes and commit them, and you can discard any commits you make in this 2020-02-12T15:11:31.017 INFO:tasks.workunit.client.0.smithi180.stderr:state without impacting any branches by performing another checkout. 2020-02-12T15:11:31.017 INFO:tasks.workunit.client.0.smithi180.stderr: 2020-02-12T15:11:31.017 INFO:tasks.workunit.client.0.smithi180.stderr:If you want to create a new branch to retain commits you create, you may 2020-02-12T15:11:31.018 INFO:tasks.workunit.client.0.smithi180.stderr:do so (now or later) by using -b with the checkout command again. Example: 2020-02-12T15:11:31.018 INFO:tasks.workunit.client.0.smithi180.stderr: 2020-02-12T15:11:31.018 INFO:tasks.workunit.client.0.smithi180.stderr: git checkout -b 2020-02-12T15:11:31.019 INFO:tasks.workunit.client.0.smithi180.stderr: 2020-02-12T15:11:31.019 INFO:tasks.workunit.client.0.smithi180.stderr:HEAD is now at 7df2194963 Merge PR #33194 into wip-pdonnell-testing-20200211.222321 2020-02-12T15:11:31.021 INFO:teuthology.orchestra.run.smithi180:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2020-02-12T15:11:31.040 INFO:tasks.workunit.client.0.smithi180.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2020-02-12T15:11:31.042 INFO:tasks.workunit.client.0.smithi180.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-02-12T15:11:31.042 INFO:tasks.workunit.client.0.smithi180.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2020-02-12T15:11:31.746 INFO:tasks.workunit.client.0.smithi180.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2020-02-12T15:11:31.796 INFO:tasks.workunit.client.0.smithi180.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2020-02-12T15:11:31.833 INFO:tasks.workunit.client.0.smithi180.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2020-02-12T15:11:31.834 INFO:tasks.workunit.client.0.smithi180.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-02-12T15:11:31.835 INFO:tasks.workunit.client.0.smithi180.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2020-02-12T15:11:31.871 INFO:tasks.workunit.client.0.smithi180.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2020-02-12T15:11:31.931 DEBUG:teuthology.orchestra.remote:smithi180:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2020-02-12T15:11:31.979 INFO:tasks.workunit:Running workunits matching fs/misc/trivial_sync.sh on client.0... 2020-02-12T15:11:31.980 INFO:tasks.workunit:Running workunit fs/misc/trivial_sync.sh... 2020-02-12T15:11:31.980 INFO:teuthology.orchestra.run.smithi180:workunit test fs/misc/trivial_sync.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7df2194963eaa185d198b9c90e899c7e7ae9eb30 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/misc/trivial_sync.sh 2020-02-12T15:11:35.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~51s 2020-02-12T15:11:35.054 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~83s 2020-02-12T15:11:41.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~57s 2020-02-12T15:11:41.369 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~89s 2020-02-12T15:11:45.652 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:45.655 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:11:47.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~63s 2020-02-12T15:11:47.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~95s 2020-02-12T15:11:54.002 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~69s 2020-02-12T15:11:54.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~102s 2020-02-12T15:12:00.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~76s 2020-02-12T15:12:00.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~108s 2020-02-12T15:12:06.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~82s 2020-02-12T15:12:06.625 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~114s 2020-02-12T15:12:12.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~88s 2020-02-12T15:12:12.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~120s 2020-02-12T15:12:15.734 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:15.738 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:19.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~95s 2020-02-12T15:12:19.255 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~127s 2020-02-12T15:12:25.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~101s 2020-02-12T15:12:25.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~133s 2020-02-12T15:12:31.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~107s 2020-02-12T15:12:31.881 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~139s 2020-02-12T15:12:38.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~114s 2020-02-12T15:12:38.193 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~146s 2020-02-12T15:12:44.503 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~120s 2020-02-12T15:12:44.504 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~152s 2020-02-12T15:12:45.800 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:45.804 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:12:50.815 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~126s 2020-02-12T15:12:50.816 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~158s 2020-02-12T15:12:51.403 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:12:51.401+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:56.404 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:12:56.401+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:12:57.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~133s 2020-02-12T15:12:57.133 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~165s 2020-02-12T15:13:01.405 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:01.401+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 42 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:03.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~139s 2020-02-12T15:13:03.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~171s 2020-02-12T15:13:06.406 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:06.402+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 59 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:09.755 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~145s 2020-02-12T15:13:09.756 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~177s 2020-02-12T15:13:11.406 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:11.403+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 79 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:15.866 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:15.869 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:16.066 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~152s 2020-02-12T15:13:16.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~184s 2020-02-12T15:13:16.406 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:16.404+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 96 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:21.407 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:21.404+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 118 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:22.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~158s 2020-02-12T15:13:22.379 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~190s 2020-02-12T15:13:26.408 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:26.406+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 135 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:28.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~164s 2020-02-12T15:13:28.691 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~196s 2020-02-12T15:13:31.408 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:31.406+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 155 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:35.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~170s 2020-02-12T15:13:35.003 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~203s 2020-02-12T15:13:36.409 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:36.407+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 172 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:41.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~177s 2020-02-12T15:13:41.314 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~209s 2020-02-12T15:13:41.410 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:41.407+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 194 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:45.930 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:45.932 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:13:46.410 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:46.407+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:47.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~183s 2020-02-12T15:13:47.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~215s 2020-02-12T15:13:51.411 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:51.408+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 231 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:13:53.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~189s 2020-02-12T15:13:53.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~221s 2020-02-12T15:13:56.412 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:13:56.409+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:00.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~196s 2020-02-12T15:14:00.247 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~228s 2020-02-12T15:14:01.413 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:01.409+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 270 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:06.413 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:06.410+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 287 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:06.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~202s 2020-02-12T15:14:06.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~234s 2020-02-12T15:14:11.414 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:11.411+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 305 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:12.877 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~208s 2020-02-12T15:14:12.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~240s 2020-02-12T15:14:16.017 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:16.020 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:16.415 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:16.412+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 324 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:19.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~215s 2020-02-12T15:14:19.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~247s 2020-02-12T15:14:21.415 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:21.413+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 344 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:25.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~221s 2020-02-12T15:14:25.509 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~253s 2020-02-12T15:14:26.417 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:26.414+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:31.417 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:31.414+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 381 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:31.820 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~227s 2020-02-12T15:14:31.821 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~259s 2020-02-12T15:14:36.419 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:36.415+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 400 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:38.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~234s 2020-02-12T15:14:38.131 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~266s 2020-02-12T15:14:41.419 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:41.416+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:44.444 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~240s 2020-02-12T15:14:44.445 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~272s 2020-02-12T15:14:46.096 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:46.100 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:14:46.420 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:46.417+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 439 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:50.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~246s 2020-02-12T15:14:50.760 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~278s 2020-02-12T15:14:51.422 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:51.417+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:56.421 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:14:56.418+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 476 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:14:57.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~253s 2020-02-12T15:14:57.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~285s 2020-02-12T15:15:01.422 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:01.419+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 496 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:03.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~259s 2020-02-12T15:15:03.382 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~291s 2020-02-12T15:15:06.422 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:06.420+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 515 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:09.692 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~265s 2020-02-12T15:15:09.693 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~297s 2020-02-12T15:15:11.423 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:11.421+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 533 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:16.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~271s 2020-02-12T15:15:16.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~304s 2020-02-12T15:15:16.006 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2020-02-12T15:15:16.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2020-02-12T15:15:16.006 INFO:teuthology.orchestra.run.smithi180:> stat --file-system '--printf=%T 2020-02-12T15:15:16.006 INFO:teuthology.orchestra.run.smithi180:> ' -- /home/ubuntu/cephtest/mnt.0 2020-02-12T15:15:16.191 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:16.194 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:16.425 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:16.422+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 552 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:21.428 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:21.422+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 572 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:26.425 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:26.422+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:31.426 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:31.423+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 609 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:36.427 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:36.424+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 628 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:41.427 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:41.425+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:46.256 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:46.259 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:15:46.428 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:46.425+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:51.429 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:51.427+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:15:56.430 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:15:56.428+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:01.431 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:01.428+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 724 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:06.432 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:06.428+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 743 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:11.433 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:11.429+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 761 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:16.329 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:16.332 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:16.433 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:16.430+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 780 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:21.434 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:21.431+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 800 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:26.435 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:26.432+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 819 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:31.436 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:31.433+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 837 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:36.436 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:36.433+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 856 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:41.437 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:41.435+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 876 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:46.399 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:46.403 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:16:46.442 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:46.435+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 895 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:51.439 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:51.436+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 913 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:16:56.440 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:16:56.436+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 931 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:01.440 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:01.437+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 952 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:06.441 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:06.437+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 969 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:11.442 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:11.438+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:16.443 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:16.439+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1008 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:16.463 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:16.466 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:21.443 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:21.440+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1031 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:26.444 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:26.441+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1049 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:31.445 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:31.442+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1070 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:36.445 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:36.443+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1088 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:41.446 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:41.443+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:46.447 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:46.443+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1129 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:46.526 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:46.528 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:17:51.447 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:51.444+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1150 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:17:56.448 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:17:56.445+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1168 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:01.450 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:01.446+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1191 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:06.450 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:06.447+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1209 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:11.451 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:11.448+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1230 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:16.452 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:16.450+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:16.589 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:16.592 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:21.453 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:21.450+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1271 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:26.454 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:26.451+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1289 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:31.454 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:31.451+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1310 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:36.456 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:36.451+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1328 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:41.456 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:41.452+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1351 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:46.457 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:46.453+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1369 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:46.653 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:46.657 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:18:51.457 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:51.454+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:18:56.458 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:18:56.455+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1408 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:01.459 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:01.457+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1431 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:06.460 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:06.457+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1449 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:11.461 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:11.458+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1470 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:16.461 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:16.458+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1488 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:16.723 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:16.726 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:21.462 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:21.459+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1511 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:26.464 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:26.460+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1529 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:31.464 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:31.461+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1550 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:36.465 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:36.462+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1568 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:41.466 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:41.463+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:46.467 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:46.464+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1609 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:46.795 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:46.798 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:19:51.468 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:51.466+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1629 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:19:56.470 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:19:56.467+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:01.470 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:01.468+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1669 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:06.471 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:06.467+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1689 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:11.472 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:11.468+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1708 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:16.473 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:16.469+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1728 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:16.899 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:16.901 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:21.474 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:21.470+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1749 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:26.475 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:26.471+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1769 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:31.476 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:31.472+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1788 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:36.476 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:36.474+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1808 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:41.477 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:41.475+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1829 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:46.478 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:46.476+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:46.971 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:46.974 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:20:51.479 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:51.477+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1868 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:20:56.480 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:20:56.477+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1888 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:01.481 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:01.477+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1909 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:06.482 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:06.478+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1929 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:11.483 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:11.479+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1948 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:16.483 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:16.480+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1968 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:17.046 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:17.049 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:21.485 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:21.481+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 1989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:26.485 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:26.483+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2009 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:31.486 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:31.483+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2028 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:36.487 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:36.484+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2048 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:41.488 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:41.484+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2069 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:46.489 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:46.485+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2089 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:47.114 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:47.120 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:21:51.490 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:51.486+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:21:56.491 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:21:56.487+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2128 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:01.491 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:01.488+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2149 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:06.492 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:06.489+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2169 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:11.493 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:11.491+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2188 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:16.495 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:16.492+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2208 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:17.202 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:17.204 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:21.496 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:21.494+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2229 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:26.497 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:26.494+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2249 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:31.498 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:31.494+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2268 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:36.499 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:36.495+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2288 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:41.500 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:41.496+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2309 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:46.500 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:46.497+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2328 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:47.273 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:47.277 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:22:51.502 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:51.498+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2348 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:22:56.502 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:22:56.499+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2366 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:01.503 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:01.501+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2389 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:06.504 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:06.502+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2407 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:11.505 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:11.503+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2428 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:16.506 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:16.503+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2446 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:17.370 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:17.373 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:21.507 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:21.503+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2469 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:26.508 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:26.505+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2487 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:31.509 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:31.505+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2508 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:36.510 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:36.506+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2526 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:41.511 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:41.507+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2549 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:46.512 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:46.509+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:47.433 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:47.436 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:23:51.513 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:51.510+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2588 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:23:56.514 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:23:56.511+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2606 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:01.515 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:01.512+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2629 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:06.516 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:06.512+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2647 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:11.517 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:11.513+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2668 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:16.518 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:16.514+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2686 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:17.528 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:17.531 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:21.519 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:21.515+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2709 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:26.520 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:26.516+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:31.521 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:31.517+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2748 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:36.522 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:36.519+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2766 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:41.523 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:41.520+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2789 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:46.524 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:46.521+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2807 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:47.617 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:47.620 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:24:51.525 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:51.522+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2828 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:24:56.526 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:24:56.522+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:01.527 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:01.523+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2869 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:06.528 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:06.524+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2887 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:11.529 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:11.525+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2908 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:16.530 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:16.526+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2926 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:17.716 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:17.719 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:21.531 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:21.528+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2949 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:26.532 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:26.530+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2967 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:31.533 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:31.531+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 2988 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:36.535 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:36.532+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3006 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:41.535 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:41.532+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3027 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:46.536 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:46.533+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:47.802 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:47.804 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:25:51.538 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:51.534+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3066 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:25:56.538 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:25:56.535+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3086 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:01.539 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:01.536+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3107 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:06.540 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:06.537+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3127 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:11.541 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:11.539+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3146 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:16.543 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:16.540+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3166 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:17.874 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:17.877 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:21.543 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:21.541+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3187 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:26.545 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:26.541+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3207 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:31.546 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:31.542+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3226 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:36.547 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:36.543+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3246 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:41.548 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:41.544+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3267 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:46.549 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:46.545+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3287 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:47.970 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:47.973 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:26:51.550 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:51.547+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3306 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:26:56.551 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:26:56.548+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3326 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:01.552 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:01.549+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3347 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:06.553 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:06.551+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3367 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:11.554 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:11.552+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3386 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:16.556 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:16.552+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3406 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:18.074 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:18.077 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:21.557 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:21.553+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:26.558 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:26.554+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3447 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:31.558 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:31.555+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3466 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:36.560 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:36.556+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3486 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:41.560 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:41.557+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3507 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:46.562 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:46.559+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:48.154 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:48.157 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:27:51.563 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:51.560+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3546 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:27:56.564 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:27:56.561+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3566 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:01.565 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:01.561+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3587 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:06.566 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:06.562+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:11.567 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:11.563+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3626 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:16.568 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:16.564+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3646 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:18.234 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:18.237 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:21.569 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:21.566+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:26.570 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:26.567+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3687 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:31.571 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:31.568+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3706 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:36.572 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:36.570+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3724 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:41.574 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:41.571+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3747 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:46.574 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:46.572+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3765 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:48.305 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:48.308 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:28:51.576 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:51.572+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3786 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:28:56.577 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:28:56.574+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3804 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:01.578 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:01.575+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3827 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:06.581 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:06.576+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3845 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:11.581 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:11.577+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3866 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:16.582 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:16.578+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3884 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:18.384 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:18.387 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:21.583 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:21.580+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:26.584 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:26.581+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3925 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:31.586 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:31.583+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:36.587 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:36.583+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3964 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:41.588 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:41.584+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 3987 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:46.589 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:46.585+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4005 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:48.473 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:48.475 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:29:51.590 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:51.587+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4026 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:29:56.591 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:29:56.588+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4044 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:01.592 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:01.589+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4067 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:06.593 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:06.590+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4085 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:11.595 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:11.592+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4106 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:16.011 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1376, in _read return self.channel.recv_stderr(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 749, in recv_stderr raise socket.timeout() timeout 2020-02-12T15:30:16.013 ERROR:teuthology:Uncaught exception (Hub) Traceback (most recent call last): File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 303, in copy_file_to copy_to_log(src, logger, capture=stream) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 272, in copy_to_log for line in f: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 108, in next line = self.readline() File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/file.py", line 291, in readline new_data = self._read(n) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 1361, in _read return self.channel.recv(size) File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/local/lib/python2.7/site-packages/paramiko/channel.py", line 701, in recv raise socket.timeout() timeout 2020-02-12T15:30:16.596 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:16.593+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4124 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:18.543 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:18.547 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:21.597 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:21.594+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4147 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:26.598 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:26.595+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4165 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:31.599 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:31.596+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4186 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:36.601 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:36.597+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4204 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:41.602 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:41.598+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4227 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:46.604 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:46.599+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4245 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:48.616 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:48.619 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:30:51.604 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:51.601+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4266 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:30:56.606 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:30:56.603+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4284 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:01.607 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:01.604+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4307 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:06.611 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:06.605+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4325 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:11.610 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:11.606+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4346 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:16.610 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:16.607+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4364 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:18.704 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:18.707 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:21.612 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:21.608+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4386 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:26.613 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:26.609+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4405 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:31.614 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:31.611+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4424 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:36.615 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:36.612+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4444 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:41.616 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:41.613+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4465 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:46.618 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:46.615+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4485 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:48.792 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:48.796 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:31:51.629 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:51.616+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4504 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:31:56.627 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:31:56.618+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4524 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:01.621 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:01.618+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4545 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:06.622 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:06.619+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4565 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:11.623 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:11.620+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4584 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:16.625 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:16.621+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4604 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:18.889 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:18.891 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:21.626 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:21.622+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4625 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:26.627 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:26.623+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:31.628 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:31.626+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4664 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:36.629 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:36.627+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4684 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:41.631 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:41.628+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4705 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:46.632 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:46.629+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4725 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:48.957 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:48.959 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:32:51.633 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:51.630+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4744 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:32:56.634 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:32:56.631+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4764 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:01.635 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:01.632+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4785 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:06.636 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:06.633+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4805 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:11.638 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:11.634+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4824 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:16.639 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:16.635+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4844 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:19.032 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:19.035 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:21.640 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:21.637+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4865 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:26.641 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:26.639+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4885 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:31.642 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:31.640+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4904 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:36.644 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:36.640+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4924 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:41.645 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:41.642+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4945 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:46.647 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:46.643+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:49.119 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:49.122 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:33:51.648 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:51.645+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 4984 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:33:56.650 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:33:56.646+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5004 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:01.651 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:01.647+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5025 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:06.652 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:06.650+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5045 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:11.654 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:11.651+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5064 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:16.655 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:16.652+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5083 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:19.267 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:19.270 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:21.656 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:21.654+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5105 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:26.658 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:26.654+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5123 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:31.659 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:31.656+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:36.661 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:36.657+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5162 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:41.662 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:41.658+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5185 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:46.663 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:46.660+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5203 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:49.329 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:49.332 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:34:51.664 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:51.661+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5224 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:34:56.665 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:34:56.663+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5242 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:01.667 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:01.664+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5265 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:06.668 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:06.666+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5283 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:11.669 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:11.666+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5304 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:16.671 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:16.667+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5322 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:19.484 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:19.487 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:21.674 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:21.669+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:26.674 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:26.670+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:31.675 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:31.671+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5384 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:36.676 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:36.673+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5402 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:41.677 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:41.674+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5425 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:46.679 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:46.676+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5443 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:49.625 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:49.634 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:35:51.680 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:51.678+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5464 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:35:56.681 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:35:56.679+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5482 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:01.683 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:01.679+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5505 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:06.684 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:06.680+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5523 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:11.686 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:11.682+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5544 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:16.687 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:16.683+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5562 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:19.743 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:19.746 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:21.688 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:21.685+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5585 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:26.690 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:26.686+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5603 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:31.691 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:31.688+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5624 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:36.692 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:36.689+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5642 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:41.693 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:41.691+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5665 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:46.695 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:46.691+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5683 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:49.831 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:49.834 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:36:51.696 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:51.692+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5704 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:36:56.697 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:36:56.694+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5722 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:01.698 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:01.695+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5745 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:06.700 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:06.696+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5763 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:11.701 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:11.698+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5782 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:16.702 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:16.699+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5801 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:19.911 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:19.914 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:21.704 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:21.701+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5823 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:26.705 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:26.703+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5843 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:31.707 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:31.704+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5863 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:36.709 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:36.705+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5883 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:41.710 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:41.706+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5905 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:46.711 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:46.708+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5925 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:50.024 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:50.027 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:37:51.713 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:51.709+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5945 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:37:56.714 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:37:56.711+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:01.716 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:01.712+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 5987 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:06.717 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:06.714+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6007 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:11.719 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:11.716+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6027 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:16.720 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:16.717+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:20.130 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:20.133 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:21.721 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:21.718+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6069 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:26.722 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:26.719+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6089 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:31.724 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:31.720+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6109 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:36.725 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:36.722+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6129 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:41.726 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:41.723+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6151 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:46.728 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:46.724+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6171 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:50.269 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:50.272 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:38:51.729 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:51.726+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6191 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:38:56.731 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:38:56.728+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:01.732 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:01.730+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6233 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:06.733 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:06.731+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6253 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:11.735 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:11.731+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6273 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:16.736 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:16.733+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6293 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:20.416 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:20.418 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:21.738 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:21.734+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6315 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:26.740 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:26.736+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6335 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:31.741 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:31.737+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6355 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:36.742 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:36.738+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6375 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:41.743 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:41.741+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6397 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:46.745 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:46.742+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6417 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:50.546 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:50.549 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:39:51.746 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:51.744+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6437 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:39:56.748 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:39:56.744+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:01.749 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:01.746+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6479 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:06.751 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:06.747+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6499 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:11.752 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:11.749+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6519 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:16.754 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:16.750+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6537 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:20.659 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:20.680 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:21.756 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:21.752+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6561 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:26.758 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:26.753+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6579 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:31.758 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:31.756+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6601 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:36.760 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:36.757+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6619 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:41.761 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:41.759+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6643 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:46.763 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:46.759+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6661 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:50.757 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:50.760 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:40:51.765 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:51.761+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6683 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:40:56.766 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:40:56.762+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6701 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:01.767 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:01.764+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6725 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:06.769 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:06.765+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6743 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:11.771 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:11.767+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6765 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:16.772 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:16.769+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6783 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:20.819 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:41:20.822 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:41:21.773 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:21.771+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6807 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:26.774 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:26.772+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6825 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:31.776 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:31.773+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6847 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:36.777 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:36.774+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6865 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:41.779 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:41.775+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6889 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:46.780 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:46.777+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:50.942 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:41:50.945 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:41:51.782 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:51.778+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6929 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:41:56.783 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:41:56.779+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6947 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:01.785 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:01.781+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6971 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:06.786 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:06.784+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 6989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:11.788 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:11.785+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7011 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:16.789 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:16.786+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7029 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:21.073 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:21.075 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:21.791 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:21.787+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7053 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:26.792 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:26.789+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7071 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:31.798 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:31.790+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7093 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:36.796 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:36.792+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:41.797 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:41.794+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7135 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:46.799 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:46.795+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7153 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:51.153 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:51.156 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:42:51.801 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:51.798+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7175 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:42:56.802 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:42:56.799+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7193 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:01.806 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:01.801+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7217 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:06.806 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:06.802+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7235 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:11.807 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:11.803+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7255 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:16.808 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:16.804+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7275 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:21.300 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:21.303 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:21.810 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:21.806+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7297 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:26.811 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:26.808+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7317 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:31.813 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:31.809+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7337 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:36.814 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:36.811+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7357 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:41.816 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:41.813+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7379 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:46.818 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:46.815+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7399 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:51.388 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:51.391 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:43:51.820 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:51.816+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7419 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:43:56.821 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:43:56.817+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7439 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:01.823 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:01.819+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7461 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:06.824 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:06.820+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7481 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:11.825 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:11.822+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7501 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:16.827 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:16.823+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7521 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:21.526 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:21.529 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:21.828 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:21.825+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7543 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:26.830 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:26.827+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7563 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:31.831 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:31.829+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7583 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:36.833 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:36.830+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7603 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:41.835 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:41.831+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7625 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:46.836 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:46.832+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:51.764 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:51.767 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:44:51.837 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:51.834+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7665 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:44:56.839 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:44:56.836+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:01.841 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:01.837+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7707 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:06.843 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:06.839+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:11.844 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:11.840+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7747 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:16.846 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:16.843+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7767 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:21.847 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:21.844+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7789 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:21.912 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:21.915 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:26.849 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:26.846+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7809 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:31.850 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:31.847+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7829 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:36.852 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:36.848+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:41.854 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:41.850+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7871 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:46.855 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:46.852+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7891 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:51.857 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:51.853+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7911 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:45:51.975 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:51.978 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:45:56.858 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:45:56.855+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7931 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:01.860 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:01.857+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7953 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:06.862 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:06.859+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7971 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:11.863 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:11.861+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 7993 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:16.865 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:16.861+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8011 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:21.867 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:21.863+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8035 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:22.114 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:22.118 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:26.869 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:26.865+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8053 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:31.870 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:31.866+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8075 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:36.872 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:36.868+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8093 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:41.873 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:41.869+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8117 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:46.875 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:46.872+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8135 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:51.877 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:51.874+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8157 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:46:52.202 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:52.204 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:46:56.878 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:46:56.876+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8175 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:01.880 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:01.877+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8199 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:06.881 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:06.878+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8217 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:11.883 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:11.879+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8239 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:16.885 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:16.881+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8257 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:21.886 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:21.883+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8281 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:22.349 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:22.352 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:26.890 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:26.884+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8299 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:31.890 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:31.886+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8321 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:36.892 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:36.889+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8339 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:41.893 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:41.890+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:46.895 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:46.892+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8381 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:51.896 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:51.893+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8403 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:47:52.446 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:52.449 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:47:56.898 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:47:56.894+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8421 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:01.900 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:01.896+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8445 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:06.902 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:06.898+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8463 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:11.903 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:11.899+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8485 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:16.905 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:16.901+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8503 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:21.906 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:21.904+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:22.584 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:22.586 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:26.908 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:26.905+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8545 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:31.910 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:31.907+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:36.912 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:36.909+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8585 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:41.914 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:41.910+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8609 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:46.915 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:46.911+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8627 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:51.917 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:51.913+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8649 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:48:52.672 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:52.675 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:48:56.919 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:48:56.915+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:01.921 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:01.917+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8689 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:06.922 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:06.918+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8709 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:11.924 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:11.921+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8729 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:16.926 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:16.923+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8749 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:21.928 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:21.924+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8771 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:22.766 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:22.769 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:26.929 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:26.925+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8791 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:31.931 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:31.927+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8811 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:36.932 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:36.928+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8831 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:41.934 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:41.930+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8853 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:46.935 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:46.932+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8873 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:51.937 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:51.934+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8893 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:49:52.833 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:52.836 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:49:56.940 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:49:56.936+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8913 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:01.941 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:01.938+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8935 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:06.943 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:06.940+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8955 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:11.944 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:11.941+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8975 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:16.946 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:16.942+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 8995 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:21.948 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:21.944+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9017 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:22.947 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:22.950 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:26.950 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:26.946+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9037 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:31.951 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:31.947+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9057 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:36.953 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:36.949+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9077 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:41.954 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:41.951+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9099 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:46.956 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:46.953+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9119 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:51.958 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:51.955+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9139 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:50:53.078 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:53.080 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:50:56.960 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:50:56.957+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9159 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:01.962 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:01.958+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:06.964 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:06.960+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9201 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:11.966 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:11.962+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9221 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:16.969 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:16.964+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9241 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:21.969 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:21.965+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9263 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:23.216 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:23.218 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:26.971 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:26.967+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9283 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:31.973 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:31.970+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9303 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:36.975 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:36.972+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9323 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:41.976 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:41.973+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:46.978 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:46.975+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9365 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:51.980 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:51.976+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9385 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:51:53.330 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:53.333 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:51:56.982 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:51:56.978+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9404 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:01.984 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:01.980+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:06.985 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:06.981+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9445 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:11.987 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:11.983+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9467 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:16.989 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:16.985+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9485 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:21.991 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:21.988+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9509 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:23.476 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:23.479 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:26.992 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:26.989+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:31.994 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:31.991+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9549 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:36.996 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:36.992+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:41.998 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:41.994+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:46.999 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:46.996+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9610 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:52.001 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:51.997+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9631 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:52:53.565 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:53.568 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:52:57.003 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:52:56.999+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9650 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:02.005 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:02.001+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9673 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:07.006 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:07.003+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9692 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:12.008 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:12.005+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9713 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:17.010 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:17.007+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9732 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:22.011 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:22.009+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9755 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:23.705 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:23.707 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:27.014 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:27.010+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9774 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:32.019 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:32.011+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9795 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:37.017 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:37.013+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9814 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:42.019 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:42.015+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9837 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:47.020 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:47.017+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9856 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:52.022 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:52.018+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9877 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:53:53.767 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:53.771 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:53:57.024 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:53:57.021+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9896 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:02.026 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:02.023+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9919 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:07.027 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:07.025+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9938 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:12.029 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:12.025+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9959 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:17.031 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:17.027+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 9978 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:22.033 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:22.029+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10001 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:23.873 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:23.876 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:27.035 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:27.031+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10020 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:32.037 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:32.033+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10041 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:37.038 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:37.035+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10060 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:42.041 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:42.038+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10083 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:47.042 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:47.039+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10102 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:52.044 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:52.041+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10123 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:54:53.953 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:53.956 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:54:57.046 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:54:57.043+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10142 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:02.048 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:02.044+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10163 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:07.050 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:07.046+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10184 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:12.052 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:12.048+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10203 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:17.054 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:17.050+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10224 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:22.055 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:22.051+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10245 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:24.075 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:24.078 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:27.057 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:27.053+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10266 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:32.059 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:32.056+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10285 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:37.061 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:37.058+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10306 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:42.062 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:42.060+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10327 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:47.064 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:47.061+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10348 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:52.066 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:52.062+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10367 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:55:54.205 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:54.208 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:55:57.068 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:55:57.064+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10388 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:02.070 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:02.066+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10409 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:07.071 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:07.068+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10430 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:12.074 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:12.070+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10449 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:17.075 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:17.072+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10470 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:22.077 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:22.074+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10491 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:24.336 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:24.338 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:27.079 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:27.076+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10512 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:32.081 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:32.078+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10531 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:37.082 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:37.079+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10552 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:42.085 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:42.081+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10573 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:47.086 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:47.083+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10594 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:52.088 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:52.085+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10613 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:56:54.416 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:54.419 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:56:57.090 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:56:57.087+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10634 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:02.092 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:02.088+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10655 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:07.094 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:07.091+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10676 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:12.096 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:12.093+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10695 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:17.098 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:17.095+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10716 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:22.099 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:22.096+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10737 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:24.546 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:57:24.548 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:57:27.102 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:27.098+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10758 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:32.104 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:32.100+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10777 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:37.106 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:37.102+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10798 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:42.108 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:42.104+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10819 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:47.110 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:47.106+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10840 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:52.112 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:52.109+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10859 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:57:54.659 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:57:54.662 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:57:57.113 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:57:57.111+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10878 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:02.115 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:02.112+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10901 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:07.117 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:07.114+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10920 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:12.119 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:12.115+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10941 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:17.121 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:17.118+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10960 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:22.123 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:22.120+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 10983 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:24.742 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:24.745 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:27.125 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:27.122+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11002 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:32.127 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:32.124+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11023 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:37.129 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:37.126+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11042 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:42.132 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:42.129+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11065 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:47.134 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:47.131+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11084 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:52.135 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:52.133+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11105 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:58:54.803 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:54.806 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:58:57.137 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:58:57.134+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11124 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:02.139 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:02.136+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11147 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:07.141 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:07.138+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11166 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:12.143 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:12.140+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11187 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:17.145 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:17.141+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11206 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:22.147 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:22.143+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11229 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:24.934 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:24.937 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:27.149 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:27.146+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11248 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:32.151 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:32.148+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11269 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:37.153 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:37.151+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11288 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:42.155 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:42.152+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11311 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:47.157 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:47.153+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11330 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:52.159 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:52.156+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11351 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T15:59:55.287 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:55.289 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T15:59:57.162 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T15:59:57.158+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11370 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:02.170 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:02.160+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11393 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:07.165 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:07.161+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11412 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:12.167 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:12.163+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11433 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:17.169 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:17.166+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11452 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:22.171 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:22.169+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11475 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:25.365 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:25.369 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:27.174 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:27.170+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11494 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:32.175 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:32.172+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11515 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:37.177 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:37.174+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11534 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:42.179 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:42.176+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11557 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:47.181 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:47.178+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11576 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:52.183 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:52.180+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11596 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:00:55.512 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:55.515 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:00:57.185 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:00:57.181+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11616 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:02.187 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:02.185+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11637 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:07.189 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:07.186+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11658 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:12.191 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:12.188+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11677 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:17.193 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:17.190+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11698 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:22.195 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:22.192+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11719 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:25.576 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:25.579 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:27.198 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:27.194+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11740 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:32.199 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:32.196+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11759 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:37.202 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:37.198+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11780 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:42.204 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:42.201+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11801 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:47.206 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:47.203+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11822 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:52.208 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:52.206+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11841 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:01:55.647 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:55.650 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:01:57.210 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:01:57.208+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11862 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:02.213 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:02.210+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11883 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:07.215 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:07.211+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11904 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:12.217 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:12.214+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11923 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:17.219 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:17.215+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11944 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:22.221 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:22.217+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:25.702 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:25.706 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:27.223 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:27.219+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 11986 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:32.225 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:32.222+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12005 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:37.227 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:37.225+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12026 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:42.229 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:42.227+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:47.231 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:47.229+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12068 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:52.233 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:52.230+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12087 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:02:55.892 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:55.896 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:02:57.235 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:02:57.232+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12108 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:02.237 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:02.234+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12129 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:07.239 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:07.236+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12150 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:12.243 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:12.238+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12169 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:17.243 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:17.240+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12190 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:22.245 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:22.242+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:25.964 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:25.967 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:27.248 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:27.245+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12232 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:32.250 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:32.248+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12251 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:37.253 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:37.250+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12272 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:42.255 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:42.252+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12293 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:47.257 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:47.254+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12314 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:52.259 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:52.256+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12333 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:03:56.033 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:56.036 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:03:57.262 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:03:57.258+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12353 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:02.264 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:02.260+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12375 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:07.266 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:07.262+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12394 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:12.267 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:12.265+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12415 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:17.270 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:17.268+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12435 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:22.272 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:22.270+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:26.189 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:26.192 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:27.275 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:27.271+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12476 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:32.277 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:32.274+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12497 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:37.278 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:37.275+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12518 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:42.281 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:42.278+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12539 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:47.283 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:47.279+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12558 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:52.285 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:52.281+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12579 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:04:56.311 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:56.314 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:04:57.287 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:04:57.284+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12600 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:02.289 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:02.287+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12621 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:07.291 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:07.288+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12640 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:12.293 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:12.291+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12661 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:17.295 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:17.292+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12682 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:22.519 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:22.294+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12703 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:26.474 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:26.477 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:27.299 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:27.296+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12722 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:32.302 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:32.299+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12743 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:37.307 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:37.301+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12764 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:42.306 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:42.303+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12785 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:47.308 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:47.306+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12804 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:52.311 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:52.309+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12825 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:05:56.537 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:56.540 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:05:57.313 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:05:57.311+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12846 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:02.317 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:02.312+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12867 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:07.317 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:07.314+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12886 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:12.319 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:12.316+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:17.322 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:17.318+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12928 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:22.324 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:22.321+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12949 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:26.625 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:26.628 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:27.326 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:27.323+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12968 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:32.328 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:32.325+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 12989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:37.330 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:37.328+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13010 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:42.332 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:42.330+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13031 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:47.334 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:47.332+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13050 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:52.337 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:52.334+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13071 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:06:56.731 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:56.734 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:06:57.339 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:06:57.336+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:02.341 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:02.338+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:07.344 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:07.340+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13132 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:12.346 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:12.343+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13151 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:17.348 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:17.345+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13174 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:22.350 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:22.348+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13193 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:26.868 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:26.871 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:27.353 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:27.350+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13214 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:32.354 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:32.352+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13233 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:37.357 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:37.354+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13256 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:42.359 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:42.356+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13275 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:47.361 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:47.358+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13296 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:52.364 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:52.361+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13315 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:07:56.944 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:56.948 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:07:57.366 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:07:57.363+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13338 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:02.368 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:02.365+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13357 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:07.370 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:07.367+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13378 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:12.373 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:12.371+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13397 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:17.375 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:17.373+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:22.377 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:22.375+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13439 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:27.104 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:27.106 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:27.380 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:27.376+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13460 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:32.382 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:32.379+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13479 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:37.384 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:37.381+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13502 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:42.386 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:42.383+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13521 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:47.389 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:47.385+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13542 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:52.391 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:52.388+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13561 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:08:57.241 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:57.243 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:08:57.393 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:08:57.391+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13584 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:02.395 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:02.393+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13603 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:07.398 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:07.396+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13624 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:12.400 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:12.397+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13643 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:17.402 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:17.399+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13666 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:22.404 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:22.401+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:27.371 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:09:27.374 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:09:27.406 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:27.403+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13706 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:32.408 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:32.405+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13725 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:37.410 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:37.407+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13748 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:42.413 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:42.409+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13767 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:47.414 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:47.412+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13788 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:52.417 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:52.415+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13807 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:57.419 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:09:57.417+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13828 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:09:57.511 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:09:57.514 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:02.421 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:02.418+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:07.423 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:07.420+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13868 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:12.426 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:12.423+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13889 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:17.428 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:17.425+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13910 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:22.430 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:22.427+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13931 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:27.432 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:27.429+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13950 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:27.691 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:27.695 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:32.435 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:32.433+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13971 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:37.437 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:37.435+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 13992 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:42.439 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:42.437+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14013 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:47.442 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:47.439+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14032 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:52.444 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:52.441+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14053 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:57.446 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:10:57.443+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14074 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:10:57.838 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:10:57.841 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:02.449 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:02.445+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14095 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:07.451 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:07.448+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14114 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:12.453 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:12.450+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14135 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:17.455 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:17.452+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14156 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:22.458 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:22.456+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14177 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:27.460 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:27.458+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14196 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:27.895 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:27.898 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:32.462 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:32.460+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14217 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:37.465 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:37.461+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14238 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:42.467 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:42.464+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14259 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:47.469 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:47.466+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14278 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:52.472 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:52.468+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14299 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:57.474 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:11:57.471+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14320 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:11:58.023 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:11:58.026 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:02.476 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:02.473+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14341 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:07.479 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:07.477+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14360 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:12.482 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:12.479+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14381 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:17.484 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:17.482+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14402 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:22.486 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:22.483+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14423 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:27.488 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:27.485+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14442 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:28.178 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:28.182 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:32.491 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:32.488+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14463 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:37.493 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:37.490+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14484 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:42.496 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:42.492+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14505 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:47.498 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:47.495+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14524 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:52.501 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:52.498+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14545 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:57.503 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:12:57.500+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14566 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:12:58.300 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:12:58.305 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:02.505 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:02.503+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14585 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:07.507 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:07.505+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14606 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:12.510 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:12.507+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14625 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:17.513 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:17.510+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14648 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:22.515 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:22.512+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:27.517 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:27.514+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14688 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:28.438 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:28.441 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:32.520 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:32.517+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14707 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:37.522 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:37.519+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14730 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:42.525 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:42.523+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14749 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:47.527 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:47.525+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14770 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:52.530 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:52.527+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14789 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:57.532 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:13:57.529+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14812 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:13:58.576 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:13:58.579 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:02.535 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:02.532+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14831 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:07.537 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:07.534+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14852 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:12.540 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:12.537+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14871 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:17.542 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:17.539+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14894 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:22.544 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:22.541+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14913 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:27.547 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:27.545+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14934 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:28.681 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:28.684 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:32.550 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:32.547+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14953 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:37.552 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:37.550+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14976 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:42.557 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:42.552+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 14995 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:47.557 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:47.554+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15016 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:52.559 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:52.556+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15035 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:57.561 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:14:57.558+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15058 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:14:59.053 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:14:59.056 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:02.564 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:02.561+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15077 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:07.566 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:07.563+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15098 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:12.569 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:12.566+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15117 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:17.571 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:17.569+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15140 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:22.574 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:22.571+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15159 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:27.576 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:27.574+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15180 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:29.124 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:29.128 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:32.578 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:32.575+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15199 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:37.581 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:37.577+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15222 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:42.583 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:42.580+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15241 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:47.586 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:47.583+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15262 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:52.588 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:52.585+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15281 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:57.591 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:15:57.588+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15303 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:15:59.255 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:15:59.258 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:02.594 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:02.591+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15323 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:07.596 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:07.594+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15342 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:12.598 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:12.596+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:17.601 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:17.599+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15384 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:22.603 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:22.600+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15405 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:27.606 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:27.603+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15424 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:29.351 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:29.354 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:32.609 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:32.605+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15445 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:37.611 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:37.608+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15466 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:42.613 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:42.610+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15487 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:47.616 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:47.613+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15506 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:52.618 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:52.616+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15527 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:57.620 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:16:57.618+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15548 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:16:59.482 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:16:59.486 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:02.623 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:02.621+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15569 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:07.626 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:07.623+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15588 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:12.628 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:12.625+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15609 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:17.631 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:17.628+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15630 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:22.634 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:22.630+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15651 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:27.636 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:27.633+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15670 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:29.638 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:29.640 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:32.643 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:32.635+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15691 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:37.641 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:37.639+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15712 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:42.643 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:42.641+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15733 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:47.646 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:47.644+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15752 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:52.649 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:52.646+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15773 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:57.651 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:17:57.648+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15794 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:17:59.785 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:17:59.788 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:18:02.654 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:02.651+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15815 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:07.656 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:07.653+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15834 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:12.659 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:12.656+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15855 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:17.661 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:17.658+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15876 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:22.664 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:22.661+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15897 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:27.667 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:27.665+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15916 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:29.889 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:18:29.892 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:18:32.670 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:32.668+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15937 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:37.672 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:37.670+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15958 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:42.675 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:42.672+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15979 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:47.677 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:47.674+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 15998 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:52.680 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:52.677+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16019 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:18:57.683 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:18:57.680+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16040 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:00.012 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:00.015 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:02.685 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:02.682+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16060 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:07.688 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:07.685+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16080 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:12.691 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:12.688+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16099 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:17.693 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:17.691+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16122 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:22.701 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:22.694+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16141 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:27.699 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:27.696+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16162 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:30.075 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:30.079 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:19:32.701 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:32.698+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:37.705 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:37.701+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16204 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:42.706 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:42.703+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16223 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:47.709 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:47.706+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16244 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:52.711 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:52.708+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16263 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:19:57.714 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:19:57.711+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16286 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:00.142 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:00.145 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:02.717 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:02.715+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16305 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:07.719 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:07.717+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16326 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:12.723 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:12.720+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:17.725 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:17.722+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16368 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:22.727 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:22.724+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16387 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:27.730 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:27.727+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16408 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:30.281 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:30.283 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:20:32.733 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:32.730+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:37.735 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:37.732+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16450 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:42.738 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:42.735+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16469 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:47.741 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:47.739+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16490 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:52.743 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:52.741+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16509 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:20:57.746 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:20:57.744+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16532 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:00.393 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:00.396 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:02.749 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:02.747+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16551 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:07.751 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:07.748+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16572 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:12.759 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:12.751+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:17.757 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:17.754+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16614 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:22.760 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:22.757+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16633 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:27.762 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:27.759+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16654 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:30.523 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:30.526 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:21:32.765 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:32.762+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16673 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:37.768 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:37.766+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16696 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:42.771 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:42.769+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16715 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:47.773 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:47.771+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16736 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:52.776 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:52.773+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16755 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:21:57.779 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:21:57.776+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16778 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:00.646 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:00.649 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:02.781 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:02.778+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16797 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:07.791 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:07.781+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16816 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:12.786 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:12.784+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16837 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:17.789 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:17.786+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16858 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:22.792 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:22.790+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16879 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:27.795 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:27.793+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16898 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:30.792 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:30.795 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:22:32.797 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:32.795+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16919 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:37.800 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:37.797+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16940 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:42.803 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:42.800+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16961 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:47.806 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:47.803+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 16980 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:52.809 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:52.806+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17001 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:22:57.814 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:22:57.809+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17022 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:00.889 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:00.892 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:02.815 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:02.812+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17043 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:07.818 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:07.815+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17062 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:12.821 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:12.819+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17083 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:17.824 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:17.822+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17104 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:22.827 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:22.825+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17125 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:27.830 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:27.827+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:31.003 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:31.005 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:23:32.833 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:32.830+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17165 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:37.835 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:37.832+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17186 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:42.838 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:42.835+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17207 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:47.841 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:47.838+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17226 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:52.853 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:52.840+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17247 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:23:57.846 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:23:57.844+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17268 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:01.073 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:01.076 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:02.849 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:02.847+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17289 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:07.852 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:07.850+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17308 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:12.855 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:12.852+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17329 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:17.858 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:17.854+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17350 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:22.861 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:22.857+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17371 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:27.863 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:27.860+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:31.247 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:31.250 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:24:32.866 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:32.863+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17411 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:37.869 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:37.866+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17432 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:42.872 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:42.869+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17453 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:47.874 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:47.872+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17472 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:52.877 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:52.875+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17493 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:24:57.880 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:24:57.878+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17514 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:01.416 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:01.419 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:02.883 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:02.880+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17535 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:07.886 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:07.883+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17554 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:12.889 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:12.885+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17573 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:17.892 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:17.888+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17596 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:22.894 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:22.891+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17615 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:27.902 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:27.894+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17636 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:31.542 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:31.545 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:25:32.900 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:32.898+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17655 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:37.903 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:37.901+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17678 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:42.905 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:42.903+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17697 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:47.908 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:47.905+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17718 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:52.911 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:52.908+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17737 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:25:57.914 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:25:57.911+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17760 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:01.681 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:01.685 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:02.917 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:02.914+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17779 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:07.919 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:07.916+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17800 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:12.922 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:12.919+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17819 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:17.925 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:17.922+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17842 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:22.928 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:22.926+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17861 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:27.931 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:27.929+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17882 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:31.812 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:31.815 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:26:32.934 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:32.932+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17901 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:37.937 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:37.934+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17924 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:42.940 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:42.937+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17943 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:47.944 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:47.940+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17964 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:52.945 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:52.942+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 17983 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:26:57.948 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:26:57.945+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18006 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:01.949 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:01.952 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:02.951 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:02.948+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18025 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:07.954 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:07.952+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18046 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:12.957 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:12.955+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18065 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:17.960 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:17.958+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18088 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:22.963 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:22.960+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18107 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:27.966 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:27.963+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18128 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:32.107 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:32.109 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:27:32.969 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:32.966+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18147 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:37.971 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:37.968+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18170 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:42.975 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:42.972+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18189 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:47.977 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:47.974+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18210 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:52.980 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:52.977+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18229 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:27:57.983 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:27:57.980+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18252 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:02.269 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:02.272 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:02.986 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:02.983+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18271 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:07.988 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:07.986+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18292 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:12.991 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:12.988+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18311 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:17.994 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:17.991+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18332 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:22.997 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:22.994+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18353 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:28.001 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:27.998+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18372 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:32.390 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:32.393 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:28:33.004 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:33.001+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18393 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:38.007 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:38.004+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18414 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:43.011 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:43.009+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18435 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:48.017 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:48.012+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18454 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:53.019 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:53.015+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18475 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:28:58.021 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:28:58.017+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18496 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:02.554 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:02.556 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:03.023 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:03.020+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18517 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:08.026 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:08.023+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18536 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:13.030 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:13.027+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18557 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:18.033 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:18.030+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18578 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:23.042 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:23.033+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18599 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:28.039 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:28.036+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18618 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:32.709 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:32.711 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:29:33.042 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:33.040+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18639 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:38.044 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:38.042+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18660 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:43.048 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:43.045+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18681 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:48.050 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:48.047+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18700 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:53.053 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:53.050+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18721 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:29:58.056 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:29:58.053+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18742 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:02.846 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:02.849 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:03.059 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:03.056+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18763 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:08.062 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:08.059+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18782 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:13.066 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:13.063+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18803 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:18.069 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:18.067+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18824 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:23.072 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:23.070+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18845 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:28.075 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:28.073+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18864 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:32.941 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:32.944 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:30:33.078 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:33.075+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18885 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:38.081 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:38.078+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18906 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:43.084 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:43.081+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18927 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:48.087 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:48.083+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18946 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:53.089 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:53.086+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18967 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:30:58.093 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:30:58.089+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 18988 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:03.096 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:03.094+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19009 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:03.098 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:03.101 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:08.098 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:08.096+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19028 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:13.102 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:13.100+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19049 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:18.105 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:18.103+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19070 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:23.108 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:23.105+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19089 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:28.111 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:28.108+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19110 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:33.114 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:33.111+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19129 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:33.236 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:33.240 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:31:38.117 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:38.114+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19152 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:43.120 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:43.117+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19171 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:48.123 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:48.120+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19192 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:53.126 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:53.124+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:31:58.129 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:31:58.127+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19234 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:03.136 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:03.130+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19253 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:03.366 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:03.387 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:08.135 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:08.132+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19274 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:13.138 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:13.135+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19293 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:18.141 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:18.138+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19316 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:23.144 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:23.141+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19335 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:28.147 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:28.144+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19356 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:33.150 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:33.147+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19375 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:33.469 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:33.474 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:32:38.155 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:38.151+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19398 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:43.156 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:43.154+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19417 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:48.162 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:48.157+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19438 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:53.162 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:53.160+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:32:58.165 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:32:58.162+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19480 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:03.168 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:03.165+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19499 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:03.537 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:03.540 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:08.171 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:08.168+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19520 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:13.174 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:13.171+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19539 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:18.177 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:18.174+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19562 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:23.180 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:23.177+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19581 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:28.184 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:28.182+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19602 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:33.187 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:33.185+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19621 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:33.654 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:33.656 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:33:38.191 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:38.188+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19644 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:43.193 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:43.190+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19663 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:48.197 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:48.194+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19684 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:53.200 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:53.197+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19703 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:33:58.203 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:33:58.200+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19726 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:03.206 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:03.203+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19745 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:03.783 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:03.786 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:08.209 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:08.206+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19766 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:13.213 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:13.210+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19785 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:18.215 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:18.213+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19808 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:23.218 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:23.216+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19827 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:28.221 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:28.219+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19847 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:33.224 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:33.221+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19867 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:33.922 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:33.925 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:34:38.227 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:38.224+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19888 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:43.230 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:43.227+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19909 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:48.234 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:48.230+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19928 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:53.236 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:53.233+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19949 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:34:58.239 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:34:58.236+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19970 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:03.243 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:03.241+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 19991 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:04.010 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:04.014 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:08.246 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:08.244+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20010 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:13.249 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:13.247+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20031 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:18.253 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:18.249+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20052 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:23.256 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:23.252+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20073 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:28.261 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:28.255+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20092 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:33.262 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:33.259+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20113 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:34.149 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:34.152 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:35:38.265 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:38.262+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20134 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:43.269 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:43.265+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20155 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:48.272 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:48.270+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20174 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:53.275 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:53.273+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20195 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:35:58.278 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:35:58.276+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20216 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:03.281 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:03.279+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20237 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:04.270 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:04.272 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:08.284 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:08.281+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20256 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:13.289 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:13.284+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20277 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:18.291 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:18.287+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20298 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:23.294 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:23.291+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20319 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:28.297 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:28.294+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20338 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:33.300 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:33.297+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20359 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:34.440 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:34.442 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:36:38.304 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:38.301+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20380 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:43.307 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:43.305+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20401 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:48.310 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:48.308+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20420 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:53.314 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:53.310+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20441 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:36:58.317 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:36:58.314+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20462 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:03.320 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:03.317+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20483 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:04.522 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:04.525 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:08.327 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:08.320+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20502 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:13.327 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:13.323+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20523 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:18.330 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:18.327+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20544 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:23.333 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:23.331+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20565 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:28.336 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:28.334+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20584 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:33.339 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:33.337+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20605 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:34.649 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:34.652 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:37:38.342 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:38.340+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20626 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:43.346 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:43.342+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20645 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:48.349 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:48.346+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20666 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:53.353 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:53.349+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:37:58.355 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:37:58.352+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20708 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:03.358 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:03.355+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:04.796 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:04.799 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:08.361 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:08.358+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20748 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:13.367 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:13.362+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20768 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:18.368 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:18.366+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20790 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:23.371 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:23.369+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20809 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:28.374 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:28.371+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20830 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:33.377 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:33.374+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20850 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:34.936 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:34.939 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:38:38.381 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:38.377+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20872 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:43.384 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:43.380+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20891 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:48.387 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:48.384+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20912 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:53.390 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:53.387+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20933 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:38:58.394 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:38:58.391+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20954 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:03.397 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:03.395+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20973 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:05.098 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:05.101 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:08.400 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:08.398+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 20994 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:13.403 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:13.401+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21015 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:18.407 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:18.404+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21036 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:23.410 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:23.407+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21055 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:28.414 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:28.411+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21076 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:33.417 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:33.414+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21097 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:35.178 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:35.181 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:39:38.421 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:38.418+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21118 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:43.424 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:43.421+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21137 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:48.428 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:48.426+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21158 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:53.431 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:53.429+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21179 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:39:58.434 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:39:58.432+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21200 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:03.438 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:03.435+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21219 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:05.242 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:05.245 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:08.441 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:08.438+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21240 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:13.444 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:13.441+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21260 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:18.448 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:18.445+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21281 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:23.451 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:23.448+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21300 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:28.455 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:28.451+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21321 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:33.458 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:33.456+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21342 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:35.396 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:35.398 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:40:38.462 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:38.459+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21363 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:43.465 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:43.462+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21382 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:48.468 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:48.466+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21401 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:53.472 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:53.469+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21424 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:40:58.476 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:40:58.473+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21443 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:03.479 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:03.476+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21464 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:05.525 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:05.529 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:08.483 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:08.479+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21483 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:13.486 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:13.483+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21506 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:18.489 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:18.486+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21525 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:23.493 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:23.490+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21546 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:28.496 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:28.494+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21565 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:33.499 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:33.497+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21588 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:35.585 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:35.587 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:41:38.503 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:38.500+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:43.507 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:43.504+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21628 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:48.510 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:48.507+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21647 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:53.514 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:53.511+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21670 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:41:58.518 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:41:58.514+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21689 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:03.521 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:03.518+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21710 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:05.719 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:05.722 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:08.524 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:08.522+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21729 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:13.528 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:13.525+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21752 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:18.531 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:18.529+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21771 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:23.535 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:23.531+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21792 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:28.538 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:28.535+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21811 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:33.542 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:33.538+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21834 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:35.823 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:35.825 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:42:38.545 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:38.541+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21853 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:43.548 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:43.545+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21874 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:48.552 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:48.548+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21893 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:53.555 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:53.552+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21916 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:42:58.559 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:42:58.556+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21935 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:03.562 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:03.560+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21956 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:05.935 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:05.938 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:08.566 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:08.563+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21975 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:13.569 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:13.566+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 21998 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:18.573 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:18.570+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22017 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:23.576 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:23.573+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22038 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:28.579 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:28.576+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22057 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:33.583 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:33.580+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22080 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:36.106 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:36.118 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:43:38.587 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:38.584+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22099 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:43.590 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:43.588+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22120 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:48.596 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:48.592+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22139 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:53.598 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:53.595+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22160 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:43:58.601 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:43:58.599+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:03.605 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:03.601+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22200 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:06.239 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:06.242 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:08.608 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:08.605+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22221 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:13.611 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:13.608+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22242 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:18.615 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:18.612+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22263 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:23.619 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:23.615+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22282 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:28.622 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:28.619+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22303 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:33.626 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:33.624+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22324 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:36.417 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:36.420 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:44:38.631 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:38.628+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:43.633 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:43.631+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22364 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:48.637 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:48.633+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22385 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:53.640 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:53.637+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22406 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:44:58.644 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:44:58.641+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:03.647 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:03.644+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22446 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:06.548 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:06.554 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:08.651 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:08.648+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22467 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:13.655 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:13.651+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22488 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:18.659 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:18.656+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22509 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:23.662 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:23.660+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22528 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:28.666 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:28.664+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22549 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:33.669 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:33.667+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22570 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:36.610 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:36.613 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:45:38.673 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:38.670+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22591 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:43.676 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:43.673+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22610 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:48.680 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:48.677+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22631 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:53.684 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:53.681+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22652 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:45:58.687 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:45:58.684+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22673 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:03.691 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:03.688+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22692 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:06.674 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:06.676 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:08.694 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:08.691+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22713 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:13.698 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:13.696+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22734 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:18.702 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:18.700+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22755 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:23.705 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:23.703+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22774 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:28.709 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:28.707+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22795 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:33.712 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:33.709+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22816 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:36.804 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:36.807 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:46:38.716 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:38.713+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22837 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:43.720 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:43.717+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22856 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:48.724 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:48.721+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22877 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:53.727 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:53.724+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22898 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:46:58.731 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:46:58.728+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22919 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:03.734 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:03.732+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22938 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:06.951 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:06.954 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:08.738 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:08.736+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22957 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:13.741 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:13.739+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22980 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:18.745 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:18.742+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 22999 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:23.749 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:23.746+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23020 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:28.752 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:28.749+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23039 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:33.757 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:33.753+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23062 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:37.089 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:37.091 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:47:38.760 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:38.757+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23081 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:43.763 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:43.760+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23102 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:48.767 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:48.765+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23121 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:53.771 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:53.769+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23144 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:47:58.775 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:47:58.772+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23163 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:03.778 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:03.776+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23184 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:07.245 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:07.248 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:08.782 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:08.779+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23203 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:13.786 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:13.783+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23226 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:18.790 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:18.786+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23245 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:23.793 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:23.790+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23266 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:28.797 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:28.794+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23285 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:33.801 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:33.798+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23308 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:37.399 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:37.402 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:48:38.804 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:38.802+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23327 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:43.808 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:43.806+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23348 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:48.812 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:48.809+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23367 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:53.816 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:53.812+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:48:58.818 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:48:58.815+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23409 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:03.823 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:03.819+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23430 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:07.488 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:07.491 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:08.825 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:08.822+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23449 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:13.829 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:13.826+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23472 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:18.833 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:18.830+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23491 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:23.836 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:23.833+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23512 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:28.845 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:28.838+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23531 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:33.844 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:33.842+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23554 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:37.582 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:37.584 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:49:38.848 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:38.846+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23573 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:43.852 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:43.849+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23594 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:48.856 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:48.853+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23613 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:53.860 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:53.857+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23636 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:49:58.864 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:49:58.861+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23655 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:03.868 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:03.865+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23676 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:07.750 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:07.752 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:08.871 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:08.869+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23695 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:13.876 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:13.874+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23716 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:18.879 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:18.877+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23737 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:23.883 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:23.881+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23756 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:28.887 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:28.884+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23777 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:33.890 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:33.887+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23799 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:37.866 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:37.868 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:50:38.894 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:38.891+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23819 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:43.898 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:43.895+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23839 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:48.902 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:48.899+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23859 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:53.906 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:53.903+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23881 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:50:58.910 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:50:58.907+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23901 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:03.914 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:03.912+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23921 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:07.983 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:07.986 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:08.917 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:08.915+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23941 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:13.921 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:13.919+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23963 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:18.925 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:18.922+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 23983 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:23.929 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:23.926+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24003 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:28.932 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:28.929+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24023 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:33.936 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:33.933+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24045 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:38.155 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:38.158 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:51:38.940 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:38.937+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24065 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:43.948 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:43.941+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24085 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:48.948 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:48.945+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24105 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:53.951 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:53.949+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24127 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:51:58.955 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:51:58.953+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24147 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:03.959 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:03.957+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24167 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:08.285 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:08.288 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:08.963 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:08.960+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24187 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:13.967 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:13.964+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24209 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:18.970 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:18.967+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24229 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:23.974 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:23.971+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24249 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:28.978 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:28.975+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24269 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:33.984 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:33.980+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24291 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:38.398 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:38.401 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:52:38.987 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:38.985+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24311 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:43.992 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:43.989+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24331 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:48.995 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:48.993+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24351 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:53.999 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:53.996+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24373 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:52:59.003 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:52:59.000+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24393 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:04.007 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:04.004+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24413 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:08.549 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:08.552 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:09.010 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:09.007+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24433 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:14.014 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:14.011+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24455 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:19.018 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:19.015+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24475 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:24.022 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:24.019+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24495 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:29.026 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:29.024+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24513 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:34.030 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:34.028+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24537 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:38.692 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:38.696 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:53:39.034 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:39.032+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24555 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:44.039 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:44.035+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24577 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:49.041 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:49.038+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24595 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:54.045 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:54.042+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24619 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:53:59.049 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:53:59.046+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24637 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:04.052 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:04.049+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24659 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:08.795 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:08.798 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:09.056 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:09.053+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24677 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:14.061 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:14.058+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24701 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:19.064 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:19.062+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24719 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:24.067 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:24.065+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24741 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:29.072 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:29.068+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24759 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:34.075 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:34.072+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24783 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:38.942 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:38.945 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:54:39.079 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:39.076+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24801 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:44.083 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:44.080+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24823 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:49.087 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:49.084+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24841 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:54.091 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:54.088+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24865 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:54:59.095 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:54:59.092+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24883 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:04.099 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:04.097+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24905 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:09.073 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:09.076 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:09.102 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:09.100+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24923 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:14.106 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:14.104+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24947 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:19.110 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:19.107+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24965 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:24.114 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:24.111+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 24987 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:29.118 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:29.115+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25005 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:34.125 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:34.118+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25029 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:39.125 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:39.122+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25047 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:39.213 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:39.216 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:55:44.129 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:44.126+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25069 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:49.133 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:49.131+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25087 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:54.137 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:54.135+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:55:59.141 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:55:59.139+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25129 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:04.145 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:04.143+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25151 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:09.149 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:09.146+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25169 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:09.335 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:09.338 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:14.153 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:14.150+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25193 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:19.158 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:19.155+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25211 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:24.165 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:24.159+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25233 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:29.166 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:29.163+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25251 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:34.173 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:34.167+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25275 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:39.174 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:39.172+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25293 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:39.508 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:39.510 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:56:44.178 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:44.176+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25313 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:49.183 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:49.180+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25333 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:54.186 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:54.183+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25355 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:56:59.190 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:56:59.187+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25375 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:04.194 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:04.191+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25395 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:09.198 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:09.195+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25415 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:09.626 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:09.630 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:14.202 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:14.199+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25437 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:19.206 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:19.203+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25457 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:24.210 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:24.207+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25477 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:29.214 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:29.212+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25497 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:34.218 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:34.216+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25519 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:39.223 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:39.221+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25539 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:39.785 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:39.788 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:57:44.227 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:44.224+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25559 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:49.231 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:49.228+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25579 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:54.235 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:54.232+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25601 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:57:59.242 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:57:59.236+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25621 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:04.243 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:04.240+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25641 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:09.247 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:09.245+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25661 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:09.935 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:09.938 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:14.252 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:14.249+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25683 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:19.256 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:19.254+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25703 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:24.260 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:24.258+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25723 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:29.264 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:29.262+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25743 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:34.268 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:34.265+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25765 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:39.272 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:39.269+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25785 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:40.075 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:40.078 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:58:44.276 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:44.273+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25805 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:49.280 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:49.277+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25825 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:54.284 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:54.281+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25847 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:58:59.288 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:58:59.285+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25867 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:04.292 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:04.290+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25887 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:09.296 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:09.294+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:10.221 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:10.224 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:14.300 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:14.298+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25929 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:19.305 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:19.303+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25949 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:24.309 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:24.306+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25969 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:29.313 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:29.310+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 25989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:34.317 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:34.314+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26011 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:39.321 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:39.318+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26031 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:40.377 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:40.380 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T16:59:44.325 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:44.322+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26051 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:49.330 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:49.327+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26071 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:54.333 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:54.332+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26093 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T16:59:59.338 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T16:59:59.336+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:04.342 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:04.340+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26133 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:09.346 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:09.343+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26151 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:10.484 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:10.487 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:14.352 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:14.347+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26175 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:19.354 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:19.352+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26193 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:24.359 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:24.356+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26215 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:29.363 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:29.360+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26233 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:34.367 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:34.365+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26257 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:39.371 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:39.370+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26275 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:40.623 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:40.625 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:00:44.377 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:44.374+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26297 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:49.380 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:49.378+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26315 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:54.384 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:54.382+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26339 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:00:59.389 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:00:59.386+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26357 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:04.393 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:04.390+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26379 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:09.397 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:09.394+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26397 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:10.768 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:10.772 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:14.401 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:14.398+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26421 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:19.405 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:19.402+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26439 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:24.409 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:24.407+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26461 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:29.414 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:29.412+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26479 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:34.418 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:34.416+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26503 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:39.426 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:39.420+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26521 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:40.865 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:40.870 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:01:44.426 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:44.423+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26543 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:49.431 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:49.428+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26562 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:54.435 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:54.432+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26585 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:01:59.439 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:01:59.436+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26603 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:04.448 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:04.441+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26625 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:09.448 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:09.445+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26644 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:11.011 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:11.014 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:14.452 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:14.450+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26667 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:19.456 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:19.454+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26685 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:24.462 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:24.459+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26707 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:29.465 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:29.462+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26727 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:34.470 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:34.467+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26749 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:39.474 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:39.471+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26767 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:41.147 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:41.150 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:02:44.478 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:44.475+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26789 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:49.482 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:49.479+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26809 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:54.487 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:54.484+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26831 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:02:59.491 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:02:59.489+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26849 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:04.495 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:04.493+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26871 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:09.499 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:09.497+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26891 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:11.286 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:11.288 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:14.503 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:14.500+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26911 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:19.508 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:19.505+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26931 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:24.513 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:24.509+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26951 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:29.517 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:29.513+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26973 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:34.520 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:34.517+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 26993 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:39.525 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:39.522+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27013 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:41.417 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:41.420 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:03:44.529 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:44.526+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27033 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:49.534 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:49.532+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27055 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:54.538 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:54.536+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27075 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:03:59.542 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:03:59.540+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27095 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:04.546 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:04.543+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27115 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:09.552 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:09.548+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27137 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:11.556 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:11.559 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:14.555 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:14.552+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27157 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:19.559 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:19.556+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27177 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:24.564 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:24.561+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27197 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:29.567 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:29.565+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27219 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:34.572 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:34.570+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27239 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:39.581 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:39.574+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27259 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:41.677 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:41.679 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:04:44.581 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:44.579+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27279 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:49.585 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:49.582+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27301 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:54.589 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:54.586+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27321 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:04:59.594 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:04:59.591+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27341 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:04.599 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:04.596+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27361 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:09.606 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:09.600+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27383 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:11.822 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:11.825 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:14.607 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:14.604+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27403 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:19.611 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:19.608+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27423 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:24.617 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:24.614+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27443 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:29.620 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:29.618+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27465 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:34.624 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:34.622+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27485 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:39.628 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:39.625+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27505 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:41.932 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:41.935 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:05:44.633 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:44.630+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27525 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:49.637 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:49.634+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27547 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:54.641 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:54.638+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27567 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:05:59.646 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:05:59.643+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27587 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:04.650 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:04.647+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27607 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:09.655 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:09.653+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27629 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:12.081 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:12.084 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:14.659 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:14.657+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27649 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:19.663 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:19.661+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27669 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:24.667 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:24.664+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27689 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:29.672 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:29.669+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27709 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:34.677 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:34.674+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27731 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:39.682 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:39.678+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27749 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:42.262 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:42.265 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:06:44.685 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:44.682+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27771 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:49.690 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:49.687+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27791 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:54.694 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:54.691+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27813 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:06:59.698 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:06:59.696+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27831 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:04.703 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:04.701+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27853 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:09.710 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:09.705+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27873 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:12.408 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:12.411 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:14.711 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:14.709+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27895 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:19.716 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:19.713+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27914 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:24.720 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:24.717+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27935 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:29.725 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:29.722+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27956 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:34.729 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:34.726+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27977 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:39.733 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:39.730+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 27996 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:42.513 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:42.516 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:07:44.738 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:44.736+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28017 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:49.742 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:49.740+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28038 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:54.747 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:54.745+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28059 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:07:59.751 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:07:59.748+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28078 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:04.756 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:04.753+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28099 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:09.761 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:09.758+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28120 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:12.636 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:12.639 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:14.765 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:14.762+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28141 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:19.769 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:19.766+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28160 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:24.773 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:24.771+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:29.785 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:29.776+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28202 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:34.782 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:34.780+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28223 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:39.787 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:39.785+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28242 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:42.782 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:42.784 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:08:44.791 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:44.789+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28263 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:49.795 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:49.792+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28284 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:54.800 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:54.797+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28305 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:08:59.806 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:08:59.802+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28324 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:04.809 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:04.806+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28345 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:09.814 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:09.811+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28366 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:12.923 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:12.926 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:14.818 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:14.815+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28387 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:19.823 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:19.821+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28406 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:24.827 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:24.825+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28427 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:29.831 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:29.830+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28448 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:34.836 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:34.833+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28469 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:39.840 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:39.838+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28488 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:43.087 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:43.090 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:09:44.845 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:44.842+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28507 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:49.849 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:49.846+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28530 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:54.855 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:54.851+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28549 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:09:59.858 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:09:59.855+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28570 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:04.863 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:04.861+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28589 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:09.867 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:09.865+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28611 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:13.443 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:13.447 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:14.872 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:14.870+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28630 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:19.876 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:19.875+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28651 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:24.881 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:24.878+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28670 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:29.885 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:29.883+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28693 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:34.891 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:34.887+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28712 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:39.894 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:39.891+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28733 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:43.507 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:43.510 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:10:44.899 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:44.896+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28752 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:49.903 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:49.900+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28775 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:54.908 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:54.906+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28794 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:10:59.912 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:10:59.910+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28815 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:04.917 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:04.915+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28834 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:09.922 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:09.919+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28857 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:13.647 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:13.650 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:14.926 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:14.923+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28876 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:19.931 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:19.928+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28897 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:24.935 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:24.933+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28916 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:29.941 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:29.938+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28939 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:34.945 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:34.942+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28958 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:39.950 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:39.948+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28979 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:43.777 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:43.780 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:11:44.955 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:44.953+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 28998 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:49.960 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:49.958+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29021 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:54.965 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:54.963+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29057 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:11:59.969 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:11:59.967+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29099 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:04.974 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:04.972+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29137 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:09.979 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:09.977+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29181 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:13.925 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:13.929 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:14.984 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:14.981+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29219 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:19.989 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:19.986+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29261 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:24.993 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:24.991+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29299 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:30.000 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:29.996+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29343 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:35.003 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:35.001+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29381 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:40.008 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:40.006+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29423 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:44.081 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:44.084 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:12:45.012 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:45.009+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29461 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:50.017 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:50.014+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29505 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:12:55.021 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:12:55.019+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29543 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:00.027 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:00.024+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29583 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:05.031 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:05.029+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29623 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:10.042 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:10.033+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29665 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:14.204 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:14.206 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:15.040 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:15.039+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29705 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:20.046 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:20.044+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29745 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:25.050 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:25.048+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29785 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:30.056 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:30.054+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29827 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:35.060 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:35.057+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29867 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:40.064 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:40.062+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29907 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:44.339 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:44.341 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:13:45.069 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:45.066+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29947 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:50.074 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:50.071+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 29989 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:13:55.079 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:13:55.076+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30029 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:00.083 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:00.081+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30069 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:05.089 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:05.087+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30109 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:10.094 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:10.092+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30151 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:14.477 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:14.480 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:15.099 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:15.097+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30191 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:20.103 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:20.100+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30231 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:25.108 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:25.105+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30271 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:30.112 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:30.110+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30313 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:35.117 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:35.114+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30353 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:40.122 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:40.119+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30392 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:44.629 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:44.632 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:14:45.127 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:45.124+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30432 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:50.132 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:50.130+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30473 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:14:55.137 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:14:55.135+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30513 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:00.141 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:00.139+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30552 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:05.146 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:05.144+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30592 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:10.151 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:10.148+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30633 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:14.760 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:14.764 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:15.155 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:15.153+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30673 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:20.161 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:20.158+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30712 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:25.166 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:25.163+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30752 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:30.178 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:30.168+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30793 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:35.175 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:35.173+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30833 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:40.180 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:40.178+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30872 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:44.883 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:44.886 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:15:45.184 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:45.183+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30912 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:50.189 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:50.188+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30953 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:15:55.194 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:15:55.192+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 30993 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:00.204 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:00.197+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31032 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:05.204 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:05.201+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31072 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:10.209 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:10.206+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31113 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:15.031 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:15.034 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:15.214 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:15.211+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31153 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:20.219 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:20.216+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31192 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:25.224 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:25.221+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31230 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:30.229 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:30.227+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31273 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:35.234 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:35.232+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31311 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:40.239 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:40.237+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31352 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:45.185 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:45.188 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:16:45.243 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:45.241+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31390 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:50.248 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:50.245+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31434 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:16:55.253 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:16:55.250+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31471 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:00.257 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:00.255+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31513 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:05.262 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:05.259+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31550 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:10.267 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:10.264+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31594 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:15.272 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:15.270+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31631 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:15.312 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:15.315 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:20.276 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:20.275+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31673 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:25.281 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:25.280+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31710 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:30.286 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:30.283+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31754 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:35.291 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:35.288+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31791 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:40.296 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:40.293+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31833 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:45.301 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:45.298+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31870 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:45.378 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:45.380 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:17:50.306 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:50.303+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31914 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:17:55.311 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:17:55.308+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31951 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:00.316 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:00.313+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 31993 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:05.321 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:05.320+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32030 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:10.326 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:10.325+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32074 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:15.332 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:15.330+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32111 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:15.508 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:15.511 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:20.337 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:20.334+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32153 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:25.342 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:25.340+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32190 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:30.348 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:30.345+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32234 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:35.354 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:35.351+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32271 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:40.359 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:40.356+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32313 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:45.364 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:45.361+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32351 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:45.605 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:45.608 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:18:50.369 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:50.367+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32395 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:18:55.374 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:18:55.372+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32434 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:00.379 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:00.378+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32476 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:05.384 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:05.382+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32515 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:10.389 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:10.387+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32559 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:15.395 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:15.392+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32598 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:15.735 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:15.738 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:20.400 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:20.397+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32640 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:25.406 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:25.403+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32679 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:30.411 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:30.408+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32723 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:35.416 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:35.414+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32762 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:40.422 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:40.420+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32802 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:45.427 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:45.425+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32843 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:45.874 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:45.878 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:19:50.432 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:50.430+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32885 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:19:55.437 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:19:55.434+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32926 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:00.443 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:00.440+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 32966 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:05.448 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:05.445+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33007 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:10.453 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:10.450+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33049 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:15.458 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:15.455+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33090 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:16.019 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:16.022 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:20.463 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:20.460+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33130 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:25.469 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:25.467+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33171 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:30.474 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:30.472+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33213 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:35.479 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:35.477+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33254 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:40.484 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:40.482+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33294 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:45.490 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:45.487+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33335 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:46.128 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:46.131 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:20:50.496 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:50.493+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33376 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:20:55.501 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:20:55.498+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33416 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:00.506 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:00.503+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33456 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:05.511 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:05.509+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33498 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:10.517 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:10.515+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33538 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:15.522 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:15.520+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33578 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:16.271 INFO:teuthology.orchestra.run.smithi105:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:21:16.274 INFO:teuthology.orchestra.run.smithi180:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2020-02-12T17:21:20.527 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:20.525+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33618 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:25.531 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:25.530+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33660 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:30.537 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:30.534+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33700 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:35.542 INFO:tasks.ceph.mon.c.smithi105.stderr:2020-02-12T17:21:35.540+0000 7fc99115c700 -1 mon.c@2(probing) e1 get_health_metrics reporting 33740 slow ops, oldest is monmgrreport(0 checks, 0 progress events) 2020-02-12T17:21:37.732 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2020-02-12T17:21:37.732 DEBUG:teuthology.task.console_log:Killing console logger for smithi105 2020-02-12T17:21:37.733 DEBUG:teuthology.task.console_log:Killing console logger for smithi180 2020-02-12T17:21:37.733 DEBUG:teuthology.task.console_log:Killing console logger for smithi105 2020-02-12T17:21:37.733 DEBUG:teuthology.task.console_log:Killing console logger for smithi180 2020-02-12T17:21:37.733 DEBUG:teuthology.exit:Finished running handlers